Mar 22 04:02:05 ALPL402 syslogd 1.4.1: restart. Mar 22 04:22:02 ALPL402 kernel: md: syncing RAID array md0 Mar 22 04:22:02 ALPL402 kernel: md: minimum _guaranteed_ reconstruction speed: 1000 KB/sec/disc. Mar 22 04:22:02 ALPL402 kernel: md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for reconstruction. Mar 22 04:22:02 ALPL402 kernel: md: using 128k window, over a total of 521984 blocks. Mar 22 04:22:02 ALPL402 kernel: md: delaying resync of md1 until md0 has finished resync (they share one or more physical units) Mar 22 04:22:07 ALPL402 kernel: md: md0: sync done. Mar 22 04:22:07 ALPL402 kernel: md: syncing RAID array md1 Mar 22 04:22:07 ALPL402 kernel: md: minimum _guaranteed_ reconstruction speed: 1000 KB/sec/disc. Mar 22 04:22:07 ALPL402 kernel: md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for reconstruction. Mar 22 04:22:07 ALPL402 kernel: md: using 128k window, over a total of 4192896 blocks. Mar 22 04:22:07 ALPL402 kernel: RAID1 conf printout: Mar 22 04:22:07 ALPL402 kernel: --- wd:2 rd:2 Mar 22 04:22:07 ALPL402 kernel: disk 0, wo:0, o:1, dev:sda1 Mar 22 04:22:07 ALPL402 kernel: disk 1, wo:0, o:1, dev:sdb1 Mar 22 04:22:53 ALPL402 kernel: md: md1: sync done. Mar 22 04:22:53 ALPL402 kernel: RAID1 conf printout: Mar 22 04:22:53 ALPL402 kernel: --- wd:2 rd:2 Mar 22 04:22:53 ALPL402 kernel: disk 0, wo:0, o:1, dev:sda2 Mar 22 04:22:53 ALPL402 kernel: disk 1, wo:0, o:1, dev:sdb2 Mar 22 04:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 22 05:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 22 06:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 22 07:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 22 08:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 22 09:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 22 10:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 22 11:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 22 12:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 22 12:45:26 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 5eb20aa9-deba-61b3-f130-3ff1ec8e2f4d (at 10.3.3.61@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 22 12:45:40 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 22 13:25:35 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 22 13:25:37 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 2088aa40-f79e-335d-291f-512480fd9835 (at 10.3.2.50@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 22 13:25:37 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 22 13:25:37 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 2088aa40-f79e-335d-291f-512480fd9835 (at 10.3.2.50@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 22 13:25:37 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 22 13:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 22 14:25:09 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 17201fea-d9f3-e71d-ddb7-112edacf4eca (at 10.3.3.23@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 22 14:25:09 ALPL402 kernel: Lustre: Skipped 2 previous similar messages Mar 22 14:25:40 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 22 14:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 22 15:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 22 16:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 22 16:46:05 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 22 17:03:27 ALPL402 ntpd[6232]: time reset +0.495856 s Mar 22 17:07:44 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 22 17:09:14 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 22 17:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 22 17:45:28 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client bdee69f6-b31c-7cad-c866-52f19dc24387 (at 10.3.2.44@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 22 17:45:28 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 22 17:45:28 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client bdee69f6-b31c-7cad-c866-52f19dc24387 (at 10.3.2.44@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 22 17:45:28 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 22 18:01:49 ALPL402 ntpd[6232]: time reset -0.402899 s Mar 22 18:05:43 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 22 18:05:56 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 6c7f4ce1-106b-cfcd-42e0-5501be8985ad (at 10.3.3.33@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 22 18:06:03 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 22 18:06:11 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 22 18:10:21 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 22 18:25:09 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 7d8798c4-9083-43f3-cc1b-394af2edf331 (at 10.3.3.40@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 22 18:25:09 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 22 18:25:09 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 7d8798c4-9083-43f3-cc1b-394af2edf331 (at 10.3.3.40@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 22 18:25:09 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 22 18:25:24 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 22 18:25:37 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 22 18:28:41 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 22 18:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 22 18:36:08 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 22 19:05:13 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 1a48c227-e08d-be1b-a13c-47605d68afa0 (at 10.3.3.7@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 22 19:05:13 ALPL402 kernel: Lustre: Skipped 2 previous similar messages Mar 22 19:05:36 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 22 19:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 22 20:22:35 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 22 20:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 22 20:39:40 ALPL402 ntpd[6232]: time reset -0.322093 s Mar 22 20:43:59 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 22 20:46:09 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 22 21:02:18 ALPL402 ntpd[6232]: time reset -0.364370 s Mar 22 21:06:11 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 22 21:08:24 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 22 21:23:27 ALPL402 ntpd[6232]: time reset -0.234792 s Mar 22 21:27:30 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 22 21:29:39 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 22 21:31:28 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 22 21:44:18 ALPL402 ntpd[6232]: time reset -0.324701 s Mar 22 21:45:52 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 8baafe7a-e1a9-103a-3c7d-41e168436877 (at 10.3.4.1@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 22 21:45:52 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 22 21:45:52 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 8baafe7a-e1a9-103a-3c7d-41e168436877 (at 10.3.4.1@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 22 21:45:52 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 22 21:48:11 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 22 21:50:21 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 22 22:09:39 ALPL402 ntpd[6232]: time reset -0.394438 s Mar 22 22:13:28 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 22 22:16:43 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 22 22:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 22 22:34:41 ALPL402 ntpd[6232]: time reset -0.389679 s Mar 22 22:38:58 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 22 22:42:10 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 22 22:58:48 ALPL402 ntpd[6232]: time reset -0.375262 s Mar 22 23:03:02 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 22 23:06:17 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 22 23:15:57 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 22 23:31:28 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 00:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 01:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 02:31:28 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 03:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 03:52:48 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 23 04:10:44 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 23 04:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 04:45:05 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 23 05:00:01 ALPL402 auditd[4168]: Audit daemon rotating log files Mar 23 05:19:15 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 23 05:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 06:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 07:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 08:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 09:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 10:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 11:25:23 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 9be28f2b-025a-4018-dac6-f9aebb505571 (at 10.3.4.24@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 23 11:25:23 ALPL402 kernel: Lustre: Skipped 2 previous similar messages Mar 23 11:25:32 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 23 11:26:05 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 23 11:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 11:45:21 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client deba5140-718a-ef00-56c4-72a4ab6b2aee (at 10.3.3.36@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 23 11:45:21 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 23 11:45:21 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client deba5140-718a-ef00-56c4-72a4ab6b2aee (at 10.3.3.36@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 23 11:45:36 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 23 12:05:24 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 8b8b057c-63f1-03a6-e188-3d645a1464c2 (at 10.3.2.15@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 23 12:05:24 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 23 12:05:36 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 23 12:25:26 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 3aa17f0e-0972-f786-ebc7-5c6a3da82bda (at 10.3.2.48@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 23 12:25:26 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 23 12:25:26 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 3aa17f0e-0972-f786-ebc7-5c6a3da82bda (at 10.3.2.48@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 23 12:25:35 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 23 12:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 13:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 14:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 15:25:10 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 871b1ba7-dc43-b946-e07a-a1e01721103e (at 10.3.2.45@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 23 15:25:10 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 23 15:25:34 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 23 15:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 15:45:12 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 371901af-b2b2-b190-12ef-3ef7420075ea (at 10.3.2.32@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 23 15:45:12 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 23 15:45:12 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 371901af-b2b2-b190-12ef-3ef7420075ea (at 10.3.2.32@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 23 15:45:12 ALPL402 kernel: Lustre: Skipped 15 previous similar messages Mar 23 15:45:36 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 23 15:46:29 ALPL402 last message repeated 2 times Mar 23 15:47:06 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 23 16:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 17:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 18:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 19:05:33 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 16f325b0-f300-b443-5573-916730ce3073 (at 10.3.2.42@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 23 19:05:33 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 23 19:05:36 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 23 19:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 19:45:27 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client c2333014-1207-b9a0-0b90-eb829d85e3f4 (at 10.3.4.7@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 23 19:45:27 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 23 19:45:40 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 23 19:46:11 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 23 20:25:07 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 2971cc12-a5ac-9fbf-987f-54fecb80ccf4 (at 10.3.2.49@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 23 20:25:07 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 23 20:25:33 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 23 20:31:28 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 21:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 22:05:24 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 4b37ea3f-3b31-a8d8-4b63-6f812ade7544 (at 10.3.9.32@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 23 22:05:24 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 23 22:05:24 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 4b37ea3f-3b31-a8d8-4b63-6f812ade7544 (at 10.3.9.32@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 23 22:06:09 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 23 22:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 23 23:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 00:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 00:45:29 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client db7c6214-23dd-14b8-d945-e97bdfc35149 (at 10.3.3.54@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 00:45:29 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 24 00:45:29 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client db7c6214-23dd-14b8-d945-e97bdfc35149 (at 10.3.3.54@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 00:45:29 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 24 00:45:29 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 01:05:06 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client a3aac1c0-2b4a-1efe-1a4c-8069d851135c (at 10.3.9.1@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 01:05:34 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 01:06:22 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 01:07:02 ALPL402 last message repeated 2 times Mar 24 01:07:18 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 118862bd-4bd7-cefb-5560-f5a1c59f8307 (at 10.3.9.26@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 01:07:18 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 24 01:07:30 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 01:07:57 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 01:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 01:47:25 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 24 02:22:26 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 24 02:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 03:12:45 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 24 03:30:01 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 24 03:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 04:25:05 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 4749bf06-d4b2-2204-295e-460c7b6102fc (at 10.3.2.32@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 04:25:05 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 24 04:25:30 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 04:26:01 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 04:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 05:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 06:25:04 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 78f8daca-f15d-dd2f-82dd-f9a356ee1be4 (at 10.3.1.55@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 06:25:04 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 24 06:25:34 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 06:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 07:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 08:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 09:14:32 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client d380ad42-74b5-f939-cc25-15e6b5a3684b (at 10.3.8.18@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 09:14:32 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 24 09:14:32 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client d380ad42-74b5-f939-cc25-15e6b5a3684b (at 10.3.8.18@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 09:27:06 ALPL402 kernel: LustreError: 14425:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-107) req@ffff8105ebbea000 x1494613909667482/t0 o400->@:0/0 lens 192/0 e 0 to 0 dl 1427160443 ref 1 fl Interpret:H/0/0 rc -107/0 Mar 24 09:27:06 ALPL402 kernel: LustreError: 14425:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 1 previous similar message Mar 24 09:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 09:45:00 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 75376e77-4ed0-0fb3-14b5-5514a030078a (at 10.3.3.62@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 09:45:00 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 24 09:45:33 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 10:05:21 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client eae73e49-3988-9791-1d63-f29311e241da (at 10.3.2.37@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 10:05:21 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 24 10:05:21 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client eae73e49-3988-9791-1d63-f29311e241da (at 10.3.2.37@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 10:05:21 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 24 10:05:34 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 10:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 10:39:38 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client d380ad42-74b5-f939-cc25-15e6b5a3684b (at 10.3.8.18@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 10:39:38 ALPL402 kernel: Lustre: Skipped 2 previous similar messages Mar 24 11:00:55 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 11:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 11:45:12 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 2df29833-109b-194d-b263-0ab850b56514 (at 10.3.9.8@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 11:45:12 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 24 11:45:12 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 2df29833-109b-194d-b263-0ab850b56514 (at 10.3.9.8@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 11:45:12 ALPL402 kernel: Lustre: Skipped 5 previous similar messages Mar 24 11:45:58 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 11:46:33 ALPL402 last message repeated 2 times Mar 24 12:05:02 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 9ea92ddd-2c2f-f3e5-f4a2-359d2f875d1c (at 10.3.3.5@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 12:05:02 ALPL402 kernel: Lustre: Skipped 8 previous similar messages Mar 24 12:05:34 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 12:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 13:05:01 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client d6a31f10-3bf0-4e3e-c201-c3dd33a5dfeb (at 10.3.4.29@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 13:05:01 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 24 13:06:01 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 13:06:12 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 13:25:00 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 2a2700bf-2d19-e0ac-0e90-fbaad38ded83 (at 10.3.2.27@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 13:25:00 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 24 13:25:00 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 2a2700bf-2d19-e0ac-0e90-fbaad38ded83 (at 10.3.2.27@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 13:25:00 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 24 13:25:32 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 13:31:28 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 13:57:32 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 14:02:25 ALPL402 kernel: Lustre: 13641:0:(client.c:1529:ptlrpc_expire_one_request()) @@@ Request x1495852777090911 sent from LFS05-OST0059 to NID 10.3.9.30@o2ib 7s ago has timed out (7s prior to deadline). Mar 24 14:02:25 ALPL402 kernel: req@ffff81052911bc00 x1495852777090911/t0 o104->@NET_0x500000a03091e_UUID:15/16 lens 296/384 e 0 to 1 dl 1427176945 ref 2 fl Rpc:N/0/0 rc 0/0 Mar 24 14:02:25 ALPL402 kernel: LustreError: 138-a: LFS05-OST0059: A client on nid 10.3.9.30@o2ib was evicted due to a lock blocking callback to 10.3.9.30@o2ib timed out: rc -107 Mar 24 14:05:25 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 14:05:30 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client c2848d9f-e3cd-49af-a13c-350eef1ff7ff (at 10.3.9.30@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 14:05:30 ALPL402 kernel: Lustre: Skipped 2 previous similar messages Mar 24 14:25:24 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 6ff885b3-49a6-e5dd-5b26-3156ac626eeb (at 10.3.4.41@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 14:25:24 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 24 14:25:24 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 6ff885b3-49a6-e5dd-5b26-3156ac626eeb (at 10.3.4.41@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 14:25:24 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 24 14:25:32 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 14:26:03 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 14:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 14:33:04 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client b11d177d-e1e5-b259-752f-9e543728b1e7 (at 10.3.3.55@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 14:33:04 ALPL402 kernel: Lustre: Skipped 5 previous similar messages Mar 24 15:25:10 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client c510c9c0-7ad9-14ac-2fe6-82c3cc1a21ce (at 10.3.8.59@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 15:25:10 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 24 15:25:39 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 15:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 16:05:22 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 5ca706ea-e3a1-45d0-634c-b771c3daf9f5 (at 10.3.4.14@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 16:05:22 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 24 16:05:22 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 5ca706ea-e3a1-45d0-634c-b771c3daf9f5 (at 10.3.4.14@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 16:05:22 ALPL402 kernel: Lustre: Skipped 11 previous similar messages Mar 24 16:05:31 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 16:06:07 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 16:06:58 ALPL402 last message repeated 2 times Mar 24 16:14:21 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 22cb8b33-48b9-e4f2-c43a-ac3ac0dd5a52 (at 10.3.5.14@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 16:14:21 ALPL402 kernel: Lustre: Skipped 7 previous similar messages Mar 24 16:25:10 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 2735af5c-a978-f6b0-7d57-e38299fbe065 (at 10.3.2.44@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 16:25:10 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 24 16:25:26 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 16:25:57 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 16:27:08 ALPL402 last message repeated 2 times Mar 24 16:27:24 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 0c77fc6d-f2dd-3fe0-4327-3147c8649991 (at 10.3.7.8@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 16:27:24 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 24 16:27:32 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 16:28:07 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 16:29:16 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 6c25023e-9b5b-b857-c2c1-0eba6fc6c27b (at 10.3.8.61@o2ib) in 303 seconds. I think it's dead, and I am evicting it. Mar 24 16:29:16 ALPL402 kernel: Lustre: Skipped 24 previous similar messages Mar 24 16:29:48 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 6c25023e-9b5b-b857-c2c1-0eba6fc6c27b (at 10.3.8.61@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 16:29:48 ALPL402 kernel: Lustre: Skipped 2 previous similar messages Mar 24 16:30:32 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 16:31:08 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 16:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 16:31:37 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 16:32:12 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 16:34:09 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 16:35:47 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 563f892c-0835-685b-9b5f-e334974eb913 (at 10.3.8.27@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 16:35:47 ALPL402 kernel: Lustre: Skipped 11 previous similar messages Mar 24 16:45:18 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client e6670c14-ccaa-7ca3-0b98-3bed46ae3cbf (at 10.3.4.1@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 16:45:18 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 24 16:45:35 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 16:46:33 ALPL402 last message repeated 2 times Mar 24 16:47:29 ALPL402 last message repeated 2 times Mar 24 16:47:32 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 64ace192-3eb5-5c90-af06-3a44964e6356 (at 10.3.5.25@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 16:47:32 ALPL402 kernel: Lustre: Skipped 14 previous similar messages Mar 24 16:48:00 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 16:48:38 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 16:49:06 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 16:49:24 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client cd235a28-6a1f-b6ae-d8ff-8d329ac7a4b5 (at 10.3.6.29@o2ib) in 322 seconds. I think it's dead, and I am evicting it. Mar 24 16:49:24 ALPL402 kernel: Lustre: Skipped 24 previous similar messages Mar 24 16:49:35 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 16:50:07 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 16:51:08 ALPL402 last message repeated 2 times Mar 24 16:51:16 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 05c99649-0c6f-1575-0475-e05b864b6c66 (at 10.3.9.10@o2ib) in 262 seconds. I think it's dead, and I am evicting it. Mar 24 16:51:16 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 24 16:51:34 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 16:52:13 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 16:52:26 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 16:53:20 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 77d741a0-6c95-349d-f792-a36134d01f71 (at 10.3.9.21@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 16:53:20 ALPL402 kernel: Lustre: Skipped 10 previous similar messages Mar 24 16:53:24 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 17:05:09 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 8cbf5bac-f4d5-5e0e-94cc-1ec138129c27 (at 10.3.1.54@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 17:05:09 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 24 17:05:34 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 17:06:07 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 17:07:43 ALPL402 last message repeated 3 times Mar 24 17:25:32 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 17:25:44 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client bac6c40f-e5bb-1341-d909-3b334e442ee5 (at 10.3.9.4@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 17:25:44 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 24 17:26:02 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 17:26:34 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 17:27:23 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 17:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 17:44:57 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 4c101156-5fb9-e609-057d-a5772911f5ac (at 10.3.4.35@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 17:44:57 ALPL402 kernel: Lustre: Skipped 14 previous similar messages Mar 24 17:45:29 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 17:46:00 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 17:46:32 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 17:46:50 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client bc498f85-de82-101b-c23a-0997cf2fcc45 (at 10.3.5.59@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 17:46:50 ALPL402 kernel: Lustre: Skipped 14 previous similar messages Mar 24 17:47:00 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 17:47:37 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 17:48:11 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 18:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 19:04:59 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 1e3b58db-4664-fdee-1645-45f064aa6927 (at 10.3.2.21@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 19:04:59 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 24 19:05:32 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 19:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 20:05:30 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client fe687965-a30d-d7d2-5e57-8784a0b6b021 (at 10.3.5.27@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 20:05:30 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 24 20:05:30 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 20:06:08 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 20:07:13 ALPL402 last message repeated 2 times Mar 24 20:07:38 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 20:07:57 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client b51c8552-9201-2938-26b7-ffff9d7d4647 (at 10.3.9.12@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 20:07:57 ALPL402 kernel: Lustre: Skipped 24 previous similar messages Mar 24 20:08:13 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 20:08:54 ALPL402 last message repeated 2 times Mar 24 20:09:28 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 20:25:05 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client da21dba5-d358-2a48-56a7-475de274aba9 (at 10.3.3.6@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 20:25:05 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 24 20:25:25 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 20:25:58 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 20:26:32 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 20:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 21:05:32 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client cf231887-d4f8-2be1-37d2-e33b8f34f29a (at 10.3.2.23@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 21:05:32 ALPL402 kernel: Lustre: Skipped 14 previous similar messages Mar 24 21:05:33 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 21:06:30 ALPL402 last message repeated 2 times Mar 24 21:07:07 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 21:07:29 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client c158ca20-de8e-cafb-5222-99cb0882ef3a (at 10.3.5.3@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 21:07:29 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 24 21:07:30 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 21:14:50 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 4bb16068-86c1-baee-fce1-a2c1e7025235 (at 10.3.2.48@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 21:14:50 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 24 21:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 21:45:31 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 22:05:26 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 053178b7-9725-282a-c942-f91a42a0bafd (at 10.3.5.9@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 22:05:26 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 24 22:05:33 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 22:06:38 ALPL402 last message repeated 2 times Mar 24 22:06:59 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 22:07:22 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client acc04756-7e86-f3b6-8ad7-5ff2c14a8813 (at 10.3.6.2@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 22:07:22 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 24 22:07:32 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 22:08:33 ALPL402 last message repeated 2 times Mar 24 22:09:03 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 22:09:23 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client b22a62f5-53c3-321f-c7fc-bba9fa817c4d (at 10.3.7.13@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 22:09:23 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 24 22:10:04 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 22:10:35 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 22:11:35 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 22:11:51 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client ee2781db-e9fa-b821-69f6-2e17000e10db (at 10.3.7.25@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 22:11:51 ALPL402 kernel: Lustre: Skipped 24 previous similar messages Mar 24 22:12:04 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 22:13:18 ALPL402 last message repeated 2 times Mar 24 22:25:25 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client a025d710-f376-b6fa-9bbd-0f0bf5cc3d5c (at 10.3.1.55@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 22:25:25 ALPL402 kernel: Lustre: Skipped 14 previous similar messages Mar 24 22:25:29 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 22:26:01 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 22:26:30 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 22:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 22:45:04 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 82611064-8c23-8234-e2b4-aa7566161f8b (at 10.3.3.54@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 22:45:04 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 24 22:45:25 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 22:46:01 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 22:46:21 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 23:25:03 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client cf664f9f-9128-a41f-14d0-5e867802a805 (at 10.3.2.42@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 23:25:03 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 24 23:25:03 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client cf664f9f-9128-a41f-14d0-5e867802a805 (at 10.3.2.42@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 23:25:03 ALPL402 kernel: Lustre: Skipped 7 previous similar messages Mar 24 23:25:28 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 23:26:33 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 23:27:21 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 987be3cc-686f-1f0f-42bb-c79f133ddbce (at 10.3.5.17@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 23:27:21 ALPL402 kernel: Lustre: Skipped 11 previous similar messages Mar 24 23:27:41 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 23:29:13 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client cb78624a-8695-0620-bd2d-16d8619a28a0 (at 10.3.6.52@o2ib) in 293 seconds. I think it's dead, and I am evicting it. Mar 24 23:29:13 ALPL402 kernel: Lustre: Skipped 24 previous similar messages Mar 24 23:29:33 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 23:29:55 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client cb78624a-8695-0620-bd2d-16d8619a28a0 (at 10.3.6.52@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 23:29:55 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 24 23:30:01 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 23:30:34 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 23:31:06 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client cab17d39-9eb7-ebc9-619a-238bca42fdb6 (at 10.3.6.63@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 23:31:06 ALPL402 kernel: Lustre: Skipped 14 previous similar messages Mar 24 23:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 24 23:31:40 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 23:31:47 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 4f4814fe-21d1-405b-7c61-68344f6d4be9 (at 10.3.8.58@o2ib) in 302 seconds. I think it's dead, and I am evicting it. Mar 24 23:31:47 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 24 23:32:20 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 4f4814fe-21d1-405b-7c61-68344f6d4be9 (at 10.3.8.58@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 23:32:20 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 24 23:32:49 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 23:33:25 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 23:45:02 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 13bd0fc3-6b61-3431-58ba-9f16579bd1b5 (at 10.3.2.56@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 23:45:02 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 24 23:45:31 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 23:47:06 ALPL402 last message repeated 2 times Mar 24 23:47:30 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 23:47:46 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 195f5cb2-0c35-4ca9-834e-07dc416cd09e (at 10.3.5.43@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 23:47:46 ALPL402 kernel: Lustre: Skipped 14 previous similar messages Mar 24 23:48:03 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 23:49:00 ALPL402 last message repeated 2 times Mar 24 23:49:31 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 23:50:04 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client af3515a5-a19e-07d6-d4dd-f4d0b3e09650 (at 10.3.6.32@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 24 23:50:04 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 24 23:50:07 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 23:51:03 ALPL402 last message repeated 2 times Mar 24 23:51:33 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 23:51:56 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client ea3e8704-479b-bc2a-6264-796b35e7846b (at 10.3.7.15@o2ib) in 324 seconds. I think it's dead, and I am evicting it. Mar 24 23:51:56 ALPL402 kernel: Lustre: Skipped 24 previous similar messages Mar 24 23:52:11 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 23:53:33 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 23:53:59 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 05bf0c14-01ae-9e25-b9bb-3fa4a237c646 (at 10.3.8.45@o2ib) in 297 seconds. I think it's dead, and I am evicting it. Mar 24 23:53:59 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 24 23:54:08 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 24 23:56:14 ALPL402 last message repeated 2 times Mar 25 00:25:32 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 00:25:33 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 1ed226f5-e144-23fd-70bf-b0a5f52dc3df (at 10.3.1.63@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 00:25:33 ALPL402 kernel: Lustre: Skipped 14 previous similar messages Mar 25 00:26:04 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 00:27:04 ALPL402 last message repeated 2 times Mar 25 00:27:25 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client a26c0d2f-4bad-07a4-ef78-8841534f5ea0 (at 10.3.4.55@o2ib) in 300 seconds. I think it's dead, and I am evicting it. Mar 25 00:27:25 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 25 00:27:29 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 00:28:00 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client a26c0d2f-4bad-07a4-ef78-8841534f5ea0 (at 10.3.4.55@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 00:28:00 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 25 00:28:03 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 00:28:38 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 00:30:03 ALPL402 last message repeated 3 times Mar 25 00:31:10 ALPL402 last message repeated 2 times Mar 25 00:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 00:31:43 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 00:32:02 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client fc79150c-3db0-c1d5-09a1-723b7c81eefd (at 10.3.9.9@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 00:32:02 ALPL402 kernel: Lustre: Skipped 7 previous similar messages Mar 25 00:32:28 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 00:45:02 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 7ec8c9c3-814f-0a96-b9b8-b7b8c59f2998 (at 10.3.1.56@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 00:45:02 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 25 00:45:27 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 00:46:05 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 01:07:42 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 25 01:24:56 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client cb90fe6f-dd66-cbab-f600-c593f8dfece2 (at 10.3.4.16@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 01:24:56 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 25 01:25:28 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 01:26:01 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 01:26:29 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 01:27:01 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 52a721fd-2f86-3fd0-e811-a09270aedaa0 (at 10.3.5.50@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 01:27:01 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 25 01:27:02 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 01:27:56 ALPL402 last message repeated 2 times Mar 25 01:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 01:34:18 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 7be21a34-563c-aac1-3f2d-29cd1e9dbaac (at 10.3.4.45@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 01:34:18 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 25 01:42:33 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 25 01:45:27 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 0d61af74-9a1c-2f5e-c60b-1c2666614119 (at 10.3.2.56@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 01:45:27 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 25 01:45:30 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 0d61af74-9a1c-2f5e-c60b-1c2666614119 (at 10.3.2.56@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 01:45:30 ALPL402 kernel: Lustre: Skipped 14 previous similar messages Mar 25 01:45:31 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 01:46:31 ALPL402 last message repeated 2 times Mar 25 01:47:32 ALPL402 last message repeated 2 times Mar 25 02:05:19 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client c4bdd3e4-b65c-bf24-373b-fd6c8b7784a5 (at 10.3.1.64@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 02:05:19 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 25 02:05:36 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 02:06:00 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 02:25:10 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client f75901da-16b7-c350-ab6b-d3963d6ba867 (at 10.3.4.9@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 02:25:10 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 25 02:25:38 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 02:26:34 ALPL402 last message repeated 2 times Mar 25 02:26:58 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 02:27:03 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client d8cefc74-4a3d-ee98-ac2d-7cafda5a5353 (at 10.3.5.46@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 02:27:03 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 25 02:27:28 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 02:28:01 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 02:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 02:33:50 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 725b7508-f3fd-b46f-d108-74dec363493c (at 10.3.4.9@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 02:33:50 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 25 03:04:55 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client e24930fe-11c2-5688-30f8-e2ce3121cd7b (at 10.3.3.33@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 03:04:55 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 25 03:05:27 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 03:06:00 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 03:06:28 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 03:06:53 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client d650251c-dd97-a113-9158-fc5dbb95e109 (at 10.3.6.1@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 03:06:53 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 25 03:07:00 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 03:08:04 ALPL402 last message repeated 2 times Mar 25 03:09:03 ALPL402 last message repeated 2 times Mar 25 03:09:22 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 298287b8-084c-21aa-a3ba-ed2679149cc5 (at 10.3.8.23@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 03:09:22 ALPL402 kernel: Lustre: Skipped 24 previous similar messages Mar 25 03:09:33 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 03:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 03:45:26 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client ff302238-eecb-109d-1387-cc15ea36e82e (at 10.3.3.49@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 03:45:26 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 25 03:45:30 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 04:25:13 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 09d0365e-274e-09fa-2705-f75deef6a7d5 (at 10.3.6.11@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 04:25:13 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 25 04:25:13 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 8e8c34c9-885e-9f4d-c4f0-c3e4b546bdf8 (at 10.3.6.14@o2ib) in 264 seconds. I think it's dead, and I am evicting it. Mar 25 04:25:13 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 25 04:25:32 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 04:26:26 ALPL402 last message repeated 2 times Mar 25 04:27:00 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 04:27:05 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 7e4dc57c-6856-1184-a70b-845a992337a7 (at 10.3.6.19@o2ib) in 333 seconds. I think it's dead, and I am evicting it. Mar 25 04:27:05 ALPL402 kernel: Lustre: Skipped 17 previous similar messages Mar 25 04:27:31 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 04:28:31 ALPL402 last message repeated 2 times Mar 25 04:29:04 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 04:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 04:45:14 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 4722d546-2618-74ab-396a-781c30a48802 (at 10.3.5.6@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 04:45:14 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 25 04:45:34 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 04:46:07 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 04:46:35 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 04:47:06 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 499e10d8-03e1-8909-24ba-ee5eb5cf2cc2 (at 10.3.6.27@o2ib) in 306 seconds. I think it's dead, and I am evicting it. Mar 25 04:47:06 ALPL402 kernel: Lustre: Skipped 24 previous similar messages Mar 25 04:47:09 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 04:47:32 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 04:47:35 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 499e10d8-03e1-8909-24ba-ee5eb5cf2cc2 (at 10.3.6.27@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 04:47:35 ALPL402 kernel: Lustre: Skipped 11 previous similar messages Mar 25 04:47:57 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 04:48:37 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 04:49:03 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 04:49:30 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 3246709d-ff7e-492a-3087-2b9c6c3c1f85 (at 10.3.8.39@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 04:49:30 ALPL402 kernel: Lustre: Skipped 2 previous similar messages Mar 25 04:49:31 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 04:50:06 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 04:55:51 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 4e4dd571-2e18-3162-fcb6-a5e73d42f6c4 (at 10.3.6.21@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 04:55:51 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 25 05:05:01 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 6ba0f53b-4824-b5b8-6419-5340fd23b896 (at 10.3.2.63@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 05:05:01 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 25 05:05:27 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 05:25:30 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client c83f56ff-7015-3298-0f94-d17ec5a7e7f2 (at 10.3.9.5@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 05:25:30 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 25 05:25:31 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 05:26:23 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 05:26:27 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 05:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 06:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 07:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 07:45:00 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client ff8f1df3-a289-1808-68a5-343af10d913c (at 10.3.3.42@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 07:45:00 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 25 07:45:29 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 07:46:27 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 08:25:25 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 75383426-fef6-1906-5d08-1671f6df0d52 (at 10.3.4.32@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 08:25:25 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 25 08:25:57 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 08:26:27 ALPL402 last message repeated 2 times Mar 25 08:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 08:45:02 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client d71afa90-aa04-dbb6-0b86-ae0829f92783 (at 10.3.4.3@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 08:45:02 ALPL402 kernel: Lustre: Skipped 14 previous similar messages Mar 25 08:45:02 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client d71afa90-aa04-dbb6-0b86-ae0829f92783 (at 10.3.4.3@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 08:45:02 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 25 08:45:27 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 08:46:00 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 08:47:07 ALPL402 last message repeated 2 times Mar 25 09:05:16 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client b970b091-28eb-ead4-196b-0d04e405ba79 (at 10.3.2.48@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 09:05:16 ALPL402 kernel: Lustre: Skipped 15 previous similar messages Mar 25 09:05:25 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 09:05:47 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 09:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 09:44:57 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 7a0390e7-7fe0-70ec-05e9-1fee0359a268 (at 10.3.3.3@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 09:44:57 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 25 09:44:57 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 7a0390e7-7fe0-70ec-05e9-1fee0359a268 (at 10.3.3.3@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 09:44:57 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 25 09:45:31 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 09:46:31 ALPL402 last message repeated 2 times Mar 25 09:46:49 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client f6d289f2-9ea8-c2bd-6494-bbbaa9a23939 (at 10.3.6.37@o2ib) in 324 seconds. I think it's dead, and I am evicting it. Mar 25 09:46:49 ALPL402 kernel: Lustre: Skipped 15 previous similar messages Mar 25 09:46:59 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 09:47:00 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client f6d289f2-9ea8-c2bd-6494-bbbaa9a23939 (at 10.3.6.37@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 09:47:00 ALPL402 kernel: Lustre: Skipped 11 previous similar messages Mar 25 09:47:24 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 09:48:01 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 09:48:28 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 10:05:06 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 960cc361-53df-b8a1-7e3a-4bda4d38157c (at 10.3.9.17@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 10:05:06 ALPL402 kernel: Lustre: Skipped 2 previous similar messages Mar 25 10:24:53 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 48a4bc6f-7470-8393-01ee-3b23c68423a6 (at 10.3.5.18@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 10:24:53 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 25 10:25:29 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 10:26:20 ALPL402 last message repeated 2 times Mar 25 10:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 11:05:19 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 20daa1a9-8c3d-99b6-5ccd-e4e134239792 (at 10.3.9.9@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 11:05:19 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 25 11:05:19 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 20daa1a9-8c3d-99b6-5ccd-e4e134239792 (at 10.3.9.9@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 11:05:19 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 25 11:05:54 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 11:25:21 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 11:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 11:45:14 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 5403955d-10f2-c2cd-fcae-0467148bafd2 (at 10.3.2.18@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 11:45:14 ALPL402 kernel: Lustre: Skipped 7 previous similar messages Mar 25 11:45:30 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 12:04:58 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 2b069ca9-f053-07d4-9915-581556f9486f (at 10.3.9.18@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 12:04:58 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 25 12:04:58 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 2b069ca9-f053-07d4-9915-581556f9486f (at 10.3.9.18@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 12:04:58 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 25 12:05:26 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 12:06:44 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 12:06:53 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 12:25:10 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client d337a0da-fc80-a2b5-bdb7-85cb4af9793e (at 10.3.4.63@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 12:25:10 ALPL402 kernel: Lustre: Skipped 15 previous similar messages Mar 25 12:25:25 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 12:26:00 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 12:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 12:45:06 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 3b0a7bc6-24ff-83ae-3387-071a8716cc71 (at 10.3.2.21@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 12:45:06 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 25 12:45:06 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 3b0a7bc6-24ff-83ae-3387-071a8716cc71 (at 10.3.2.21@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 12:45:06 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 25 12:45:29 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 12:45:52 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 13:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 13:44:56 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 74330132-bb8d-511f-de30-9d85ad22e3ae (at 10.3.2.3@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 13:44:56 ALPL402 kernel: Lustre: Skipped 2 previous similar messages Mar 25 14:05:33 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 14:05:48 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 46c143db-b9af-a11c-027a-a3cfa20aecd5 (at 10.3.9.5@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 14:05:48 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 25 14:05:48 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 46c143db-b9af-a11c-027a-a3cfa20aecd5 (at 10.3.9.5@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 14:05:48 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 25 14:06:29 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 14:06:33 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 14:24:57 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client d1cfbd34-aea7-80bf-6cb7-3d324ba1b6dc (at 10.3.5.2@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 14:24:57 ALPL402 kernel: Lustre: Skipped 7 previous similar messages Mar 25 14:25:30 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 14:26:07 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 14:26:58 ALPL402 last message repeated 2 times Mar 25 14:27:10 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 7be528b9-848b-151c-a007-41f3dde6f7f7 (at 10.3.6.54@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 14:27:10 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 25 14:27:35 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 14:28:27 ALPL402 last message repeated 2 times Mar 25 14:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 14:45:28 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 14:45:30 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client e738b0ab-38e8-f8d9-87bf-d01ca301fef6 (at 10.3.3.3@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 14:45:30 ALPL402 kernel: Lustre: Skipped 14 previous similar messages Mar 25 15:24:58 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 34d88127-649c-999a-88d3-fb4cda08b3e6 (at 10.3.3.23@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 15:24:58 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 25 15:24:58 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 34d88127-649c-999a-88d3-fb4cda08b3e6 (at 10.3.3.23@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 15:24:58 ALPL402 kernel: Lustre: Skipped 5 previous similar messages Mar 25 15:25:26 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 15:26:01 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 15:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 15:45:15 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 220df50b-a9c3-622e-d3c1-144907e17d4e (at 10.3.2.21@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 15:45:15 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 25 15:45:27 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 15:46:35 ALPL402 last message repeated 2 times Mar 25 15:47:02 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 16:00:34 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 6e94dc22-b462-936b-13da-8ca7350ae616 (at 10.3.1.38@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 16:00:34 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 25 16:00:34 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 6e94dc22-b462-936b-13da-8ca7350ae616 (at 10.3.1.38@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 16:00:34 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 25 16:01:43 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 16:04:59 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 9be58b88-13ae-cd7a-372a-a7b498fc32fa (at 10.3.2.20@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 16:05:27 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 16:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 17:05:22 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 5c49a4c6-da43-d2f0-8ec7-ad757f7d47ef (at 10.3.2.9@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 17:05:22 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 25 17:05:29 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 17:06:01 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 17:25:07 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client f99c6118-e884-c819-2d98-13a483d04a16 (at 10.3.2.26@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 17:25:07 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 25 17:25:07 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client f99c6118-e884-c819-2d98-13a483d04a16 (at 10.3.2.26@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 17:25:07 ALPL402 kernel: Lustre: Skipped 2 previous similar messages Mar 25 17:25:23 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 17:25:58 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 17:26:35 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 17:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 17:45:28 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 17:45:29 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client c8f17db1-3268-1faf-4a85-efd8f11a08ea (at 10.3.3.4@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 17:45:29 ALPL402 kernel: Lustre: Skipped 11 previous similar messages Mar 25 17:45:59 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 18:29:30 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client a8dbd026-f198-8295-3c09-a7a86a4eafdb (at 10.3.6.66@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 18:29:30 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 25 18:29:34 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client a8dbd026-f198-8295-3c09-a7a86a4eafdb (at 10.3.6.66@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 18:29:37 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client a8dbd026-f198-8295-3c09-a7a86a4eafdb (at 10.3.6.66@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 18:29:39 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client a8dbd026-f198-8295-3c09-a7a86a4eafdb (at 10.3.6.66@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 18:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 18:34:25 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client a8dbd026-f198-8295-3c09-a7a86a4eafdb (at 10.3.6.66@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 18:35:15 ALPL402 kernel: LustreError: 13645:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-107) req@ffff8105d0e66c00 x1478417547717612/t0 o101->@:0/0 lens 296/0 e 0 to 0 dl 1427279758 ref 1 fl Interpret:/0/0 rc -107/0 Mar 25 18:35:15 ALPL402 kernel: LustreError: 13645:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 13 previous similar messages Mar 25 18:40:19 ALPL402 kernel: LustreError: 13613:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-107) req@ffff8105f2194c00 x1478417547704508/t0 o400->@:0/0 lens 192/0 e 0 to 0 dl 1427280103 ref 1 fl Interpret:H/0/0 rc -107/0 Mar 25 18:40:19 ALPL402 kernel: LustreError: 13613:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 3 previous similar messages Mar 25 18:40:21 ALPL402 kernel: LustreError: 13696:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-107) req@ffff8105f2194c00 x1478417547704779/t0 o400->@:0/0 lens 192/0 e 0 to 0 dl 1427280105 ref 1 fl Interpret:H/0/0 rc -107/0 Mar 25 18:40:21 ALPL402 kernel: LustreError: 13696:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 2 previous similar messages Mar 25 18:40:24 ALPL402 kernel: LustreError: 13656:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-107) req@ffff810631fe3c00 x1478417547768935/t0 o400->@:0/0 lens 192/0 e 0 to 0 dl 1427280108 ref 1 fl Interpret:H/0/0 rc -107/0 Mar 25 18:40:24 ALPL402 kernel: LustreError: 13656:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 669 previous similar messages Mar 25 18:40:50 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client a8dbd026-f198-8295-3c09-a7a86a4eafdb (at 10.3.6.66@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 18:41:12 ALPL402 kernel: LustreError: 13678:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-107) req@ffff8105c4ae3450 x1478417547778816/t0 o101->@:0/0 lens 296/0 e 0 to 0 dl 1427280115 ref 1 fl Interpret:/0/0 rc -107/0 Mar 25 18:41:12 ALPL402 kernel: LustreError: 13678:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 7 previous similar messages Mar 25 18:45:03 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 996b6e16-a1da-0599-0660-ef8616e82fe0 (at 10.3.4.2@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 18:45:28 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 18:45:59 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 19:05:28 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client eba14250-22d6-e092-f2af-064faab033b5 (at 10.3.2.18@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 19:05:28 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 25 19:05:30 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 19:25:16 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 99c163c9-a48a-3f12-a45c-1ebe493b9698 (at 10.3.4.23@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 19:25:16 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 25 19:25:33 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 19:25:58 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 19:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 20:25:25 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 20:25:29 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client ae0aff64-ff9f-6c1b-db13-32926a25d3f1 (at 10.3.2.27@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 20:25:29 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 25 20:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 20:45:03 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 1cdd2eed-6f16-ecc7-5d45-dd676ee9d095 (at 10.3.3.58@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 20:45:03 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 25 20:45:03 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 1cdd2eed-6f16-ecc7-5d45-dd676ee9d095 (at 10.3.3.58@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 20:45:03 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 25 20:45:30 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 20:46:04 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 21:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 22:05:03 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client ecc92ada-dbb4-dc5e-cbc6-80623f7fce13 (at 10.3.9.5@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 22:05:03 ALPL402 kernel: Lustre: Skipped 7 previous similar messages Mar 25 22:05:54 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 22:06:01 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 22:25:23 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 40e046ec-c7bb-b99f-9b1a-a5b12600973a (at 10.3.2.21@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 22:25:23 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 25 22:25:23 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 40e046ec-c7bb-b99f-9b1a-a5b12600973a (at 10.3.2.21@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 22:25:23 ALPL402 kernel: Lustre: Skipped 5 previous similar messages Mar 25 22:25:28 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 22:25:59 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 22:31:26 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 22:43:25 ALPL402 kernel: Lustre: 14363:0:(client.c:1529:ptlrpc_expire_one_request()) @@@ Request x1495852786481826 sent from LFS05-OST0055 to NID 10.3.2.21@o2ib 7s ago has timed out (7s prior to deadline). Mar 25 22:43:25 ALPL402 kernel: req@ffff8105e6ee3400 x1495852786481826/t0 o106->@NET_0x500000a030215_UUID:15/16 lens 296/424 e 0 to 1 dl 1427294605 ref 2 fl Rpc:/0/0 rc 0/0 Mar 25 22:43:31 ALPL402 kernel: Lustre: 14421:0:(client.c:1529:ptlrpc_expire_one_request()) @@@ Request x1495852786481825 sent from LFS05-OST0059 to NID 10.3.2.21@o2ib 13s ago has timed out (13s prior to deadline). Mar 25 22:43:31 ALPL402 kernel: req@ffff8105f0006000 x1495852786481825/t0 o106->@NET_0x500000a030215_UUID:15/16 lens 296/424 e 0 to 1 dl 1427294611 ref 2 fl Rpc:/0/0 rc 0/0 Mar 25 22:43:32 ALPL402 kernel: Lustre: 14363:0:(client.c:1529:ptlrpc_expire_one_request()) @@@ Request x1495852786481826 sent from LFS05-OST0055 to NID 10.3.2.21@o2ib 7s ago has timed out (7s prior to deadline). Mar 25 22:43:32 ALPL402 kernel: req@ffff8105e6ee3400 x1495852786481826/t0 o106->@NET_0x500000a030215_UUID:15/16 lens 296/424 e 0 to 1 dl 1427294612 ref 3 fl Rpc:/2/0 rc 0/0 Mar 25 22:43:39 ALPL402 kernel: Lustre: 14363:0:(client.c:1529:ptlrpc_expire_one_request()) @@@ Request x1495852786481826 sent from LFS05-OST0055 to NID 10.3.2.21@o2ib 7s ago has timed out (7s prior to deadline). Mar 25 22:43:39 ALPL402 kernel: req@ffff8105e6ee3400 x1495852786481826/t0 o106->@NET_0x500000a030215_UUID:15/16 lens 296/424 e 0 to 1 dl 1427294619 ref 4 fl Rpc:/2/0 rc 0/0 Mar 25 22:43:44 ALPL402 kernel: Lustre: 14421:0:(client.c:1529:ptlrpc_expire_one_request()) @@@ Request x1495852786481825 sent from LFS05-OST0059 to NID 10.3.2.21@o2ib 13s ago has timed out (13s prior to deadline). Mar 25 22:43:44 ALPL402 kernel: req@ffff8105f0006000 x1495852786481825/t0 o106->@NET_0x500000a030215_UUID:15/16 lens 296/424 e 0 to 1 dl 1427294624 ref 3 fl Rpc:/2/0 rc 0/0 Mar 25 22:43:53 ALPL402 kernel: Lustre: 14363:0:(client.c:1529:ptlrpc_expire_one_request()) @@@ Request x1495852786481826 sent from LFS05-OST0055 to NID 10.3.2.21@o2ib 7s ago has timed out (7s prior to deadline). Mar 25 22:43:53 ALPL402 kernel: req@ffff8105e6ee3400 x1495852786481826/t0 o106->@NET_0x500000a030215_UUID:15/16 lens 296/424 e 0 to 1 dl 1427294633 ref 6 fl Rpc:/2/0 rc 0/0 Mar 25 22:43:53 ALPL402 kernel: Lustre: 14363:0:(client.c:1529:ptlrpc_expire_one_request()) Skipped 1 previous similar message Mar 25 22:44:07 ALPL402 kernel: Lustre: 14363:0:(client.c:1529:ptlrpc_expire_one_request()) @@@ Request x1495852786481826 sent from LFS05-OST0055 to NID 10.3.2.21@o2ib 7s ago has timed out (7s prior to deadline). Mar 25 22:44:07 ALPL402 kernel: req@ffff8105e6ee3400 x1495852786481826/t0 o106->@NET_0x500000a030215_UUID:15/16 lens 296/424 e 0 to 1 dl 1427294647 ref 8 fl Rpc:/2/0 rc 0/0 Mar 25 22:44:07 ALPL402 kernel: Lustre: 14363:0:(client.c:1529:ptlrpc_expire_one_request()) Skipped 2 previous similar messages Mar 25 22:44:29 ALPL402 kernel: Lustre: 14363:0:(client.c:1529:ptlrpc_expire_one_request()) @@@ Request x1495852786481826 sent from LFS05-OST0055 to NID 10.3.2.21@o2ib 7s ago has timed out (7s prior to deadline). Mar 25 22:44:29 ALPL402 kernel: req@ffff8105e6ee3400 x1495852786481826/t0 o106->@NET_0x500000a030215_UUID:15/16 lens 296/424 e 0 to 1 dl 1427294669 ref 8 fl Rpc:/2/0 rc 0/0 Mar 25 22:44:29 ALPL402 kernel: Lustre: 14363:0:(client.c:1529:ptlrpc_expire_one_request()) Skipped 7 previous similar messages Mar 25 22:44:56 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client c9552633-dd01-5969-6634-ec04d558bc55 (at 10.3.2.21@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 22:44:56 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 25 22:44:56 ALPL402 kernel: LustreError: 138-a: LFS05-OST0059: A client on nid 10.3.2.21@o2ib was evicted due to a lock glimpse callback to 10.3.2.21@o2ib timed out: rc -4 Mar 25 22:45:58 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 23:05:19 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 4e1621b4-714b-6052-4d58-5d985630298b (at 10.3.3.17@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 23:05:19 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 25 23:05:19 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 4e1621b4-714b-6052-4d58-5d985630298b (at 10.3.3.17@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 23:05:19 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 25 23:05:28 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 23:25:31 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 8dfac636-94ea-3296-8118-41fe18b1c035 (at 10.3.3.17@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 23:25:31 ALPL402 kernel: Lustre: Skipped 2 previous similar messages Mar 25 23:25:31 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 25 23:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 25 23:45:01 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client c4270cb0-8ca8-3e88-759e-6434e9d6f30b (at 10.3.3.29@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 23:45:01 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 25 23:45:01 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client c4270cb0-8ca8-3e88-759e-6434e9d6f30b (at 10.3.3.29@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 25 23:45:01 ALPL402 kernel: Lustre: Skipped 2 previous similar messages Mar 26 00:05:14 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client e5aa52e5-5b92-9e0b-3000-ff8e8fc6b8f1 (at 10.3.3.17@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 00:05:14 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 26 00:05:29 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 00:06:00 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 00:06:30 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 00:10:35 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 26 00:25:25 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client d11d00f6-79f5-1e09-16df-9561a0b8482a (at 10.3.3.29@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 00:25:25 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 26 00:25:25 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client d11d00f6-79f5-1e09-16df-9561a0b8482a (at 10.3.3.29@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 00:25:26 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 00:31:27 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 26 00:44:53 ALPL402 ntpd[6232]: time reset +9.336635 s Mar 26 00:45:06 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 75dee454-4c99-e4e2-faf0-4247ad97c895 (at 10.3.3.40@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 00:45:06 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 26 00:45:36 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 00:46:05 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 00:48:18 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 26 00:50:29 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 26 01:05:07 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client d1b8f965-4633-4af4-88c9-56a7f2127a09 (at 10.3.3.38@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 01:05:07 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 26 01:05:07 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client d1b8f965-4633-4af4-88c9-56a7f2127a09 (at 10.3.3.38@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 01:05:07 ALPL402 kernel: Lustre: Skipped 8 previous similar messages Mar 26 01:05:37 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 01:06:31 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 01:07:01 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 711c6cb2-02b8-befa-5f7b-ecefaba9fbcf (at 10.3.9.32@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 01:07:01 ALPL402 kernel: Lustre: Skipped 5 previous similar messages Mar 26 01:07:06 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 01:07:19 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 01:07:48 ALPL402 ntpd[6232]: time reset +0.429696 s Mar 26 01:11:13 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 26 01:14:26 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 26 01:25:21 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 38b46147-83e1-4aa0-fcd2-125a0dd1721a (at 10.3.9.31@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 01:25:21 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 26 01:25:49 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 01:31:37 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 26 01:50:57 ALPL402 ntpd[6232]: time reset +0.161878 s Mar 26 01:54:41 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 26 01:56:48 ALPL402 ntpd[6232]: synchronized to 10.3.8.66, stratum 4 Mar 26 02:31:37 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 26 03:25:16 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 89e6e133-a2ee-4082-096e-feb2581ddd06 (at 10.3.1.49@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 03:25:16 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 26 03:25:16 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 48c1e769-575b-a27c-4c06-12b45b8db569 (at 10.3.3.12@o2ib) in 288 seconds. I think it's dead, and I am evicting it. Mar 26 03:25:16 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 26 03:25:40 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 03:26:40 ALPL402 last message repeated 2 times Mar 26 03:31:37 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 26 04:05:10 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 8293f4cf-f997-b9b6-04f2-05f1f2631e10 (at 10.3.5.23@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 04:05:10 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 26 04:05:40 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 04:06:09 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 04:25:36 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 879df44d-6567-a545-bd6e-31fb04a2ae6e (at 10.3.2.42@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 04:25:36 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 26 04:25:36 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 879df44d-6567-a545-bd6e-31fb04a2ae6e (at 10.3.2.42@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 04:25:36 ALPL402 kernel: Lustre: Skipped 2 previous similar messages Mar 26 04:25:37 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 04:31:38 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 26 04:45:31 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client ad48a26e-7b20-42b2-23da-c1a48385b9a9 (at 10.3.4.56@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 04:45:31 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 26 04:45:40 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 04:46:14 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 04:47:12 ALPL402 last message repeated 2 times Mar 26 04:54:56 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 34e1f0ec-c648-3d7b-bc5e-a6ca8218e646 (at 10.3.5.31@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 04:54:56 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 26 04:57:11 ALPL402 ntpd[6232]: synchronized to LOCAL(0), stratum 10 Mar 26 05:05:08 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 00826c0e-8b85-9f14-57c6-81d43f64c03a (at 10.3.3.24@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 05:05:08 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 26 05:05:40 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 00826c0e-8b85-9f14-57c6-81d43f64c03a (at 10.3.3.24@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 05:05:40 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 26 05:05:44 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 05:25:42 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 05:31:39 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 26 05:45:11 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client a63c1a20-81f9-35cc-2486-71915d4d8ee9 (at 10.3.1.59@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 05:45:45 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 05:46:06 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 06:31:38 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 26 07:05:43 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 15a51e4c-80fc-dd92-01fd-0a7922cc9823 (at 10.3.9.5@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 07:05:43 ALPL402 kernel: Lustre: Skipped 9 previous similar messages Mar 26 07:05:43 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 15a51e4c-80fc-dd92-01fd-0a7922cc9823 (at 10.3.9.5@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 07:05:43 ALPL402 kernel: Lustre: Skipped 2 previous similar messages Mar 26 07:06:07 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 07:06:36 ALPL402 last message repeated 2 times Mar 26 07:25:19 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 05e86d25-4907-c7b8-9bbf-6abb70704f14 (at 10.3.3.11@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 07:25:19 ALPL402 kernel: Lustre: Skipped 11 previous similar messages Mar 26 07:25:40 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 07:31:38 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 26 08:05:14 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 6e11be27-d508-8bb5-0ca9-e3c9085969c7 (at 10.3.3.32@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 08:05:14 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 26 08:05:14 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 6e11be27-d508-8bb5-0ca9-e3c9085969c7 (at 10.3.3.32@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 08:05:14 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 26 08:05:42 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 08:25:11 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 1f7ad9ab-95ea-d07a-ec46-fb188d227130 (at 10.3.9.30@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 08:25:36 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 08:31:39 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 26 08:45:29 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client bb2cca60-1294-60e9-d2ca-f7ac42ad7c29 (at 10.3.2.20@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 08:45:29 ALPL402 kernel: Lustre: Skipped 4 previous similar messages Mar 26 08:45:29 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client b34ded67-a5bd-6499-bf8e-8e9d2754dc40 (at 10.3.3.17@o2ib) in 316 seconds. I think it's dead, and I am evicting it. Mar 26 08:45:29 ALPL402 kernel: Lustre: Skipped 5 previous similar messages Mar 26 08:46:15 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 08:47:10 ALPL402 last message repeated 2 times Mar 26 08:47:41 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 1ac0c044-dd7e-6e56-89a5-115b0197b11a (at 10.3.4.36@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 08:47:41 ALPL402 kernel: Lustre: Skipped 18 previous similar messages Mar 26 08:47:41 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 08:48:14 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 08:49:20 ALPL402 last message repeated 2 times Mar 26 08:49:40 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 883468c0-1df8-b323-080b-928e6bebafc2 (at 10.3.5.8@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 08:49:40 ALPL402 kernel: Lustre: Skipped 14 previous similar messages Mar 26 08:49:40 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 08:50:15 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 08:51:42 ALPL402 last message repeated 3 times Mar 26 08:52:03 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client 901f948b-21e8-0389-a926-da662bc48de1 (at 10.3.5.54@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 08:52:03 ALPL402 kernel: Lustre: Skipped 24 previous similar messages Mar 26 08:52:14 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 08:53:16 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 08:53:44 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 08:54:13 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client da5c56b0-7550-8c77-e017-4b07dc92587e (at 10.3.6.33@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 08:54:13 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 26 08:54:42 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 08:55:45 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 08:56:06 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client 71f83b12-c11d-818f-e3a8-f22e096f82d7 (at 10.3.7.18@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 08:56:06 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 26 08:56:23 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 08:56:56 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 08:57:47 ALPL402 last message repeated 2 times Mar 26 08:58:06 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 75dc59fc-c075-2001-e7b9-0cb5dd3786e4 (at 10.3.8.5@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 08:58:06 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 26 08:58:16 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 08:58:49 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 08:59:26 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:00:02 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 838de325-db6a-b254-479a-504088178e71 (at 10.3.8.34@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 09:00:02 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 26 09:00:45 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:01:20 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:01:56 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:01:58 ALPL402 kernel: Lustre: LFS05-OST0056: haven't heard from client a83efbbd-14a2-0c13-d2b0-eff155c09366 (at 10.3.8.46@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 09:01:58 ALPL402 kernel: Lustre: Skipped 19 previous similar messages Mar 26 09:02:18 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:02:33 ALPL402 kernel: Lustre: 14330:0:(ldlm_lib.c:805:target_handle_connect()) LFS05-OST0057: exp ffff810c3409a600 already connecting Mar 26 09:02:33 ALPL402 kernel: Lustre: 14330:0:(ldlm_lib.c:805:target_handle_connect()) Skipped 5 previous similar messages Mar 26 09:02:33 ALPL402 kernel: LustreError: 14330:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-114) req@ffff8105dc4cc800 x1496665802408225/t0 o8->@:0/0 lens 368/264 e 0 to 0 dl 1427331903 ref 1 fl Interpret:/0/0 rc -114/0 Mar 26 09:02:43 ALPL402 kernel: Lustre: 13582:0:(ldlm_lib.c:805:target_handle_connect()) LFS05-OST0057: exp ffff810c3a4dc400 already connecting Mar 26 09:02:43 ALPL402 kernel: LustreError: 13582:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-114) req@ffff8105f043a000 x1496665778291201/t0 o8->@:0/0 lens 368/264 e 0 to 0 dl 1427331913 ref 1 fl Interpret:/0/0 rc -114/0 Mar 26 09:03:15 ALPL402 kernel: Lustre: 14290:0:(ldlm_lib.c:805:target_handle_connect()) LFS05-OST0057: exp ffff810c3409a600 already connecting Mar 26 09:03:15 ALPL402 kernel: LustreError: 14290:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-114) req@ffff81053bb89050 x1496665802408514/t0 o8->@:0/0 lens 368/264 e 0 to 0 dl 1427331945 ref 1 fl Interpret:/0/0 rc -114/0 Mar 26 09:03:57 ALPL402 kernel: Lustre: 14300:0:(ldlm_lib.c:805:target_handle_connect()) LFS05-OST0057: exp ffff810c3a4dc400 already connecting Mar 26 09:03:57 ALPL402 kernel: LustreError: 14300:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-114) req@ffff810b855c1800 x1496665778291778/t0 o8->@:0/0 lens 368/264 e 0 to 0 dl 1427331987 ref 1 fl Interpret:/0/0 rc -114/0 Mar 26 09:04:29 ALPL402 kernel: Lustre: 14230:0:(ldlm_lib.c:805:target_handle_connect()) LFS05-OST0057: exp ffff810c3409a600 already connecting Mar 26 09:04:29 ALPL402 kernel: LustreError: 14230:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-114) req@ffff810042b5b400 x1496665802408875/t0 o8->@:0/0 lens 368/264 e 0 to 0 dl 1427332019 ref 1 fl Interpret:/0/0 rc -114/0 Mar 26 09:04:33 ALPL402 kernel: INFO: task ll_ost_01:13576 blocked for more than 120 seconds. Mar 26 09:04:33 ALPL402 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Mar 26 09:04:33 ALPL402 kernel: ll_ost_01 D ffff81000100caa0 0 13576 1 13577 13575 (L-TLB) Mar 26 09:04:33 ALPL402 kernel: ffff8105e90cb8f0 0000000000000046 ffff8106215f9ac0 ffffffff88a1b88b Mar 26 09:04:33 ALPL402 kernel: ffff8105e90cb8b0 000000000000000a ffff8105efe5f7e0 ffff810640047820 Mar 26 09:04:33 ALPL402 kernel: 0002c0f3d558a99d 000000000000979a ffff8105efe5f9c8 000000019d1e71f8 Mar 26 09:04:33 ALPL402 kernel: Call Trace: Mar 26 09:04:33 ALPL402 kernel: [] :ko2iblnd:kiblnd_check_sends+0x41b/0x560 Mar 26 09:04:33 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:04:33 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ldlm_grant_lock+0x4e9/0x550 Mar 26 09:04:33 ALPL402 kernel: [] :obdfilter:filter_parent_lock+0x36/0x220 Mar 26 09:04:33 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x2cf/0x740 Mar 26 09:04:33 ALPL402 kernel: [] __down_trylock+0x44/0x4e Mar 26 09:04:33 ALPL402 kernel: [] :obdfilter:filter_lvbo_init+0x3bb/0x69b Mar 26 09:04:33 ALPL402 kernel: [] :obdclass:lustre_hash_del+0x36e/0x400 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x900/0xa60 Mar 26 09:04:33 ALPL402 kernel: [] :ost:ost_blocking_ast+0x0/0x9b0 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ldlm_server_completion_ast+0x0/0x5e0 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ldlm_lock_create+0xba/0x9f0 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:lustre_swab_buf+0x81/0x170 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ldlm_server_glimpse_ast+0x0/0x3b0 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ldlm_server_glimpse_ast+0x0/0x3b0 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ldlm_server_completion_ast+0x0/0x5e0 Mar 26 09:04:33 ALPL402 kernel: [] :ost:ost_blocking_ast+0x0/0x9b0 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ldlm_handle_enqueue+0x670/0x1210 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:04:33 ALPL402 kernel: [] :ost:ost_handle+0x5003/0x55c0 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:04:33 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:04:33 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:04:33 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:04:33 ALPL402 kernel: Mar 26 09:04:33 ALPL402 kernel: INFO: task ll_ost_09:13584 blocked for more than 120 seconds. Mar 26 09:04:33 ALPL402 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Mar 26 09:04:33 ALPL402 kernel: ll_ost_09 D ffff81000101d7a0 0 13584 1 13585 13583 (L-TLB) Mar 26 09:04:33 ALPL402 kernel: ffff8105e90e18f0 0000000000000046 ffff8106215f9ac0 ffffffff88a1b88b Mar 26 09:04:33 ALPL402 kernel: ffff8105e90e18b0 000000000000000a ffff81061f5227a0 ffff8106551987a0 Mar 26 09:04:33 ALPL402 kernel: 0002c0f5b4717d8e 0000000000007f04 ffff81061f522988 000000037df183b8 Mar 26 09:04:33 ALPL402 kernel: Call Trace: Mar 26 09:04:33 ALPL402 kernel: [] :ko2iblnd:kiblnd_check_sends+0x41b/0x560 Mar 26 09:04:33 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:04:33 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ldlm_grant_lock+0x4e9/0x550 Mar 26 09:04:33 ALPL402 kernel: [] :obdfilter:filter_parent_lock+0x36/0x220 Mar 26 09:04:33 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x2cf/0x740 Mar 26 09:04:33 ALPL402 kernel: [] __down_trylock+0x44/0x4e Mar 26 09:04:33 ALPL402 kernel: [] :obdfilter:filter_lvbo_init+0x3bb/0x69b Mar 26 09:04:33 ALPL402 kernel: [] :lnet:LNetPut+0x720/0x830 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x900/0xa60 Mar 26 09:04:33 ALPL402 kernel: [] :ost:ost_blocking_ast+0x0/0x9b0 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ldlm_server_completion_ast+0x0/0x5e0 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ldlm_lock_create+0xba/0x9f0 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:lustre_swab_buf+0x81/0x170 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ldlm_server_glimpse_ast+0x0/0x3b0 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ldlm_server_glimpse_ast+0x0/0x3b0 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ldlm_server_completion_ast+0x0/0x5e0 Mar 26 09:04:33 ALPL402 kernel: [] :ost:ost_blocking_ast+0x0/0x9b0 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ldlm_handle_enqueue+0x670/0x1210 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:04:33 ALPL402 kernel: [] :ost:ost_handle+0x5003/0x55c0 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:04:33 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:04:33 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:04:33 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:04:33 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:04:33 ALPL402 kernel: Mar 26 09:04:33 ALPL402 kernel: INFO: task ll_ost_11:13586 blocked for more than 120 seconds. Mar 26 09:04:34 ALPL402 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Mar 26 09:04:34 ALPL402 kernel: ll_ost_11 D ffff81000101d7a0 0 13586 1 13587 13585 (L-TLB) Mar 26 09:04:34 ALPL402 kernel: ffff8105e90e78f0 0000000000000046 ffff8106215f9ac0 ffffffff88a1b88b Mar 26 09:04:34 ALPL402 kernel: ffff8105e90e78b0 000000000000000a ffff8105ec011080 ffff8106551987a0 Mar 26 09:04:34 ALPL402 kernel: 0002c0f85c0112c5 000000000000aea3 ffff8105ec011268 00000003362c4ef8 Mar 26 09:04:34 ALPL402 kernel: Call Trace: Mar 26 09:04:34 ALPL402 kernel: [] :ko2iblnd:kiblnd_check_sends+0x41b/0x560 Mar 26 09:04:34 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:04:34 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_grant_lock+0x4e9/0x550 Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_parent_lock+0x36/0x220 Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x2cf/0x740 Mar 26 09:04:34 ALPL402 kernel: [] __down_trylock+0x44/0x4e Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_lvbo_init+0x3bb/0x69b Mar 26 09:04:34 ALPL402 kernel: [] :obdclass:lustre_hash_del+0x36e/0x400 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x900/0xa60 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_blocking_ast+0x0/0x9b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_completion_ast+0x0/0x5e0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_lock_create+0xba/0x9f0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:lustre_swab_buf+0x81/0x170 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_glimpse_ast+0x0/0x3b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_glimpse_ast+0x0/0x3b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_completion_ast+0x0/0x5e0 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_blocking_ast+0x0/0x9b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_handle_enqueue+0x670/0x1210 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_handle+0x5003/0x55c0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:04:34 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:04:34 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:04:34 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:04:34 ALPL402 kernel: Mar 26 09:04:34 ALPL402 kernel: INFO: task ll_ost_15:13590 blocked for more than 120 seconds. Mar 26 09:04:34 ALPL402 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Mar 26 09:04:34 ALPL402 kernel: ll_ost_15 D ffff81000100caa0 0 13590 1 13591 13589 (L-TLB) Mar 26 09:04:34 ALPL402 kernel: ffff8105e90f18f0 0000000000000046 ffff8106215f9ac0 ffffffff88a1b88b Mar 26 09:04:34 ALPL402 kernel: ffff8105e90f18b0 000000000000000a ffff81060d08e860 ffff810640047820 Mar 26 09:04:34 ALPL402 kernel: 0002c0f20bc5b641 000000000000b901 ffff81060d08ea48 0000000138af38b8 Mar 26 09:04:34 ALPL402 kernel: Call Trace: Mar 26 09:04:34 ALPL402 kernel: [] :ko2iblnd:kiblnd_check_sends+0x41b/0x560 Mar 26 09:04:34 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:04:34 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_grant_lock+0x4e9/0x550 Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_parent_lock+0x36/0x220 Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x2cf/0x740 Mar 26 09:04:34 ALPL402 kernel: [] __down_trylock+0x44/0x4e Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_lvbo_init+0x3bb/0x69b Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x900/0xa60 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_blocking_ast+0x0/0x9b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_completion_ast+0x0/0x5e0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_lock_create+0xba/0x9f0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:lustre_swab_buf+0x81/0x170 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_glimpse_ast+0x0/0x3b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_glimpse_ast+0x0/0x3b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_completion_ast+0x0/0x5e0 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_blocking_ast+0x0/0x9b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_handle_enqueue+0x670/0x1210 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_handle+0x5003/0x55c0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:04:34 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:04:34 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:04:34 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:04:34 ALPL402 kernel: Mar 26 09:04:34 ALPL402 kernel: INFO: task ll_ost_24:13599 blocked for more than 120 seconds. Mar 26 09:04:34 ALPL402 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Mar 26 09:04:34 ALPL402 kernel: ll_ost_24 D ffff8106550f2120 0 13599 1 13600 13598 (L-TLB) Mar 26 09:04:34 ALPL402 kernel: ffff8105e88278f0 0000000000000046 ffff8106215f9ac0 ffffffff88a1b88b Mar 26 09:04:34 ALPL402 kernel: ffff8105e88278b0 000000000000000a ffff8105e97970c0 ffff8106552de860 Mar 26 09:04:34 ALPL402 kernel: 0002c0f74ca6c64b 0000000000007fe5 ffff8105e97972a8 000000063408f0b8 Mar 26 09:04:34 ALPL402 kernel: Call Trace: Mar 26 09:04:34 ALPL402 kernel: [] :ko2iblnd:kiblnd_check_sends+0x41b/0x560 Mar 26 09:04:34 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:04:34 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_grant_lock+0x4e9/0x550 Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_parent_lock+0x36/0x220 Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x2cf/0x740 Mar 26 09:04:34 ALPL402 kernel: [] __down_trylock+0x44/0x4e Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_lvbo_init+0x3bb/0x69b Mar 26 09:04:34 ALPL402 kernel: [] :lnet:LNetPut+0x720/0x830 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x900/0xa60 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_blocking_ast+0x0/0x9b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_completion_ast+0x0/0x5e0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_lock_create+0xba/0x9f0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:lustre_swab_buf+0x81/0x170 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_glimpse_ast+0x0/0x3b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_glimpse_ast+0x0/0x3b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_completion_ast+0x0/0x5e0 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_blocking_ast+0x0/0x9b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_handle_enqueue+0x670/0x1210 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_handle+0x5003/0x55c0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:04:34 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:04:34 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:04:34 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:04:34 ALPL402 kernel: Mar 26 09:04:34 ALPL402 kernel: INFO: task ll_ost_68:13643 blocked for more than 120 seconds. Mar 26 09:04:34 ALPL402 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Mar 26 09:04:34 ALPL402 kernel: ll_ost_68 D ffff81000100caa0 0 13643 1 13644 13642 (L-TLB) Mar 26 09:04:34 ALPL402 kernel: ffff8105e80998f0 0000000000000046 ffff8106215f9ac0 ffffffff88a1b88b Mar 26 09:04:34 ALPL402 kernel: ffff8105e80998b0 000000000000000a ffff8105e86b1040 ffff810640047820 Mar 26 09:04:34 ALPL402 kernel: 0002c0f133fa6b1b 000000000000a253 ffff8105e86b1228 00000001380c0db8 Mar 26 09:04:34 ALPL402 kernel: Call Trace: Mar 26 09:04:34 ALPL402 kernel: [] :ko2iblnd:kiblnd_check_sends+0x41b/0x560 Mar 26 09:04:34 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:04:34 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_grant_lock+0x4e9/0x550 Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_parent_lock+0x36/0x220 Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x2cf/0x740 Mar 26 09:04:34 ALPL402 kernel: [] __down_trylock+0x44/0x4e Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_lvbo_init+0x3bb/0x69b Mar 26 09:04:34 ALPL402 kernel: [] :obdclass:lustre_hash_del+0x36e/0x400 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x900/0xa60 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_blocking_ast+0x0/0x9b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_completion_ast+0x0/0x5e0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_lock_create+0xba/0x9f0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:lustre_swab_buf+0x81/0x170 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_glimpse_ast+0x0/0x3b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_glimpse_ast+0x0/0x3b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_completion_ast+0x0/0x5e0 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_blocking_ast+0x0/0x9b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_handle_enqueue+0x670/0x1210 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_handle+0x5003/0x55c0 Mar 26 09:04:34 ALPL402 kernel: [] dequeue_task+0x18/0x37 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:04:34 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:04:34 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:04:34 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:04:34 ALPL402 kernel: Mar 26 09:04:34 ALPL402 kernel: INFO: task ll_ost_70:13645 blocked for more than 120 seconds. Mar 26 09:04:34 ALPL402 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Mar 26 09:04:34 ALPL402 kernel: ll_ost_70 D ffff810001015120 0 13645 1 13646 13644 (L-TLB) Mar 26 09:04:34 ALPL402 kernel: ffff8105e80a38f0 0000000000000046 ffff8106215f9ac0 ffffffff88a1b88b Mar 26 09:04:34 ALPL402 kernel: 00000000ffffffff 000000000000000a ffff8105e86b4080 ffff810655184860 Mar 26 09:04:34 ALPL402 kernel: 0002c0ef5919d339 00000000000088d4 ffff8105e86b4268 00000002739ad7b8 Mar 26 09:04:34 ALPL402 kernel: Call Trace: Mar 26 09:04:34 ALPL402 kernel: [] :ko2iblnd:kiblnd_check_sends+0x41b/0x560 Mar 26 09:04:34 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:04:34 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:04:34 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_parent_lock+0x36/0x220 Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x2cf/0x740 Mar 26 09:04:34 ALPL402 kernel: [] __down_trylock+0x44/0x4e Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_lvbo_init+0x3bb/0x69b Mar 26 09:04:34 ALPL402 kernel: [] :lnet:LNetPut+0x720/0x830 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x900/0xa60 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_blocking_ast+0x0/0x9b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_completion_ast+0x0/0x5e0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_lock_create+0xba/0x9f0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:lustre_swab_buf+0x81/0x170 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_glimpse_ast+0x0/0x3b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_glimpse_ast+0x0/0x3b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_completion_ast+0x0/0x5e0 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_blocking_ast+0x0/0x9b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_handle_enqueue+0x670/0x1210 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20WARNING Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_handle+0x5003/0x55c0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:04:34 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:04:34 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:04:34 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:04:34 ALPL402 kernel: Mar 26 09:04:34 ALPL402 kernel: INFO: task ll_ost_73:13648 blocked for more than 120 seconds. Mar 26 09:04:34 ALPL402 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Mar 26 09:04:34 ALPL402 kernel: ll_ost_73 D ffff810001015120 0 13648 1 13649 13647 (L-TLB) Mar 26 09:04:34 ALPL402 kernel: ffff8105e80af8f0 0000000000000046 ffff8106215f9ac0 ffffffff88a1b88b Mar 26 09:04:34 ALPL402 kernel: ffff8105e80af8b0 000000000000000a ffff8105e86b8860 ffff810655184860 Mar 26 09:04:34 ALPL402 kernel: 0002c0f3008af51f 00000000000076de ffff8105e86b8a48 000000023408f0b8 Mar 26 09:04:34 ALPL402 kernel: Call Trace: Mar 26 09:04:34 ALPL402 kernel: [] :ko2iblnd:kiblnd_check_sends+0x41b/0x560 Mar 26 09:04:34 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:04:34 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_grant_lock+0x4e9/0x550 Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_parent_lock+0x36/0x220 Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x2cf/0x740 Mar 26 09:04:34 ALPL402 kernel: [] __down_trylock+0x44/0x4e Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_lvbo_init+0x3bb/0x69b Mar 26 09:04:34 ALPL402 kernel: [] :lnet:LNetPut+0x720/0x830 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x900/0xa60 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_blocking_ast+0x0/0x9b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_completion_ast+0x0/0x5e0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_lock_create+0xba/0x9f0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:lustre_swab_buf+0x81/0x170 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_glimpse_ast+0x0/0x3b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_glimpse_ast+0x0/0x3b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_completion_ast+0x0/0x5e0 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_blocking_ast+0x0/0x9b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_handle_enqueue+0x670/0x1210 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_handle+0x5003/0x55c0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:04:34 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:04:34 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:04:34 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:04:34 ALPL402 kernel: Mar 26 09:04:34 ALPL402 kernel: INFO: task ll_ost_76:13651 blocked for more than 120 seconds. Mar 26 09:04:34 ALPL402 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Mar 26 09:04:34 ALPL402 kernel: ll_ost_76 D ffff81000100caa0 0 13651 1 13652 13650 (L-TLB) Mar 26 09:04:34 ALPL402 kernel: ffff8105e80bf8f0 0000000000000046 ffff8106215f9ac0 ffffffff88a1b88b Mar 26 09:04:34 ALPL402 kernel: ffff8105d9141800 000000000000000a ffff8105e86ba040 ffff810640047820 Mar 26 09:04:34 ALPL402 kernel: 0002c0f0f08b736f 000000000000a3a9 ffff8105e86ba228 00000001d805d5f8 Mar 26 09:04:34 ALPL402 kernel: Call Trace: Mar 26 09:04:34 ALPL402 kernel: [] :ko2iblnd:kiblnd_check_sends+0x41b/0x560 Mar 26 09:04:34 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:04:34 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:lustre_swab_buf+0x81/0x170 Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_parent_lock+0x36/0x220 Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x2cf/0x740 Mar 26 09:04:34 ALPL402 kernel: [] __down_trylock+0x44/0x4e Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_lvbo_init+0x3bb/0x69b Mar 26 09:04:34 ALPL402 kernel: [] :obdclass:lustre_hash_del+0x36e/0x400 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x900/0xa60 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_blocking_ast+0x0/0x9b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_completion_ast+0x0/0x5e0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_lock_create+0xba/0x9f0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:lustre_swab_buf+0x81/0x170 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_glimpse_ast+0x0/0x3b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_glimpse_ast+0x0/0x3b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_completion_ast+0x0/0x5e0 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_blocking_ast+0x0/0x9b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_handle_enqueue+0x670/0x1210 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_handle+0x5003/0x55c0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:04:34 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:04:34 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:04:34 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:04:34 ALPL402 kernel: Mar 26 09:04:34 ALPL402 kernel: INFO: task ll_ost_79:13654 blocked for more than 120 seconds. Mar 26 09:04:34 ALPL402 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Mar 26 09:04:34 ALPL402 kernel: ll_ost_79 D ffff81000101d7a0 0 13654 1 13655 13653 (L-TLB) Mar 26 09:04:34 ALPL402 kernel: ffff8105e80d58f0 0000000000000046 ffff8106215f9ac0 ffffffff88a1b88b Mar 26 09:04:34 ALPL402 kernel: ffff8105e80d58b0 000000000000000a ffff8105e86be820 ffff8106551987a0 Mar 26 09:04:34 ALPL402 kernel: 0002c0f8b782866f 00000000000088b8 ffff8105e86bea08 000000033871cdb8 Mar 26 09:04:34 ALPL402 kernel: Call Trace: Mar 26 09:04:34 ALPL402 kernel: [] :ko2iblnd:kiblnd_check_sends+0x41b/0x560 Mar 26 09:04:34 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:04:34 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_grant_lock+0x4e9/0x550 Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_parent_lock+0x36/0x220 Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x2cf/0x740 Mar 26 09:04:34 ALPL402 kernel: [] __down_trylock+0x44/0x4e Mar 26 09:04:34 ALPL402 kernel: [] :obdfilter:filter_lvbo_init+0x3bb/0x69b Mar 26 09:04:34 ALPL402 kernel: [] :obdclass:lustre_hash_del+0x36e/0x400 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x900/0xa60 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_blocking_ast+0x0/0x9b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_completion_ast+0x0/0x5e0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_lock_create+0xba/0x9f0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:lustre_swab_buf+0x81/0x170 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_glimpse_ast+0x0/0x3b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_glimpse_ast+0x0/0x3b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_server_completion_ast+0x0/0x5e0 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_blocking_ast+0x0/0x9b0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ldlm_handle_enqueue+0x670/0x1210 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:04:34 ALPL402 kernel: [] :ost:ost_handle+0x5003/0x55c0 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:04:34 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:04:34 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:04:34 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:04:34 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:04:34 ALPL402 kernel: Mar 26 09:04:50 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:05:01 ALPL402 kernel: Lustre: 14281:0:(ldlm_lib.c:805:target_handle_connect()) LFS05-OST0057: exp ffff810c3a4dc400 already connecting Mar 26 09:05:01 ALPL402 kernel: LustreError: 14281:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-114) req@ffff81007818cc00 x1496665778292062/t0 o8->@:0/0 lens 368/264 e 0 to 0 dl 1427332051 ref 1 fl Interpret:/0/0 rc -114/0 Mar 26 09:05:18 ALPL402 kernel: Lustre: 14444:0:(ldlm_lib.c:805:target_handle_connect()) LFS05-OST0057: exp ffff810c3409a600 already connecting Mar 26 09:05:18 ALPL402 kernel: Lustre: 14444:0:(ldlm_lib.c:805:target_handle_connect()) Skipped 1 previous similar message Mar 26 09:05:46 ALPL402 kernel: Lustre: 14414:0:(ldlm_lib.c:805:target_handle_connect()) LFS05-OST0057: exp ffff8104dae26c00 already connecting Mar 26 09:05:46 ALPL402 kernel: LustreError: 14414:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-114) req@ffff810242dd5400 x1496665962840642/t0 o8->@:0/0 lens 368/264 e 0 to 0 dl 1427332096 ref 1 fl Interpret:/0/0 rc -114/0 Mar 26 09:05:46 ALPL402 kernel: LustreError: 14414:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 2 previous similar messages Mar 26 09:05:53 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:06:25 ALPL402 kernel: Lustre: 14504:0:(ldlm_lib.c:805:target_handle_connect()) LFS05-OST0057: exp ffff810c3a4dc400 already connecting Mar 26 09:06:25 ALPL402 kernel: Lustre: 14504:0:(ldlm_lib.c:805:target_handle_connect()) Skipped 3 previous similar messages Mar 26 09:06:34 ALPL402 kernel: Lustre: Service thread pid 19528 was inactive for 300.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: Mar 26 09:06:34 ALPL402 kernel: Pid: 19528, comm: ll_ost_creat_09 Mar 26 09:06:34 ALPL402 kernel: Mar 26 09:06:34 ALPL402 kernel: Call Trace: Mar 26 09:06:34 ALPL402 kernel: [] do_get_write_access+0x3e3/0x418 [jbd2] Mar 26 09:06:34 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:06:34 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:06:34 ALPL402 kernel: [] __jbd2_log_wait_for_space+0x5d/0x1ad [jbd2] Mar 26 09:06:34 ALPL402 kernel: [] start_this_handle+0x346/0x3cf [jbd2] Mar 26 09:06:34 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:06:34 ALPL402 kernel: [] jbd2_journal_start+0xad/0xe1 [jbd2] Mar 26 09:06:34 ALPL402 kernel: [] fsfilt_ldiskfs_start+0x4c2/0x590 [fsfilt_ldiskfs] Mar 26 09:06:34 ALPL402 kernel: [] _atomic_dec_and_lock+0x39/0x57 Mar 26 09:06:34 ALPL402 kernel: [] filter_precreate+0xf95/0x19b0 [obdfilter] Mar 26 09:06:34 ALPL402 kernel: [] lnet_ni_send+0x96/0xe0 [lnet] Mar 26 09:06:34 ALPL402 kernel: [] dput+0x2c/0x114 Mar 26 09:06:34 ALPL402 kernel: [] filter_create+0x11cf/0x17e0 [obdfilter] Mar 26 09:06:34 ALPL402 kernel: [] LNetPut+0x720/0x830 [lnet] Mar 26 09:06:34 ALPL402 kernel: [] ptl_send_buf+0x3f3/0x5b0 [ptlrpc] Mar 26 09:06:34 ALPL402 kernel: [] lustre_msg_add_version+0x34/0x110 [ptlrpc] Mar 26 09:06:34 ALPL402 kernel: [] ptlrpc_send_reply+0x5e8/0x600 [ptlrpc] Mar 26 09:06:34 ALPL402 kernel: [] lustre_pack_reply+0x29/0xb0 [ptlrpc] Mar 26 09:06:34 ALPL402 kernel: [] ost_handle+0x1281/0x55c0 [ost] Mar 26 09:06:34 ALPL402 kernel: [] ptlrpc_server_handle_request+0x984/0xe00 [ptlrpc] Mar 26 09:06:34 ALPL402 kernel: [] ptlrpc_wait_event+0x2e5/0x310 [ptlrpc] Mar 26 09:06:34 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:06:34 ALPL402 kernel: [] ptlrpc_main+0xf16/0x10e0 [ptlrpc] Mar 26 09:06:34 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:06:34 ALPL402 kernel: [] ptlrpc_main+0x0/0x10e0 [ptlrpc] Mar 26 09:06:34 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:06:34 ALPL402 kernel: Mar 26 09:06:34 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331994.19528 Mar 26 09:06:39 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:06:39 ALPL402 kernel: Lustre: Service thread pid 19220 was inactive for 300.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: Mar 26 09:06:39 ALPL402 kernel: Pid: 19220, comm: ll_ost_io_418 Mar 26 09:06:39 ALPL402 kernel: Mar 26 09:06:39 ALPL402 kernel: Call Trace: Mar 26 09:06:39 ALPL402 kernel: [] jbd2_log_wait_commit+0xa3/0xf5 [jbd2] Mar 26 09:06:39 ALPL402 kernel: [] autoremove_wake_function+0x0/0x2e Mar 26 09:06:39 ALPL402 kernel: [] fsfilt_ldiskfs_commit_wait+0xab/0xd0 [fsfilt_ldiskfs] Mar 26 09:06:39 ALPL402 kernel: [] filter_commitrw_write+0x1eb4/0x2e70 [obdfilter] Mar 26 09:06:39 ALPL402 kernel: [] ost_brw_write+0x1c99/0x2480 [ost] Mar 26 09:06:39 ALPL402 kernel: [] LNetMDBind+0x301/0x450 [lnet] Mar 26 09:06:39 ALPL402 kernel: [] lustre_msg_set_limit+0x35/0xf0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ptlrpc_send_reply+0x5e8/0x600 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:06:39 ALPL402 kernel: [] lustre_msg_check_version_v2+0x8/0x20 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ost_handle+0x2bc2/0x55c0 [ost] Mar 26 09:06:39 ALPL402 kernel: [] class_handle2object+0xe0/0x170 [obdclass] Mar 26 09:06:39 ALPL402 kernel: [] lock_res_and_lock+0xba/0xd0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] __ldlm_handle2lock+0x2f8/0x360 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ptlrpc_server_handle_request+0x984/0xe00 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ptlrpc_wait_event+0x2e5/0x310 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:06:39 ALPL402 kernel: [] ptlrpc_main+0xf16/0x10e0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:06:39 ALPL402 kernel: [] ptlrpc_main+0x0/0x10e0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:06:39 ALPL402 kernel: Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.19220 Mar 26 09:06:39 ALPL402 kernel: Pid: 19218, comm: ll_ost_io_416 Mar 26 09:06:39 ALPL402 kernel: Mar 26 09:06:39 ALPL402 kernel: Call Trace: Mar 26 09:06:39 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:06:39 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:06:39 ALPL402 kernel: [] __jbd2_log_wait_for_space+0x5d/0x1ad [jbd2] Mar 26 09:06:39 ALPL402 kernel: [] start_this_handle+0x346/0x3cf [jbd2] Mar 26 09:06:39 ALPL402 kernel: [] ldlm_lock_remove_from_lru+0x74/0xe0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] jbd2_journal_start+0xad/0xe1 [jbd2] Mar 26 09:06:39 ALPL402 kernel: [] fsfilt_ldiskfs_start+0x4c2/0x590 [fsfilt_ldiskfs] Mar 26 09:06:39 ALPL402 kernel: [] filter_version_get_check+0x91/0x2a0 [obdfilter] Mar 26 09:06:39 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:06:39 ALPL402 kernel: [] cfs_alloc+0x68/0xc0 [libcfs] Mar 26 09:06:39 ALPL402 kernel: [] filter_destroy+0xa2d/0x1f90 [obdfilter] Mar 26 09:06:39 ALPL402 kernel: [] ldlm_blocking_ast+0x0/0x2a0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ldlm_completion_ast+0x0/0x880 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] lustre_msg_add_version+0x34/0x110 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] lustre_pack_reply_flags+0x86a/0x950 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ldlm_resource_putref_internal+0x3ab/0x460 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ldlm_lock_put+0x372/0x3d0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] lustre_pack_reply+0x29/0xb0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ost_destroy+0x660/0x790 [ost] Mar 26 09:06:39 ALPL402 kernel: [] lustre_msg_check_version_v2+0x8/0x20 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] lustre_msg_get_opc+0x35/0xf0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ost_handle+0x1566/0x55c0 [ost] Mar 26 09:06:39 ALPL402 kernel: [] dequeue_task+0x18/0x37 Mar 26 09:06:39 ALPL402 kernel: [] ptlrpc_server_handle_request+0x984/0xe00 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ptlrpc_wait_event+0x2e5/0x310 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:06:39 ALPL402 kernel: [] ptlrpc_main+0xf16/0x10e0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:06:39 ALPL402 kernel: [] ptlrpc_main+0x0/0x10e0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:06:39 ALPL402 kernel: Mar 26 09:06:39 ALPL402 kernel: Pid: 18583, comm: ll_ost_io_220 Mar 26 09:06:39 ALPL402 kernel: Mar 26 09:06:39 ALPL402 kernel: Call Trace: Mar 26 09:06:39 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:06:39 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:06:39 ALPL402 kernel: [] __jbd2_log_wait_for_space+0x5d/0x1ad [jbd2] Mar 26 09:06:39 ALPL402 kernel: [] start_this_handle+0x346/0x3cf [jbd2] Mar 26 09:06:39 ALPL402 kernel: [] ldlm_lock_remove_from_lru+0x74/0xe0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] jbd2_journal_start+0xad/0xe1 [jbd2] Mar 26 09:06:39 ALPL402 kernel: [] fsfilt_ldiskfs_start+0x4c2/0x590 [fsfilt_ldiskfs] Mar 26 09:06:39 ALPL402 kernel: [] filter_version_get_check+0x91/0x2a0 [obdfilter] Mar 26 09:06:39 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:06:39 ALPL402 kernel: [] cfs_alloc+0x68/0xc0 [libcfs] Mar 26 09:06:39 ALPL402 kernel: [] filter_destroy+0xa2d/0x1f90 [obdfilter] Mar 26 09:06:39 ALPL402 kernel: [] ldlm_blocking_ast+0x0/0x2a0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ldlm_completion_ast+0x0/0x880 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] lustre_msg_add_version+0x34/0x110 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] lustre_pack_reply_flags+0x86a/0x950 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ldlm_resource_putref_internal+0x3ab/0x460 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ldlm_lock_put+0x372/0x3d0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] lustre_pack_reply+0x29/0xb0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ost_destroy+0x660/0x790 [ost] Mar 26 09:06:39 ALPL402 kernel: [] lustre_msg_check_version_v2+0x8/0x20 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] lustre_msg_get_opc+0x35/0xf0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ost_handle+0x1566/0x55c0 [ost] Mar 26 09:06:39 ALPL402 kernel: [] dequeue_task+0x18/0x37 Mar 26 09:06:39 ALPL402 kernel: [] ptlrpc_server_handle_request+0x984/0xe00 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ptlrpc_wait_event+0x2e5/0x310 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:06:39 ALPL402 kernel: [] ptlrpc_main+0xf16/0x10e0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:06:39 ALPL402 kernel: [] ptlrpc_main+0x0/0x10e0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:06:39 ALPL402 kernel: Mar 26 09:06:39 ALPL402 kernel: Pid: 19224, comm: ll_ost_io_422 Mar 26 09:06:39 ALPL402 kernel: Mar 26 09:06:39 ALPL402 kernel: Call Trace: Mar 26 09:06:39 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:06:39 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:06:39 ALPL402 kernel: [] __jbd2_log_wait_for_space+0x5d/0x1ad [jbd2] Mar 26 09:06:39 ALPL402 kernel: [] start_this_handle+0x346/0x3cf [jbd2] Mar 26 09:06:39 ALPL402 kernel: [] ldlm_lock_remove_from_lru+0x74/0xe0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] jbd2_journal_start+0xad/0xe1 [jbd2] Mar 26 09:06:39 ALPL402 kernel: [] fsfilt_ldiskfs_start+0x4c2/0x590 [fsfilt_ldiskfs] Mar 26 09:06:39 ALPL402 kernel: [] filter_version_get_check+0x91/0x2a0 [obdfilter] Mar 26 09:06:39 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:06:39 ALPL402 kernel: [] cfs_alloc+0x68/0xc0 [libcfs] Mar 26 09:06:39 ALPL402 kernel: [] filter_destroy+0xa2d/0x1f90 [obdfilter] Mar 26 09:06:39 ALPL402 kernel: [] ldlm_blocking_ast+0x0/0x2a0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ldlm_completion_ast+0x0/0x880 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] lustre_msg_add_version+0x34/0x110 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] lustre_pack_reply_flags+0x86a/0x950 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ldlm_resource_putref_internal+0x3ab/0x460 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ldlm_lock_put+0x372/0x3d0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] lustre_pack_reply+0x29/0xb0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ost_destroy+0x660/0x790 [ost] Mar 26 09:06:39 ALPL402 kernel: [] lustre_msg_check_version_v2+0x8/0x20 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] lustre_msg_get_opc+0x35/0xf0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ost_handle+0x1566/0x55c0 [ost] Mar 26 09:06:39 ALPL402 kernel: [] ptlrpc_server_handle_request+0x984/0xe00 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] ptlrpc_wait_event+0x2e5/0x310 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:06:39 ALPL402 kernel: [] ptlrpc_main+0xf16/0x10e0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:06:39 ALPL402 kernel: [] ptlrpc_main+0x0/0x10e0 [ptlrpc] Mar 26 09:06:39 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:06:39 ALPL402 kernel: Mar 26 09:06:39 ALPL402 kernel: Lustre: Service thread pid 18623 was inactive for 300.00s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. Mar 26 09:06:39 ALPL402 kernel: Lustre: Service thread pid 13792 was inactive for 300.00s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. Mar 26 09:06:39 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.13792 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.19240 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.13776 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.18544 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.13764 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.18547 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.18623 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.19224 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.18514 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.18687 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.18583 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.19218 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.18511 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.18594 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.13769 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.18529 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.14574 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.19504 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.14391 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.14578 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.13713 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.14597 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.13795 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.18500 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.19445 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.18515 Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.13735 Mar 26 09:06:39 ALPL402 kernel: Lustre: Service thread pid 18668 was inactive for 300.00s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. Mar 26 09:06:39 ALPL402 kernel: Lustre: Skipped 21 previous similar messages Mar 26 09:06:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427331999.18668 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.18727 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.18535 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.18713 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.13759 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.19446 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.18506 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.18600 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.13708 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.19223 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.13742 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.13784 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.18608 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.18592 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.19203 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.14524 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.18596 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.19234 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.18522 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.18680 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.13710 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.18706 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.19520 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.13730 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.18549 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.19247 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.18508 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.18733 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.13823 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.14565 Mar 26 09:06:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332000.19483 Mar 26 09:06:41 ALPL402 kernel: Lustre: Service thread pid 19190 was inactive for 300.00s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. Mar 26 09:06:41 ALPL402 kernel: Lustre: Skipped 30 previous similar messages Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.19190 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.19173 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.13808 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.19523 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.18678 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.18633 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.19231 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.18569 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.19526 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.19191 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.14439 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.13813 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.18520 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.13744 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.18703 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.13724 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.19518 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.18517 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.19183 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.18498 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.18602 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.19509 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.18667 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.19511 Mar 26 09:06:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332001.19175 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18675 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13712 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18662 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13780 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19187 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19479 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18567 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13690 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19217 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18489 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18620 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18654 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13797 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19184 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19219 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13725 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19454 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18645 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18737 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13812 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18712 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18531 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18739 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19448 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18571 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.14317 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13731 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18728 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19521 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18707 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19503 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18558 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18576 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19178 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18585 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13752 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18641 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19489 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18725 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13824 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13777 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13791 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19174 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19436 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18663 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13779 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18659 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18540 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18603 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19447 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18689 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13766 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18708 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18561 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.14398 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13743 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18723 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19476 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18621 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19192 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13750 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13762 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19453 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18572 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19441 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13826 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19492 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18524 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18497 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18647 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19207 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19517 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13739 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18670 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18648 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18661 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18666 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.14231 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13745 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13754 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19482 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13728 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19525 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19500 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19514 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18630 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.13778 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18656 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.19208 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18528 Mar 26 09:06:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332002.18682 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18719 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.14368 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.13709 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18554 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.13772 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18545 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18710 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18622 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18637 Mar 26 09:06:43 ALPL402 kernel: Lustre: Service thread pid 18729 was inactive for 300.00s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. Mar 26 09:06:43 ALPL402 kernel: Lustre: Skipped 124 previous similar messages Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18729 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18523 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.19211 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18736 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.14392 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18651 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.19241 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18732 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18543 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18643 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.13789 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.19519 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18624 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.19475 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.19498 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.19227 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.19182 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.13721 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.13736 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.13788 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18538 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.13765 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.19176 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.19209 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.19480 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18716 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18490 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18493 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.13733 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.13775 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18721 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18488 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18541 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.19216 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18634 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18536 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.13801 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.13722 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.13815 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18730 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18676 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.19438 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18527 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.19193 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18534 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.19515 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.13672 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18559 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.14343 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.19442 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.19196 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.13768 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.19486 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.13714 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18505 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.13767 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18734 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18738 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.19202 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.13706 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.13798 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18573 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.19194 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.19213 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.18590 Mar 26 09:06:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332003.14266 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.13705 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.13753 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.13763 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.19248 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.13755 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.19171 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.19222 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.18578 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.13738 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.19494 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.14582 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.13757 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.18564 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.13732 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.19179 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.13781 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.18699 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.18589 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.14611 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.13719 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.13803 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.18512 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.14589 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.13760 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.18697 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.13785 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.19508 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.18562 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.13747 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.19505 Mar 26 09:06:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332004.13717 Mar 26 09:06:45 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332005.18606 Mar 26 09:06:45 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332005.13751 Mar 26 09:06:45 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332005.18496 Mar 26 09:06:45 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332005.19230 Mar 26 09:06:45 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332005.14596 Mar 26 09:06:45 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332005.13782 Mar 26 09:06:45 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332005.18684 Mar 26 09:06:45 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332005.19516 Mar 26 09:06:45 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332005.13790 Mar 26 09:06:45 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332005.18519 Mar 26 09:06:45 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332005.13802 Mar 26 09:06:45 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332005.19186 Mar 26 09:06:46 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332006.19226 Mar 26 09:06:46 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332006.19205 Mar 26 09:06:46 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332006.18674 Mar 26 09:06:46 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332006.18709 Mar 26 09:06:46 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332006.19204 Mar 26 09:06:46 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332006.14459 Mar 26 09:06:46 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332006.19228 Mar 26 09:06:46 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332006.18566 Mar 26 09:06:46 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332006.13796 Mar 26 09:06:46 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332006.19242 Mar 26 09:06:46 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332006.18646 Mar 26 09:06:46 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332006.19237 Mar 26 09:06:46 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332006.14447 Mar 26 09:06:47 ALPL402 kernel: Lustre: Service thread pid 19488 was inactive for 300.00s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. Mar 26 09:06:47 ALPL402 kernel: Lustre: Skipped 121 previous similar messages Mar 26 09:06:47 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332007.19488 Mar 26 09:06:47 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332007.18722 Mar 26 09:06:47 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332007.18617 Mar 26 09:06:47 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332007.18692 Mar 26 09:06:47 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332007.18613 Mar 26 09:06:47 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332007.14494 Mar 26 09:06:47 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332007.18701 Mar 26 09:06:47 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332007.19232 Mar 26 09:06:47 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332007.18653 Mar 26 09:06:47 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332007.19185 Mar 26 09:06:47 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332007.13821 Mar 26 09:06:47 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332007.13645 Mar 26 09:06:48 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332008.18694 Mar 26 09:06:48 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332008.18632 Mar 26 09:06:48 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332008.13729 Mar 26 09:06:48 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332008.19243 Mar 26 09:06:48 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332008.19206 Mar 26 09:06:48 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332008.14271 Mar 26 09:06:48 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332008.18628 Mar 26 09:06:48 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332008.18627 Mar 26 09:06:48 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332008.14491 Mar 26 09:06:48 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332008.14287 Mar 26 09:06:48 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332008.18502 Mar 26 09:06:49 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332009.19195 Mar 26 09:06:49 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332009.19189 Mar 26 09:06:49 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332009.14586 Mar 26 09:06:50 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332010.18509 Mar 26 09:06:50 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332010.13748 Mar 26 09:06:50 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332010.18640 Mar 26 09:06:50 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332010.14462 Mar 26 09:06:51 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332011.13811 Mar 26 09:06:51 ALPL402 kernel: LustreError: 14445:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-114) req@ffff8101b7163400 x1496666027852354/t0 o8->@:0/0 lens 368/264 e 0 to 0 dl 1427332161 ref 1 fl Interpret:/0/0 rc -114/0 Mar 26 09:06:51 ALPL402 kernel: LustreError: 14445:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 5 previous similar messages Mar 26 09:06:51 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332011.18612 Mar 26 09:06:51 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332011.19485 Mar 26 09:06:51 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332011.18513 Mar 26 09:06:51 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332011.14406 Mar 26 09:06:51 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332011.14279 Mar 26 09:06:52 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332012.18574 Mar 26 09:06:52 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332012.14604 Mar 26 09:06:52 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332012.13793 Mar 26 09:06:53 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332013.13804 Mar 26 09:06:53 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332013.14507 Mar 26 09:06:53 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332013.18642 Mar 26 09:06:53 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332013.13698 Mar 26 09:06:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332014.13718 Mar 26 09:06:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332014.19507 Mar 26 09:06:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332014.18539 Mar 26 09:06:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332014.18644 Mar 26 09:06:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332014.18601 Mar 26 09:06:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332014.13819 Mar 26 09:06:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332014.19221 Mar 26 09:06:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332014.18491 Mar 26 09:06:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332014.18702 Mar 26 09:06:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332014.18616 Mar 26 09:06:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332014.18492 Mar 26 09:06:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332014.18530 Mar 26 09:06:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332014.19502 Mar 26 09:06:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332014.18609 Mar 26 09:06:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332014.19513 Mar 26 09:06:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332014.13818 Mar 26 09:06:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332014.13651 Mar 26 09:06:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332014.18546 Mar 26 09:06:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332014.18525 Mar 26 09:06:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332014.13832 Mar 26 09:06:55 ALPL402 kernel: Lustre: Service thread pid 13668 was inactive for 300.00s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. Mar 26 09:06:55 ALPL402 kernel: Lustre: Skipped 62 previous similar messages Mar 26 09:06:55 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332015.13668 Mar 26 09:06:55 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332015.18614 Mar 26 09:06:55 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332015.13643 Mar 26 09:06:56 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332016.18711 Mar 26 09:06:56 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332016.18704 Mar 26 09:06:56 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332016.18618 Mar 26 09:06:56 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332016.13831 Mar 26 09:06:56 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332016.13810 Mar 26 09:06:56 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332016.18487 Mar 26 09:06:56 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332016.14512 Mar 26 09:06:56 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332016.18501 Mar 26 09:06:56 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332016.14357 Mar 26 09:06:57 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332017.18672 Mar 26 09:06:57 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332017.14484 Mar 26 09:06:57 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332017.18731 Mar 26 09:06:57 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332017.18619 Mar 26 09:06:57 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332017.18698 Mar 26 09:06:57 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332017.19229 Mar 26 09:06:57 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332017.14500 Mar 26 09:06:57 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332017.13805 Mar 26 09:06:58 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332018.18580 Mar 26 09:06:58 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332018.14477 Mar 26 09:06:59 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332019.18629 Mar 26 09:06:59 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332019.18626 Mar 26 09:06:59 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332019.13590 Mar 26 09:06:59 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332019.19481 Mar 26 09:06:59 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332019.18495 Mar 26 09:06:59 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332019.18518 Mar 26 09:06:59 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332019.19181 Mar 26 09:07:00 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332020.14421 Mar 26 09:07:00 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332020.13820 Mar 26 09:07:00 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332020.18555 Mar 26 09:07:00 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332020.18681 Mar 26 09:07:01 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332021.14525 Mar 26 09:07:01 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:07:01 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332021.14548 Mar 26 09:07:01 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332021.18686 Mar 26 09:07:02 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332022.14326 Mar 26 09:07:02 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332022.19455 Mar 26 09:07:02 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332022.14277 Mar 26 09:07:03 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332023.14518 Mar 26 09:07:03 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332023.19499 Mar 26 09:07:03 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332023.13648 Mar 26 09:07:05 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332025.14490 Mar 26 09:07:05 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332025.13773 Mar 26 09:07:05 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332025.14335 Mar 26 09:07:06 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332026.13716 Mar 26 09:07:06 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332026.14350 Mar 26 09:07:06 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332026.19439 Mar 26 09:07:07 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332027.13576 Mar 26 09:07:08 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332028.14550 Mar 26 09:07:08 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332028.14468 Mar 26 09:07:09 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332029.13830 Mar 26 09:07:09 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332029.18673 Mar 26 09:07:09 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332029.14441 Mar 26 09:07:09 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332029.18611 Mar 26 09:07:10 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332030.14612 Mar 26 09:07:11 ALPL402 kernel: Lustre: Service thread pid 13794 was inactive for 300.00s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. Mar 26 09:07:11 ALPL402 kernel: Lustre: Skipped 55 previous similar messages Mar 26 09:07:11 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332031.13794 Mar 26 09:07:11 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332031.19198 Mar 26 09:07:12 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332032.13694 Mar 26 09:07:12 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332032.18726 Mar 26 09:07:12 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332032.18714 Mar 26 09:07:12 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332032.18526 Mar 26 09:07:12 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332032.18499 Mar 26 09:07:12 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332032.19491 Mar 26 09:07:12 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332032.19495 Mar 26 09:07:12 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332032.13816 Mar 26 09:07:12 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332032.19452 Mar 26 09:07:12 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332032.18669 Mar 26 09:07:12 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332032.13740 Mar 26 09:07:12 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332032.18635 Mar 26 09:07:12 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332032.19497 Mar 26 09:07:12 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332032.13827 Mar 26 09:07:13 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332033.18565 Mar 26 09:07:13 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332033.14316 Mar 26 09:07:14 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332034.14449 Mar 26 09:07:14 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332034.13715 Mar 26 09:07:14 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332034.18586 Mar 26 09:07:14 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332034.18650 Mar 26 09:07:15 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332035.13825 Mar 26 09:07:15 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332035.18691 Mar 26 09:07:15 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332035.13584 Mar 26 09:07:16 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332036.14418 Mar 26 09:07:16 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332036.13809 Mar 26 09:07:16 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332036.19210 Mar 26 09:07:16 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332036.18690 Mar 26 09:07:18 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332038.18504 Mar 26 09:07:18 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332038.18533 Mar 26 09:07:18 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332038.13723 Mar 26 09:07:18 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332038.14245 Mar 26 09:07:18 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332038.14440 Mar 26 09:07:18 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332038.18683 Mar 26 09:07:18 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332038.18679 Mar 26 09:07:19 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332039.18548 Mar 26 09:07:19 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332039.13682 Mar 26 09:07:20 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332040.19496 Mar 26 09:07:20 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332040.14407 Mar 26 09:07:21 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332041.14289 Mar 26 09:07:22 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332042.18636 Mar 26 09:07:22 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332042.13599 Mar 26 09:07:22 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332042.13800 Mar 26 09:07:22 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332042.14472 Mar 26 09:07:22 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332042.14264 Mar 26 09:07:22 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332042.14311 Mar 26 09:07:22 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332042.14388 Mar 26 09:07:23 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332043.13697 Mar 26 09:07:23 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332043.14580 Mar 26 09:07:23 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332043.14324 Mar 26 09:07:23 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332043.18494 Mar 26 09:07:23 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332043.18568 Mar 26 09:07:23 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332043.19512 Mar 26 09:07:24 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332044.18685 Mar 26 09:07:24 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332044.13667 Mar 26 09:07:24 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332044.14352 Mar 26 09:07:25 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332045.18615 Mar 26 09:07:25 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332045.14272 Mar 26 09:07:25 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332045.18700 Mar 26 09:07:26 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332046.13786 Mar 26 09:07:26 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332046.19493 Mar 26 09:07:26 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332046.19214 Mar 26 09:07:26 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332046.13586 Mar 26 09:07:27 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332047.19188 Mar 26 09:07:28 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332048.13654 Mar 26 09:07:28 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332048.13727 Mar 26 09:07:28 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332048.13829 Mar 26 09:07:28 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332048.13737 Mar 26 09:07:28 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332048.13720 Mar 26 09:07:28 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332048.18556 Mar 26 09:07:28 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332048.19477 Mar 26 09:07:28 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332048.18652 Mar 26 09:07:28 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332048.13726 Mar 26 09:07:28 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332048.14430 Mar 26 09:07:30 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332050.19201 Mar 26 09:07:30 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332050.18695 Mar 26 09:07:30 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332050.14502 Mar 26 09:07:32 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332052.19215 Mar 26 09:07:32 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332052.13661 Mar 26 09:07:32 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332052.13771 Mar 26 09:07:32 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332052.18696 Mar 26 09:07:32 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332052.19238 Mar 26 09:07:32 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332052.14227 Mar 26 09:07:32 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332052.13828 Mar 26 09:07:32 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332052.19506 Mar 26 09:07:32 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332052.18597 Mar 26 09:07:32 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332052.19197 Mar 26 09:07:32 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332052.13707 Mar 26 09:07:32 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332052.19199 Mar 26 09:07:32 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332052.19437 Mar 26 09:07:33 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332053.19490 Mar 26 09:07:33 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332053.13746 Mar 26 09:07:33 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332053.14443 Mar 26 09:07:33 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332053.19225 Mar 26 09:07:34 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332054.13758 Mar 26 09:07:34 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332054.14537 Mar 26 09:07:34 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332054.18688 Mar 26 09:07:34 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332054.13734 Mar 26 09:07:35 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332055.18658 Mar 26 09:07:35 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332055.14595 Mar 26 09:07:35 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332055.18610 Mar 26 09:07:36 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332056.13595 Mar 26 09:07:37 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332057.18660 Mar 26 09:07:37 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332057.14520 Mar 26 09:07:38 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332058.13612 Mar 26 09:07:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332059.18507 Mar 26 09:07:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332060.14435 Mar 26 09:07:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332060.19510 Mar 26 09:07:40 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332060.14422 Mar 26 09:07:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332061.13622 Mar 26 09:07:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332062.13817 Mar 26 09:07:42 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332062.13655 Mar 26 09:07:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332063.18560 Mar 26 09:07:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332063.14509 Mar 26 09:07:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332063.18503 Mar 26 09:07:43 ALPL402 kernel: Lustre: Service thread pid 18655 was inactive for 300.00s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. Mar 26 09:07:43 ALPL402 kernel: Lustre: Skipped 115 previous similar messages Mar 26 09:07:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332063.18655 Mar 26 09:07:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332063.13761 Mar 26 09:07:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332063.18664 Mar 26 09:07:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332064.13642 Mar 26 09:07:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332064.19233 Mar 26 09:07:44 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332064.18557 Mar 26 09:07:45 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332065.18563 Mar 26 09:07:46 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332066.14234 Mar 26 09:07:47 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332067.18657 Mar 26 09:07:47 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332067.13692 Mar 26 09:07:47 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332067.19212 Mar 26 09:07:48 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332068.18735 Mar 26 09:07:48 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332068.14345 Mar 26 09:07:49 ALPL402 kernel: Lustre: 14432:0:(ldlm_lib.c:805:target_handle_connect()) LFS05-OST0057: exp ffff8104dae26c00 already connecting Mar 26 09:07:49 ALPL402 kernel: Lustre: 14432:0:(ldlm_lib.c:805:target_handle_connect()) Skipped 8 previous similar messages Mar 26 09:07:50 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332070.14448 Mar 26 09:07:51 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332071.14242 Mar 26 09:07:52 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332072.18631 Mar 26 09:07:53 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332073.18516 Mar 26 09:07:53 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332073.14602 Mar 26 09:07:53 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332073.18581 Mar 26 09:07:53 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332073.18595 Mar 26 09:07:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332074.14325 Mar 26 09:07:54 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332074.13822 Mar 26 09:07:55 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332075.13783 Mar 26 09:07:57 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332077.14257 Mar 26 09:07:58 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332078.18552 Mar 26 09:07:59 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332079.14535 Mar 26 09:08:00 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332080.14366 Mar 26 09:08:00 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332080.14556 Mar 26 09:08:01 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332081.18625 Mar 26 09:08:02 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332082.14353 Mar 26 09:08:02 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332082.18532 Mar 26 09:08:02 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332082.18649 Mar 26 09:08:03 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332083.13582 Mar 26 09:08:05 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332085.18665 Mar 26 09:08:05 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332085.13611 Mar 26 09:08:07 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332087.14481 Mar 26 09:08:08 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332088.19239 Mar 26 09:08:09 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332089.18537 Mar 26 09:08:10 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332090.19200 Mar 26 09:08:10 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332090.14258 Mar 26 09:08:13 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332093.19172 Mar 26 09:08:13 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332093.13814 Mar 26 09:08:13 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332093.18587 Mar 26 09:08:13 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332093.13711 Mar 26 09:08:13 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332093.14346 Mar 26 09:08:14 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332094.14467 Mar 26 09:08:14 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332094.18705 Mar 26 09:08:17 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332097.14482 Mar 26 09:08:20 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332100.14558 Mar 26 09:08:20 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332100.13756 Mar 26 09:08:23 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:08:23 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332103.14585 Mar 26 09:08:25 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332105.18521 Mar 26 09:08:25 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332105.19180 Mar 26 09:08:30 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332110.18607 Mar 26 09:08:30 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332110.18570 Mar 26 09:08:33 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332113.18693 Mar 26 09:08:35 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332115.14436 Mar 26 09:08:35 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332115.19449 Mar 26 09:08:37 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332117.13799 Mar 26 09:08:37 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332117.13695 Mar 26 09:08:39 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332119.19236 Mar 26 09:08:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332123.19235 Mar 26 09:08:45 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332125.13806 Mar 26 09:08:47 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332127.13770 Mar 26 09:08:47 ALPL402 kernel: Lustre: Service thread pid 14323 was inactive for 300.00s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. Mar 26 09:08:47 ALPL402 kernel: Lustre: Skipped 63 previous similar messages Mar 26 09:08:47 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332127.14323 Mar 26 09:08:48 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332128.19522 Mar 26 09:08:58 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332138.18510 Mar 26 09:08:58 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332138.18599 Mar 26 09:09:00 ALPL402 kernel: LustreError: 14283:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-114) req@ffff8100b4380800 x1496666027854398/t0 o8->@:0/0 lens 368/264 e 0 to 0 dl 1427332290 ref 1 fl Interpret:/0/0 rc -114/0 Mar 26 09:09:00 ALPL402 kernel: LustreError: 14283:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 16 previous similar messages Mar 26 09:09:07 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332147.13749 Mar 26 09:09:07 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332147.19484 Mar 26 09:09:20 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332160.18604 Mar 26 09:09:20 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332160.18542 Mar 26 09:09:21 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332161.13701 Mar 26 09:09:23 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332163.19474 Mar 26 09:09:29 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332169.13787 Mar 26 09:09:33 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332173.14429 Mar 26 09:09:33 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332173.19524 Mar 26 09:09:33 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332173.18605 Mar 26 09:09:37 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332177.13774 Mar 26 09:09:37 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332177.19487 Mar 26 09:09:37 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332177.19501 Mar 26 09:09:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332181.14446 Mar 26 09:09:41 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332181.18575 Mar 26 09:10:00 ALPL402 kernel: Lustre: 14410:0:(ldlm_lib.c:805:target_handle_connect()) LFS05-OST0057: exp ffff810549838e00 already connecting Mar 26 09:10:00 ALPL402 kernel: Lustre: 14410:0:(ldlm_lib.c:805:target_handle_connect()) Skipped 19 previous similar messages Mar 26 09:11:57 ALPL402 kernel: Lustre: Service thread pid 14515 was inactive for 426.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: Mar 26 09:11:57 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 26 09:11:57 ALPL402 kernel: Pid: 14515, comm: ll_ost_417 Mar 26 09:11:57 ALPL402 kernel: Mar 26 09:11:57 ALPL402 kernel: Call Trace: Mar 26 09:11:57 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:11:57 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:11:57 ALPL402 kernel: [] __jbd2_log_wait_for_space+0x5d/0x1ad [jbd2] Mar 26 09:11:57 ALPL402 kernel: [] start_this_handle+0x346/0x3cf [jbd2] Mar 26 09:11:57 ALPL402 kernel: [] lustre_hash_findadd_unique_hnode+0x3f5/0x490 [obdclass] Mar 26 09:11:57 ALPL402 kernel: [] jbd2_journal_start+0xad/0xe1 [jbd2] Mar 26 09:11:57 ALPL402 kernel: [] fsfilt_ldiskfs_start+0x4c2/0x590 [fsfilt_ldiskfs] Mar 26 09:11:57 ALPL402 kernel: [] dput+0x2c/0x114 Mar 26 09:11:57 ALPL402 kernel: [] filter_client_add+0x508/0xc30 [obdfilter] Mar 26 09:11:57 ALPL402 kernel: [] filter_export_stats_init+0x117/0x650 [obdfilter] Mar 26 09:11:57 ALPL402 kernel: [] filter_connect+0x535/0x8c0 [obdfilter] Mar 26 09:11:57 ALPL402 kernel: [] lustre_msg_add_op_flags+0x47/0x120 [ptlrpc] Mar 26 09:11:57 ALPL402 kernel: [] ost_handle+0x0/0x55c0 [ost] Mar 26 09:11:57 ALPL402 kernel: [] target_handle_connect+0x21c6/0x2e80 [ptlrpc] Mar 26 09:11:57 ALPL402 kernel: [] ptl_send_buf+0x3f3/0x5b0 [ptlrpc] Mar 26 09:11:57 ALPL402 kernel: [] lustre_msg_set_limit+0x35/0xf0 [ptlrpc] Mar 26 09:11:57 ALPL402 kernel: [] ptlrpc_send_reply+0x5e8/0x600 [ptlrpc] Mar 26 09:11:57 ALPL402 kernel: [] lustre_msg_get_version+0x35/0xf0 [ptlrpc] Mar 26 09:11:57 ALPL402 kernel: [] lustre_msg_check_version_v2+0x8/0x20 [ptlrpc] Mar 26 09:11:57 ALPL402 kernel: [] ost_handle+0x8af/0x55c0 [ost] Mar 26 09:11:57 ALPL402 kernel: [] ptlrpc_server_handle_request+0x984/0xe00 [ptlrpc] Mar 26 09:11:57 ALPL402 kernel: [] ptlrpc_wait_event+0x2e5/0x310 [ptlrpc] Mar 26 09:11:57 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:11:57 ALPL402 kernel: [] ptlrpc_main+0xf16/0x10e0 [ptlrpc] Mar 26 09:11:57 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:11:57 ALPL402 kernel: [] ptlrpc_main+0x0/0x10e0 [ptlrpc] Mar 26 09:11:57 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:11:57 ALPL402 kernel: Mar 26 09:11:57 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332317.14515 Mar 26 09:11:58 ALPL402 kernel: Lustre: Service thread pid 18671 was inactive for 426.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: Mar 26 09:11:58 ALPL402 kernel: Pid: 18671, comm: ll_ost_io_303 Mar 26 09:11:58 ALPL402 kernel: Mar 26 09:11:58 ALPL402 kernel: Call Trace: Mar 26 09:11:58 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:11:58 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:11:58 ALPL402 kernel: [] __jbd2_log_wait_for_space+0x5d/0x1ad [jbd2] Mar 26 09:11:58 ALPL402 kernel: [] start_this_handle+0x346/0x3cf [jbd2] Mar 26 09:11:58 ALPL402 kernel: [] ldlm_lock_remove_from_lru+0x74/0xe0 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] jbd2_journal_start+0xad/0xe1 [jbd2] Mar 26 09:11:58 ALPL402 kernel: [] fsfilt_ldiskfs_start+0x4c2/0x590 [fsfilt_ldiskfs] Mar 26 09:11:58 ALPL402 kernel: [] filter_version_get_check+0x91/0x2a0 [obdfilter] Mar 26 09:11:58 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:11:58 ALPL402 kernel: [] cfs_alloc+0x68/0xc0 [libcfs] Mar 26 09:11:58 ALPL402 kernel: [] filter_destroy+0xa2d/0x1f90 [obdfilter] Mar 26 09:11:58 ALPL402 kernel: [] ldlm_blocking_ast+0x0/0x2a0 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] ldlm_completion_ast+0x0/0x880 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] lustre_msg_add_version+0x34/0x110 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] lustre_pack_reply_flags+0x86a/0x950 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] ldlm_resource_putref_internal+0x3ab/0x460 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] ldlm_lock_put+0x372/0x3d0 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] lustre_pack_reply+0x29/0xb0 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] ost_destroy+0x660/0x790 [ost] Mar 26 09:11:58 ALPL402 kernel: [] lustre_msg_check_version_v2+0x8/0x20 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] lustre_msg_get_opc+0x35/0xf0 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] ost_handle+0x1566/0x55c0 [ost] Mar 26 09:11:58 ALPL402 kernel: [] ptlrpc_server_handle_request+0x984/0xe00 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] ptlrpc_wait_event+0x2e5/0x310 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:11:58 ALPL402 kernel: [] ptlrpc_main+0xf16/0x10e0 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:11:58 ALPL402 kernel: [] ptlrpc_main+0x0/0x10e0 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:11:58 ALPL402 kernel: Mar 26 09:11:58 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332318.18671 Mar 26 09:11:58 ALPL402 kernel: Pid: 19177, comm: ll_ost_io_375 Mar 26 09:11:58 ALPL402 kernel: Mar 26 09:11:58 ALPL402 kernel: Call Trace: Mar 26 09:11:58 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:11:58 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:11:58 ALPL402 kernel: [] __jbd2_log_wait_for_space+0x5d/0x1ad [jbd2] Mar 26 09:11:58 ALPL402 kernel: [] start_this_handle+0x346/0x3cf [jbd2] Mar 26 09:11:58 ALPL402 kernel: [] ldlm_lock_remove_from_lru+0x74/0xe0 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] jbd2_journal_start+0xad/0xe1 [jbd2] Mar 26 09:11:58 ALPL402 kernel: [] fsfilt_ldiskfs_start+0x4c2/0x590 [fsfilt_ldiskfs] Mar 26 09:11:58 ALPL402 kernel: [] filter_version_get_check+0x91/0x2a0 [obdfilter] Mar 26 09:11:58 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:11:58 ALPL402 kernel: [] cfs_alloc+0x68/0xc0 [libcfs] Mar 26 09:11:58 ALPL402 kernel: [] filter_destroy+0xa2d/0x1f90 [obdfilter] Mar 26 09:11:58 ALPL402 kernel: [] ldlm_blocking_ast+0x0/0x2a0 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] ldlm_completion_ast+0x0/0x880 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] lustre_msg_add_version+0x34/0x110 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] lustre_pack_reply_flags+0x86a/0x950 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] ldlm_resource_putref_internal+0x3ab/0x460 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] ldlm_lock_put+0x372/0x3d0 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] lustre_pack_reply+0x29/0xb0 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] ost_destroy+0x660/0x790 [ost] Mar 26 09:11:58 ALPL402 kernel: [] lustre_msg_check_version_v2+0x8/0x20 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] lustre_msg_get_opc+0x35/0xf0 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] ost_handle+0x1566/0x55c0 [ost] Mar 26 09:11:58 ALPL402 kernel: [] ptlrpc_server_handle_request+0x984/0xe00 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] ptlrpc_wait_event+0x2e5/0x310 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:11:58 ALPL402 kernel: [] ptlrpc_main+0xf16/0x10e0 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:11:58 ALPL402 kernel: [] ptlrpc_main+0x0/0x10e0 [ptlrpc] Mar 26 09:11:58 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:11:58 ALPL402 kernel: Mar 26 09:11:58 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332318.19177 Mar 26 09:11:59 ALPL402 kernel: Pid: 13585, comm: ll_ost_10 Mar 26 09:11:59 ALPL402 kernel: Mar 26 09:11:59 ALPL402 kernel: Call Trace: Mar 26 09:11:59 ALPL402 kernel: [] kiblnd_check_sends+0x41b/0x560 [ko2iblnd] Mar 26 09:11:59 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:11:59 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:11:59 ALPL402 kernel: [] __sched_text_start+0xf6/0xbd0 Mar 26 09:11:59 ALPL402 kernel: [] filter_parent_lock+0x36/0x220 [obdfilter] Mar 26 09:11:59 ALPL402 kernel: [] filter_fid2dentry+0x2cf/0x740 [obdfilter] Mar 26 09:11:59 ALPL402 kernel: [] __down_trylock+0x44/0x4e Mar 26 09:11:59 ALPL402 kernel: [] filter_lvbo_init+0x3bb/0x69b [obdfilter] Mar 26 09:11:59 ALPL402 kernel: [] LNetPut+0x720/0x830 [lnet] Mar 26 09:11:59 ALPL402 kernel: [] ldlm_resource_get+0x900/0xa60 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] ost_blocking_ast+0x0/0x9b0 [ost] Mar 26 09:11:59 ALPL402 kernel: [] ldlm_server_completion_ast+0x0/0x5e0 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] ldlm_lock_create+0xba/0x9f0 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] lustre_swab_buf+0x81/0x170 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] ldlm_server_glimpse_ast+0x0/0x3b0 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] ldlm_server_glimpse_ast+0x0/0x3b0 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] ldlm_server_completion_ast+0x0/0x5e0 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] ost_blocking_ast+0x0/0x9b0 [ost] Mar 26 09:11:59 ALPL402 kernel: [] ldlm_handle_enqueue+0x670/0x1210 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] lustre_msg_check_version_v2+0x8/0x20 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] ost_handle+0x5003/0x55c0 [ost] Mar 26 09:11:59 ALPL402 kernel: [] ptlrpc_server_handle_request+0x984/0xe00 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] ptlrpc_wait_event+0x2e5/0x310 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:11:59 ALPL402 kernel: [] ptlrpc_main+0xf16/0x10e0 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:11:59 ALPL402 kernel: [] ptlrpc_main+0x0/0x10e0 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:11:59 ALPL402 kernel: Mar 26 09:11:59 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332319.13585 Mar 26 09:11:59 ALPL402 kernel: Pid: 18591, comm: ll_ost_io_227 Mar 26 09:11:59 ALPL402 kernel: Mar 26 09:11:59 ALPL402 kernel: Call Trace: Mar 26 09:11:59 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:11:59 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:11:59 ALPL402 kernel: [] __jbd2_log_wait_for_space+0x5d/0x1ad [jbd2] Mar 26 09:11:59 ALPL402 kernel: [] start_this_handle+0x346/0x3cf [jbd2] Mar 26 09:11:59 ALPL402 kernel: [] ldiskfs_get_blocks+0xaa/0x210 [ldiskfs] Mar 26 09:11:59 ALPL402 kernel: [] jbd2_journal_start+0xad/0xe1 [jbd2] Mar 26 09:11:59 ALPL402 kernel: [] fsfilt_ldiskfs_brw_start+0x35c/0x490 [fsfilt_ldiskfs] Mar 26 09:11:59 ALPL402 kernel: [] filter_quota_acquire+0x0/0x120 [lquota] Mar 26 09:11:59 ALPL402 kernel: [] filter_commitrw_write+0xe4d/0x2e70 [obdfilter] Mar 26 09:11:59 ALPL402 kernel: [] ost_brw_write+0x1c99/0x2480 [ost] Mar 26 09:11:59 ALPL402 kernel: [] LNetMDBind+0x301/0x450 [lnet] Mar 26 09:11:59 ALPL402 kernel: [] lustre_msg_set_limit+0x35/0xf0 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] ptlrpc_send_reply+0x5e8/0x600 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:11:59 ALPL402 kernel: [] lustre_msg_check_version_v2+0x8/0x20 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] ost_handle+0x2bc2/0x55c0 [ost] Mar 26 09:11:59 ALPL402 kernel: [] class_handle2object+0xe0/0x170 [obdclass] Mar 26 09:11:59 ALPL402 kernel: [] lock_res_and_lock+0xba/0xd0 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] __ldlm_handle2lock+0x2f8/0x360 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] ptlrpc_server_handle_request+0x984/0xe00 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] ptlrpc_wait_event+0x2e5/0x310 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:11:59 ALPL402 kernel: [] ptlrpc_main+0xf16/0x10e0 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:11:59 ALPL402 kernel: [] ptlrpc_main+0x0/0x10e0 [ptlrpc] Mar 26 09:11:59 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:11:59 ALPL402 kernel: Mar 26 09:11:59 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332319.18591 Mar 26 09:12:04 ALPL402 kernel: Lustre: Service thread pid 19478 was inactive for 426.00s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. Mar 26 09:12:04 ALPL402 kernel: Lustre: Skipped 18 previous similar messages Mar 26 09:12:04 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332324.19478 Mar 26 09:12:17 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332337.18677 Mar 26 09:12:25 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332345.13807 Mar 26 09:13:30 ALPL402 kernel: LustreError: 14442:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-114) req@ffff8101ba591c00 x1496665802415665/t0 o8->@:0/0 lens 368/264 e 0 to 0 dl 1427332560 ref 1 fl Interpret:/0/0 rc -114/0 Mar 26 09:13:30 ALPL402 kernel: LustreError: 14442:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 43 previous similar messages Mar 26 09:14:04 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332444.13741 Mar 26 09:14:04 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332444.18724 Mar 26 09:14:17 ALPL402 kernel: Lustre: 14499:0:(ldlm_lib.c:805:target_handle_connect()) LFS05-OST0057: exp ffff810c0d176800 already connecting Mar 26 09:14:17 ALPL402 kernel: Lustre: 14499:0:(ldlm_lib.c:805:target_handle_connect()) Skipped 40 previous similar messages Mar 26 09:14:24 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332464.18579 Mar 26 09:14:25 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332465.18584 Mar 26 09:14:25 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332465.18553 Mar 26 09:14:27 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332467.14247 Mar 26 09:14:43 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332483.14486 Mar 26 09:15:01 ALPL402 kernel: Lustre: 19527:0:(service.c:812:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/-207), not sending early reply Mar 26 09:15:01 ALPL402 kernel: req@ffff810b7020bc00 x1495854363304131/t0 o5->LFS05-mdtlov_UUID@NET_0x500000a030548_UUID:0/0 lens 400/400 e 4 to 0 dl 1427332506 ref 2 fl Interpret:/0/0 rc 0/0 Mar 26 09:15:06 ALPL402 kernel: Lustre: 14480:0:(service.c:812:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/-207), not sending early reply Mar 26 09:15:06 ALPL402 kernel: req@ffff810b74d1c000 x1495124511170817/t0 o101->a78ee7bd-bd0e-2c11-4350-6c50e92b2e05@NET_0x500000a030723_UUID:0/0 lens 296/0 e 5 to 0 dl 1427332511 ref 2 fl Interpret:/0/0 rc 0/0 Mar 26 09:15:07 ALPL402 kernel: Lustre: 14495:0:(service.c:812:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/-207), not sending early reply Mar 26 09:15:07 ALPL402 kernel: req@ffff810b8abd4c00 x1493951713062669/t0 o101->423b86f0-c5c7-b9b9-d16d-d10309139761@NET_0x500000a030731_UUID:0/0 lens 296/0 e 5 to 0 dl 1427332512 ref 2 fl Interpret:/0/0 rc 0/0 Mar 26 09:15:07 ALPL402 kernel: Lustre: 14495:0:(service.c:812:ptlrpc_at_send_early_reply()) Skipped 3 previous similar messages Mar 26 09:15:10 ALPL402 kernel: Lustre: 18717:0:(service.c:812:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/-207), not sending early reply Mar 26 09:15:10 ALPL402 kernel: req@ffff810a318a1800 x1495124967380262/t0 o6->ed482feb-8815-efd4-e52e-8c2d7b8a14a2@NET_0x500000a03073c_UUID:0/0 lens 512/400 e 5 to 0 dl 1427332515 ref 2 fl Interpret:/0/0 rc 0/0 Mar 26 09:15:13 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332513.14288 Mar 26 09:15:14 ALPL402 kernel: Lustre: 18717:0:(service.c:812:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/-207), not sending early reply Mar 26 09:15:14 ALPL402 kernel: req@ffff810c10ec4000 x1492974257676758/t0 o4->82fd3dbc-3c6b-baeb-6ed0-4ebd26e0168d@NET_0x500000a030501_UUID:0/0 lens 448/416 e 5 to 0 dl 1427332519 ref 2 fl Interpret:/0/0 rc 0/0 Mar 26 09:15:14 ALPL402 kernel: Lustre: 18717:0:(service.c:812:ptlrpc_at_send_early_reply()) Skipped 4 previous similar messages Mar 26 09:15:19 ALPL402 kernel: Lustre: 18717:0:(service.c:812:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/-109), not sending early reply Mar 26 09:15:19 ALPL402 kernel: req@ffff8105e834c050 x1496606898159884/t0 o4->019d63d0-9e7f-117f-f501-c66ff1b7dd46@NET_0x500000a03032e_UUID:0/0 lens 448/416 e 2 to 0 dl 1427332524 ref 2 fl Interpret:/0/0 rc 0/0 Mar 26 09:15:19 ALPL402 kernel: Lustre: 18717:0:(service.c:812:ptlrpc_at_send_early_reply()) Skipped 10 previous similar messages Mar 26 09:15:28 ALPL402 kernel: Lustre: 14411:0:(service.c:812:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/-199), not sending early reply Mar 26 09:15:28 ALPL402 kernel: req@ffff81053c0d3450 x1495124406679658/t0 o101->c4002e7d-6e15-d980-876b-0c6a35b18688@NET_0x500000a030720_UUID:0/0 lens 296/0 e 3 to 0 dl 1427332533 ref 2 fl Interpret:/0/0 rc 0/0 Mar 26 09:15:28 ALPL402 kernel: Lustre: 14411:0:(service.c:812:ptlrpc_at_send_early_reply()) Skipped 8 previous similar messages Mar 26 09:15:35 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332535.14296 Mar 26 09:15:45 ALPL402 kernel: Lustre: 14488:0:(service.c:812:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/-160), not sending early reply Mar 26 09:15:45 ALPL402 kernel: req@ffff8105c8c4dc00 x1495124666518466/t0 o101->61afc508-76b1-0d6d-e1c4-3d98d8c68b9e@NET_0x500000a030727_UUID:0/0 lens 296/0 e 2 to 0 dl 1427332550 ref 2 fl Interpret:/0/0 rc 0/0 Mar 26 09:15:45 ALPL402 kernel: Lustre: 14488:0:(service.c:812:ptlrpc_at_send_early_reply()) Skipped 10 previous similar messages Mar 26 09:16:08 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332568.14402 Mar 26 09:16:33 ALPL402 kernel: Lustre: 14327:0:(service.c:812:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/-263), not sending early reply Mar 26 09:16:33 ALPL402 kernel: req@ffff8107ec3a8400 x1495124967430847/t0 o101->ed482feb-8815-efd4-e52e-8c2d7b8a14a2@NET_0x500000a03073c_UUID:0/0 lens 296/0 e 3 to 0 dl 1427332598 ref 2 fl Interpret:/0/0 rc 0/0 Mar 26 09:16:33 ALPL402 kernel: Lustre: 14327:0:(service.c:812:ptlrpc_at_send_early_reply()) Skipped 4 previous similar messages Mar 26 09:16:58 ALPL402 kernel: Lustre: 14256:0:(ldlm_lib.c:576:target_handle_reconnect()) LFS05-OST0057: LFS05-mdtlov_UUID reconnecting Mar 26 09:16:58 ALPL402 kernel: Lustre: 14256:0:(ldlm_lib.c:576:target_handle_reconnect()) Skipped 673 previous similar messages Mar 26 09:16:58 ALPL402 kernel: Lustre: 14256:0:(ldlm_lib.c:876:target_handle_connect()) LFS05-OST0057: refuse reconnection from LFS05-mdtlov_UUID@10.3.5.72@o2ib to 0xffff8105ead6f200; still busy with 1 active RPCs Mar 26 09:17:01 ALPL402 kernel: Lustre: 13702:0:(ldlm_lib.c:876:target_handle_connect()) LFS05-OST0057: refuse reconnection from c5111c9d-6e92-beb3-b78e-43408b342d07@10.3.2.1@o2ib to 0xffff810bac454e00; still busy with 1 active RPCs Mar 26 09:17:02 ALPL402 kernel: Lustre: 13683:0:(ldlm_lib.c:876:target_handle_connect()) LFS05-OST0057: refuse reconnection from a78ee7bd-bd0e-2c11-4350-6c50e92b2e05@10.3.7.35@o2ib to 0xffff8105eb7b4400; still busy with 14 active RPCs Mar 26 09:17:07 ALPL402 kernel: Lustre: 13679:0:(ldlm_lib.c:876:target_handle_connect()) LFS05-OST0057: refuse reconnection from LFS05-mdtlov_UUID@10.3.5.72@o2ib to 0xffff8105ead6f200; still busy with 1 active RPCs Mar 26 09:17:07 ALPL402 kernel: Lustre: 13679:0:(ldlm_lib.c:876:target_handle_connect()) Skipped 3 previous similar messages Mar 26 09:17:10 ALPL402 kernel: Lustre: 14412:0:(ldlm_lib.c:876:target_handle_connect()) LFS05-OST0057: refuse reconnection from c5111c9d-6e92-beb3-b78e-43408b342d07@10.3.2.1@o2ib to 0xffff810bac454e00; still busy with 1 active RPCs Mar 26 09:17:10 ALPL402 kernel: Lustre: 14412:0:(ldlm_lib.c:876:target_handle_connect()) Skipped 1 previous similar message Mar 26 09:17:15 ALPL402 kernel: Lustre: 13614:0:(ldlm_lib.c:876:target_handle_connect()) LFS05-OST0057: refuse reconnection from 9969a305-7f5b-8d98-366f-91f842601e7e@10.3.3.59@o2ib to 0xffff8105ebb8c400; still busy with 11 active RPCs Mar 26 09:17:15 ALPL402 kernel: Lustre: 13614:0:(ldlm_lib.c:876:target_handle_connect()) Skipped 6 previous similar messages Mar 26 09:17:23 ALPL402 kernel: Lustre: 13588:0:(ldlm_lib.c:876:target_handle_connect()) LFS05-OST0057: refuse reconnection from 6f79d44b-77be-f5f0-ba7e-6d22b27e1a77@10.3.3.58@o2ib to 0xffff8105abd60a00; still busy with 4 active RPCs Mar 26 09:17:23 ALPL402 kernel: Lustre: 13588:0:(ldlm_lib.c:876:target_handle_connect()) Skipped 14 previous similar messages Mar 26 09:17:31 ALPL402 kernel: Lustre: 14577:0:(ldlm_lib.c:576:target_handle_reconnect()) LFS05-OST0057: aa3223f0-2469-a680-9972-e20a45cb8c95 reconnecting Mar 26 09:17:31 ALPL402 kernel: Lustre: 14577:0:(ldlm_lib.c:576:target_handle_reconnect()) Skipped 42 previous similar messages Mar 26 09:17:40 ALPL402 kernel: Lustre: 14508:0:(ldlm_lib.c:876:target_handle_connect()) LFS05-OST0057: refuse reconnection from d1b868eb-10e1-4a18-db79-2de4ebf0a7ed@10.3.7.36@o2ib to 0xffff8105ea905a00; still busy with 14 active RPCs Mar 26 09:17:40 ALPL402 kernel: Lustre: 14508:0:(ldlm_lib.c:876:target_handle_connect()) Skipped 38 previous similar messages Mar 26 09:18:02 ALPL402 kernel: Lustre: 18717:0:(service.c:812:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/-383), not sending early reply Mar 26 09:18:02 ALPL402 kernel: req@ffff810b8a306000 x1495767678684159/t0 o10->08197287-bcf2-81e5-9a88-3afc4d5e7362@NET_0x500000a030213_UUID:0/0 lens 400/400 e 4 to 0 dl 1427332687 ref 2 fl Interpret:/0/0 rc 0/0 Mar 26 09:18:02 ALPL402 kernel: Lustre: 18717:0:(service.c:812:ptlrpc_at_send_early_reply()) Skipped 1 previous similar message Mar 26 09:18:13 ALPL402 kernel: Lustre: 14453:0:(ldlm_lib.c:876:target_handle_connect()) LFS05-OST0057: refuse reconnection from 1105ba59-fe4f-4b60-332c-a40ace1ba89a@10.3.1.67@o2ib to 0xffff8105ea905e00; still busy with 5 active RPCs Mar 26 09:18:13 ALPL402 kernel: Lustre: 14453:0:(ldlm_lib.c:876:target_handle_connect()) Skipped 93 previous similar messages Mar 26 09:18:35 ALPL402 kernel: Lustre: 14497:0:(ldlm_lib.c:576:target_handle_reconnect()) LFS05-OST0057: c4002e7d-6e15-d980-876b-0c6a35b18688 reconnecting Mar 26 09:18:35 ALPL402 kernel: Lustre: 14497:0:(ldlm_lib.c:576:target_handle_reconnect()) Skipped 186 previous similar messages Mar 26 09:19:17 ALPL402 kernel: Lustre: 14463:0:(ldlm_lib.c:876:target_handle_connect()) LFS05-OST0057: refuse reconnection from 82fd3dbc-3c6b-baeb-6ed0-4ebd26e0168d@10.3.5.1@o2ib to 0xffff8105eb7cf800; still busy with 1 active RPCs Mar 26 09:19:17 ALPL402 kernel: Lustre: 14463:0:(ldlm_lib.c:876:target_handle_connect()) Skipped 190 previous similar messages Mar 26 09:20:10 ALPL402 kernel: Lustre: 18717:0:(service.c:812:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/-225), not sending early reply Mar 26 09:20:10 ALPL402 kernel: req@ffff8104e6868400 x1496634553250501/t0 o4->aa3223f0-2469-a680-9972-e20a45cb8c95@NET_0x500000a030328_UUID:0/0 lens 448/0 e 1 to 0 dl 1427332815 ref 2 fl New:/0/0 rc 0/0 Mar 26 09:20:10 ALPL402 kernel: Lustre: 18717:0:(service.c:812:ptlrpc_at_send_early_reply()) Skipped 695 previous similar messages Mar 26 09:20:43 ALPL402 kernel: Lustre: 14576:0:(ldlm_lib.c:576:target_handle_reconnect()) LFS05-OST0057: 1cd059b0-6258-4163-3e03-f1d01cd59e41 reconnecting Mar 26 09:20:43 ALPL402 kernel: Lustre: 14576:0:(ldlm_lib.c:576:target_handle_reconnect()) Skipped 512 previous similar messages Mar 26 09:21:25 ALPL402 kernel: Lustre: 14505:0:(ldlm_lib.c:876:target_handle_connect()) LFS05-OST0057: refuse reconnection from e4f68fef-4481-fecb-1817-6e26aea2f8ff@10.3.7.62@o2ib to 0xffff8105eadeae00; still busy with 18 active RPCs Mar 26 09:21:25 ALPL402 kernel: Lustre: 14505:0:(ldlm_lib.c:876:target_handle_connect()) Skipped 803 previous similar messages Mar 26 09:22:03 ALPL402 kernel: LustreError: 14458:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-16) req@ffff81005d5cbc00 x1496634553266589/t0 o8->aa3223f0-2469-a680-9972-e20a45cb8c95@NET_0x500000a030328_UUID:0/0 lens 368/264 e 0 to 0 dl 1427333073 ref 1 fl Interpret:/0/0 rc -16/0 Mar 26 09:22:03 ALPL402 kernel: LustreError: 14458:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 1609 previous similar messages Mar 26 09:22:13 ALPL402 kernel: Lustre: Service thread pid 14511 was inactive for 842.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: Mar 26 09:22:13 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 26 09:22:13 ALPL402 kernel: Pid: 14511, comm: ll_ost_413 Mar 26 09:22:13 ALPL402 kernel: Mar 26 09:22:13 ALPL402 kernel: Call Trace: Mar 26 09:22:13 ALPL402 kernel: [] kiblnd_check_sends+0x41b/0x560 [ko2iblnd] Mar 26 09:22:13 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:22:13 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:22:13 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:22:13 ALPL402 kernel: [] filter_parent_lock+0x36/0x220 [obdfilter] Mar 26 09:22:13 ALPL402 kernel: [] filter_fid2dentry+0x2cf/0x740 [obdfilter] Mar 26 09:22:13 ALPL402 kernel: [] __down_trylock+0x44/0x4e Mar 26 09:22:13 ALPL402 kernel: [] filter_lvbo_init+0x3bb/0x69b [obdfilter] Mar 26 09:22:13 ALPL402 kernel: [] lustre_hash_del+0x36e/0x400 [obdclass] Mar 26 09:22:13 ALPL402 kernel: [] ldlm_resource_get+0x900/0xa60 [ptlrpc] Mar 26 09:22:13 ALPL402 kernel: [] ost_blocking_ast+0x0/0x9b0 [ost] Mar 26 09:22:13 ALPL402 kernel: [] ldlm_server_completion_ast+0x0/0x5e0 [ptlrpc] Mar 26 09:22:13 ALPL402 kernel: [] ldlm_lock_create+0xba/0x9f0 [ptlrpc] Mar 26 09:22:13 ALPL402 kernel: [] lustre_swab_buf+0x81/0x170 [ptlrpc] Mar 26 09:22:13 ALPL402 kernel: [] ldlm_server_glimpse_ast+0x0/0x3b0 [ptlrpc] Mar 26 09:22:13 ALPL402 kernel: [] ldlm_server_glimpse_ast+0x0/0x3b0 [ptlrpc] Mar 26 09:22:13 ALPL402 kernel: [] ldlm_server_completion_ast+0x0/0x5e0 [ptlrpc] Mar 26 09:22:13 ALPL402 kernel: [] ost_blocking_ast+0x0/0x9b0 [ost] Mar 26 09:22:13 ALPL402 kernel: [] ldlm_handle_enqueue+0x670/0x1210 [ptlrpc] Mar 26 09:22:13 ALPL402 kernel: [] lustre_msg_check_version_v2+0x8/0x20 [ptlrpc] Mar 26 09:22:13 ALPL402 kernel: [] ost_handle+0x5003/0x55c0 [ost] Mar 26 09:22:13 ALPL402 kernel: [] dequeue_task+0x18/0x37 Mar 26 09:22:13 ALPL402 kernel: [] ptlrpc_server_handle_request+0x984/0xe00 [ptlrpc] Mar 26 09:22:13 ALPL402 kernel: [] ptlrpc_wait_event+0x2e5/0x310 [ptlrpc] Mar 26 09:22:13 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:22:13 ALPL402 kernel: [] ptlrpc_main+0xf16/0x10e0 [ptlrpc] Mar 26 09:22:13 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:22:13 ALPL402 kernel: [] ptlrpc_main+0x0/0x10e0 [ptlrpc] Mar 26 09:22:13 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:22:13 ALPL402 kernel: Mar 26 09:22:13 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332933.14511 Mar 26 09:22:25 ALPL402 kernel: Lustre: Service thread pid 14291 was inactive for 842.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: Mar 26 09:22:25 ALPL402 kernel: Pid: 14291, comm: ll_ost_194 Mar 26 09:22:25 ALPL402 kernel: Mar 26 09:22:25 ALPL402 kernel: Call Trace: Mar 26 09:22:25 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:22:25 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:22:25 ALPL402 kernel: [] __jbd2_log_wait_for_space+0x5d/0x1ad [jbd2] Mar 26 09:22:25 ALPL402 kernel: [] start_this_handle+0x346/0x3cf [jbd2] Mar 26 09:22:25 ALPL402 kernel: [] cache_alloc_refill+0x108/0x188 Mar 26 09:22:25 ALPL402 kernel: [] jbd2_journal_start+0xad/0xe1 [jbd2] Mar 26 09:22:25 ALPL402 kernel: [] fsfilt_ldiskfs_start+0x4c2/0x590 [fsfilt_ldiskfs] Mar 26 09:22:25 ALPL402 kernel: [] dput+0x2c/0x114 Mar 26 09:22:25 ALPL402 kernel: [] filter_client_add+0x508/0xc30 [obdfilter] Mar 26 09:22:25 ALPL402 kernel: [] filter_export_stats_init+0x117/0x650 [obdfilter] Mar 26 09:22:25 ALPL402 kernel: [] filter_connect+0x535/0x8c0 [obdfilter] Mar 26 09:22:25 ALPL402 kernel: [] lustre_msg_add_op_flags+0x47/0x120 [ptlrpc] Mar 26 09:22:25 ALPL402 kernel: [] ost_handle+0x0/0x55c0 [ost] Mar 26 09:22:25 ALPL402 kernel: [] target_handle_connect+0x21c6/0x2e80 [ptlrpc] Mar 26 09:22:25 ALPL402 kernel: [] ptl_send_buf+0x3f3/0x5b0 [ptlrpc] Mar 26 09:22:25 ALPL402 kernel: [] lustre_msg_set_limit+0x35/0xf0 [ptlrpc] Mar 26 09:22:25 ALPL402 kernel: [] ptlrpc_send_reply+0x5e8/0x600 [ptlrpc] Mar 26 09:22:25 ALPL402 kernel: [] lustre_msg_get_version+0x35/0xf0 [ptlrpc] Mar 26 09:22:25 ALPL402 kernel: [] lustre_msg_check_version_v2+0x8/0x20 [ptlrpc] Mar 26 09:22:25 ALPL402 kernel: [] ost_handle+0x8af/0x55c0 [ost] Mar 26 09:22:25 ALPL402 kernel: [] ptlrpc_server_handle_request+0x984/0xe00 [ptlrpc] Mar 26 09:22:25 ALPL402 kernel: [] ptlrpc_wait_event+0x2e5/0x310 [ptlrpc] Mar 26 09:22:25 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:22:25 ALPL402 kernel: [] ptlrpc_main+0xf16/0x10e0 [ptlrpc] Mar 26 09:22:25 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:22:25 ALPL402 kernel: [] ptlrpc_main+0x0/0x10e0 [ptlrpc] Mar 26 09:22:25 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:22:25 ALPL402 kernel: Mar 26 09:22:25 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332945.14291 Mar 26 09:22:27 ALPL402 kernel: Lustre: Service thread pid 14319 was inactive for 842.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: Mar 26 09:22:27 ALPL402 kernel: Pid: 14319, comm: ll_ost_222 Mar 26 09:22:27 ALPL402 kernel: Mar 26 09:22:27 ALPL402 kernel: Call Trace: Mar 26 09:22:27 ALPL402 kernel: [] kiblnd_check_sends+0x41b/0x560 [ko2iblnd] Mar 26 09:22:27 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:22:27 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:22:27 ALPL402 kernel: [] ldlm_grant_lock+0x4e9/0x550 [ptlrpc] Mar 26 09:22:27 ALPL402 kernel: [] filter_parent_lock+0x36/0x220 [obdfilter] Mar 26 09:22:27 ALPL402 kernel: [] filter_fid2dentry+0x2cf/0x740 [obdfilter] Mar 26 09:22:27 ALPL402 kernel: [] __down_trylock+0x44/0x4e Mar 26 09:22:27 ALPL402 kernel: [] filter_lvbo_init+0x3bb/0x69b [obdfilter] Mar 26 09:22:27 ALPL402 kernel: [] LNetPut+0x720/0x830 [lnet] Mar 26 09:22:27 ALPL402 kernel: [] ldlm_resource_get+0x900/0xa60 [ptlrpc] Mar 26 09:22:27 ALPL402 kernel: [] ost_blocking_ast+0x0/0x9b0 [ost] Mar 26 09:22:27 ALPL402 kernel: [] ldlm_server_completion_ast+0x0/0x5e0 [ptlrpc] Mar 26 09:22:27 ALPL402 kernel: [] ldlm_lock_create+0xba/0x9f0 [ptlrpc] Mar 26 09:22:27 ALPL402 kernel: [] lustre_swab_buf+0x81/0x170 [ptlrpc] Mar 26 09:22:27 ALPL402 kernel: [] ldlm_server_glimpse_ast+0x0/0x3b0 [ptlrpc] Mar 26 09:22:27 ALPL402 kernel: [] ldlm_server_glimpse_ast+0x0/0x3b0 [ptlrpc] Mar 26 09:22:27 ALPL402 kernel: [] ldlm_server_completion_ast+0x0/0x5e0 [ptlrpc] Mar 26 09:22:27 ALPL402 kernel: [] ost_blocking_ast+0x0/0x9b0 [ost] Mar 26 09:22:27 ALPL402 kernel: [] ldlm_handle_enqueue+0x670/0x1210 [ptlrpc] Mar 26 09:22:27 ALPL402 kernel: [] lustre_msg_check_version_v2+0x8/0x20 [ptlrpc] Mar 26 09:22:27 ALPL402 kernel: [] ost_handle+0x5003/0x55c0 [ost] Mar 26 09:22:27 ALPL402 kernel: [] ptlrpc_server_handle_request+0x984/0xe00 [ptlrpc] Mar 26 09:22:27 ALPL402 kernel: [] ptlrpc_wait_event+0x2e5/0x310 [ptlrpc] Mar 26 09:22:27 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:22:27 ALPL402 kernel: [] ptlrpc_main+0xf16/0x10e0 [ptlrpc] Mar 26 09:22:27 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:22:27 ALPL402 kernel: [] ptlrpc_main+0x0/0x10e0 [ptlrpc] Mar 26 09:22:27 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:22:27 ALPL402 kernel: Mar 26 09:22:27 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427332947.14319 Mar 26 09:22:59 ALPL402 kernel: Lustre: 13699:0:(ldlm_lib.c:805:target_handle_connect()) LFS05-OST0057: exp ffff810c0d176800 already connecting Mar 26 09:22:59 ALPL402 kernel: Lustre: 13699:0:(ldlm_lib.c:805:target_handle_connect()) Skipped 63 previous similar messages Mar 26 09:24:38 ALPL402 kernel: Lustre: 18717:0:(service.c:812:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/-36), not sending early reply Mar 26 09:24:38 ALPL402 kernel: req@ffff8105dc415c00 x1496543947628949/t0 o6->a1175e6d-5b48-293f-7b04-4e8eda87d8de@NET_0x500000a030138_UUID:0/0 lens 512/0 e 0 to 0 dl 1427333083 ref 2 fl New:/0/0 rc 0/0 Mar 26 09:24:38 ALPL402 kernel: Lustre: 18717:0:(service.c:812:ptlrpc_at_send_early_reply()) Skipped 112 previous similar messages Mar 26 09:24:59 ALPL402 kernel: Lustre: 14344:0:(ldlm_lib.c:576:target_handle_reconnect()) LFS05-OST0057: 187efe83-f4f3-6400-8b50-c74013904ce9 reconnecting Mar 26 09:24:59 ALPL402 kernel: Lustre: 14344:0:(ldlm_lib.c:576:target_handle_reconnect()) Skipped 2695 previous similar messages Mar 26 09:25:41 ALPL402 kernel: Lustre: 14362:0:(ldlm_lib.c:876:target_handle_connect()) LFS05-OST0057: refuse reconnection from 32b33ee7-d6ed-f312-9abc-9437826897ab@10.3.7.31@o2ib to 0xffff8105eb7c1600; still busy with 16 active RPCs Mar 26 09:25:41 ALPL402 kernel: Lustre: 14362:0:(ldlm_lib.c:876:target_handle_connect()) Skipped 2631 previous similar messages Mar 26 09:25:43 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:26:44 ALPL402 last message repeated 2 times Mar 26 09:27:42 ALPL402 last message repeated 2 times Mar 26 09:28:06 ALPL402 kernel: Lustre: Service thread pid 14434 was inactive for 1018.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: Mar 26 09:28:06 ALPL402 kernel: Pid: 14434, comm: ll_ost_336 Mar 26 09:28:06 ALPL402 kernel: Mar 26 09:28:06 ALPL402 kernel: Call Trace: Mar 26 09:28:06 ALPL402 kernel: [] kiblnd_check_sends+0x41b/0x560 [ko2iblnd] Mar 26 09:28:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:28:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:28:06 ALPL402 kernel: [] ldlm_grant_lock+0x4e9/0x550 [ptlrpc] Mar 26 09:28:06 ALPL402 kernel: [] filter_parent_lock+0x36/0x220 [obdfilter] Mar 26 09:28:06 ALPL402 kernel: [] filter_fid2dentry+0x2cf/0x740 [obdfilter] Mar 26 09:28:06 ALPL402 kernel: [] __down_trylock+0x44/0x4e Mar 26 09:28:06 ALPL402 kernel: [] filter_lvbo_init+0x3bb/0x69b [obdfilter] Mar 26 09:28:06 ALPL402 kernel: [] lustre_hash_del+0x36e/0x400 [obdclass] Mar 26 09:28:06 ALPL402 kernel: [] ldlm_resource_get+0x900/0xa60 [ptlrpc] Mar 26 09:28:06 ALPL402 kernel: [] ost_blocking_ast+0x0/0x9b0 [ost] Mar 26 09:28:06 ALPL402 kernel: [] ldlm_server_completion_ast+0x0/0x5e0 [ptlrpc] Mar 26 09:28:06 ALPL402 kernel: [] ldlm_lock_create+0xba/0x9f0 [ptlrpc] Mar 26 09:28:06 ALPL402 kernel: [] lustre_swab_buf+0x81/0x170 [ptlrpc] Mar 26 09:28:06 ALPL402 kernel: [] ldlm_server_glimpse_ast+0x0/0x3b0 [ptlrpc] Mar 26 09:28:06 ALPL402 kernel: [] ldlm_server_glimpse_ast+0x0/0x3b0 [ptlrpc] Mar 26 09:28:06 ALPL402 kernel: [] ldlm_server_completion_ast+0x0/0x5e0 [ptlrpc] Mar 26 09:28:06 ALPL402 kernel: [] ost_blocking_ast+0x0/0x9b0 [ost] Mar 26 09:28:06 ALPL402 kernel: [] ldlm_handle_enqueue+0x670/0x1210 [ptlrpc] Mar 26 09:28:06 ALPL402 kernel: [] lustre_msg_check_version_v2+0x8/0x20 [ptlrpc] Mar 26 09:28:06 ALPL402 kernel: [] ost_handle+0x5003/0x55c0 [ost] Mar 26 09:28:06 ALPL402 kernel: [] ptlrpc_server_handle_request+0x984/0xe00 [ptlrpc] Mar 26 09:28:06 ALPL402 kernel: [] ptlrpc_wait_event+0x2e5/0x310 [ptlrpc] Mar 26 09:28:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:28:06 ALPL402 kernel: [] ptlrpc_main+0xf16/0x10e0 [ptlrpc] Mar 26 09:28:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:28:06 ALPL402 kernel: [] ptlrpc_main+0x0/0x10e0 [ptlrpc] Mar 26 09:28:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:28:06 ALPL402 kernel: Mar 26 09:28:06 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427333286.14434 Mar 26 09:28:16 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:28:35 ALPL402 kernel: Lustre: Service thread pid 13575 was inactive for 1018.00s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: Mar 26 09:28:35 ALPL402 kernel: Pid: 13575, comm: ll_ost_00 Mar 26 09:28:35 ALPL402 kernel: Mar 26 09:28:35 ALPL402 kernel: Call Trace: Mar 26 09:28:35 ALPL402 kernel: [] __lookup_hash+0x10b/0x130 Mar 26 09:28:35 ALPL402 kernel: [] __down+0xc3/0xd8 Mar 26 09:28:35 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:28:35 ALPL402 kernel: [] __down_failed+0x35/0x3a Mar 26 09:28:35 ALPL402 kernel: [] .text.lock.ldlm_resource+0x41/0x87 [ptlrpc] Mar 26 09:28:35 ALPL402 kernel: [] ost_blocking_ast+0x0/0x9b0 [ost] Mar 26 09:28:35 ALPL402 kernel: [] ldlm_server_completion_ast+0x0/0x5e0 [ptlrpc] Mar 26 09:28:35 ALPL402 kernel: [] ldlm_lock_create+0xba/0x9f0 [ptlrpc] Mar 26 09:28:35 ALPL402 kernel: [] lustre_swab_buf+0x81/0x170 [ptlrpc] Mar 26 09:28:35 ALPL402 kernel: [] ldlm_server_glimpse_ast+0x0/0x3b0 [ptlrpc] Mar 26 09:28:35 ALPL402 kernel: [] ldlm_server_glimpse_ast+0x0/0x3b0 [ptlrpc] Mar 26 09:28:35 ALPL402 kernel: [] ldlm_server_completion_ast+0x0/0x5e0 [ptlrpc] Mar 26 09:28:35 ALPL402 kernel: [] ost_blocking_ast+0x0/0x9b0 [ost] Mar 26 09:28:35 ALPL402 kernel: [] ldlm_handle_enqueue+0x670/0x1210 [ptlrpc] Mar 26 09:28:35 ALPL402 kernel: [] lustre_msg_check_version_v2+0x8/0x20 [ptlrpc] Mar 26 09:28:35 ALPL402 kernel: [] ost_handle+0x5003/0x55c0 [ost] Mar 26 09:28:35 ALPL402 kernel: [] ptlrpc_server_handle_request+0x984/0xe00 [ptlrpc] Mar 26 09:28:35 ALPL402 kernel: [] ptlrpc_wait_event+0x2e5/0x310 [ptlrpc] Mar 26 09:28:35 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:28:35 ALPL402 kernel: [] ptlrpc_main+0xf16/0x10e0 [ptlrpc] Mar 26 09:28:35 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:28:35 ALPL402 kernel: [] ptlrpc_main+0x0/0x10e0 [ptlrpc] Mar 26 09:28:35 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:28:35 ALPL402 kernel: Mar 26 09:28:35 ALPL402 kernel: LustreError: dumping log to /tmp/lustre-log.1427333315.13575 Mar 26 09:30:00 ALPL402 kernel: SysRq : Show State Mar 26 09:30:00 ALPL402 kernel: Mar 26 09:30:00 ALPL402 kernel: sibling Mar 26 09:30:00 ALPL402 kernel: task PC pid father child younger older Mar 26 09:30:00 ALPL402 kernel: init S ffff810001015120 0 1 0 2 (NOTLB) Mar 26 09:30:00 ALPL402 kernel: ffff810115ebba28 0000000000000082 ffff810c3ee76140 ffff810c3ee76140 Mar 26 09:30:00 ALPL402 kernel: 0000000010008040 000000000000000a ffff8106400a5040 ffff810655184860 Mar 26 09:30:00 ALPL402 kernel: 0002c27798a8fd0d 0000000000003122 ffff8106400a5228 000000020000000a Mar 26 09:30:00 ALPL402 kernel: Call Trace: Mar 26 09:30:00 ALPL402 kernel: [] schedule_timeout+0x8a/0xad Mar 26 09:30:00 ALPL402 kernel: [] process_timeout+0x0/0x5 Mar 26 09:30:00 ALPL402 kernel: [] do_select+0x3dc/0x43c Mar 26 09:30:00 ALPL402 kernel: [] __pollwait+0x0/0xe2 Mar 26 09:30:00 ALPL402 kernel: ff80063cad>] .text.lock.mutex+0xf/0x14 Mar 26 09:30:00 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:00 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:00 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:00 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:00 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:00 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:00 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:00 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:00 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:00 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:00 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:00 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:00 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:00 ALPL402 kernel: Mar 26 09:30:00 ALPL402 kernel: ll_ost_io_308 D ffff8106550e1420 0 18676 1 18677 18675 (L-TLB) Mar 26 09:30:00 ALPL402 kernel: ffff8102ef6d9840 0000000000000046 00000d0900003a9f ffffffff88be73ba Mar 26 09:30:00 ALPL402 kernel: ffff81063f72be00 000000000000000a ffff8104704ee040 ffff8106552227e0 Mar 26 09:30:00 ALPL402 kernel: 0002c0ee4585c0eb 0000000000147688 ffff8104704ee228 0000000488a7f662 Mar 26 09:30:00 ALPL402 kernel: Call Trace: Mar 26 09:30:00 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:00 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:00 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:00 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xc47/0x2e70 Mar 26 09:30:00 ALPL402 kernel: [] :ost:ost_checksum_bulk+0x352/0x5a0 Mar 26 09:30:00 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:00 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:00 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:00 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:00 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:00 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:00 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:00 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:00 ALPL402 kernel: Mar 26 09:30:00 ALPL402 kernel: ll_ost_io_309 D ffff8106550f2120 0 18677 1 18678 18676 (L-TLB) Mar 26 09:30:00 ALPL402 kernel: ffff8109c3a3f8b0 0000000000000046 ffff810892a00c00 ffff810b4bead380 Mar 26 09:30:01 ALPL402 kernel: 0000000000000001 000000000000000a ffff810c3895e860 ffff8106552de860 Mar 26 09:30:01 ALPL402 kernel: 0002c11ea6913213 00000000000195da ffff810c3895ea48 00000006ffffffff Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:01 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:01 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x8c/0x360 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_310 D ffff8106550f2120 0 18678 1 18679 18677 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8109c34db8b0 0000000000000046 ffff81090c689600 ffff81099b0a4b00 Mar 26 09:30:01 ALPL402 kernel: 0000000000000001 000000000000000a ffff810c3895e100 ffff8106552de860 Mar 26 09:30:01 ALPL402 kernel: 0002c0edc297fb25 000000000000954c ffff810c3895e2e8 00000006ffffffff Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:01 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:01 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_311 D ffff8106550e9aa0 0 18679 1 18680 18678 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8109c38b76d0 0000000000000046 ffff8105dc8a2970 0000000000000000 Mar 26 09:30:01 ALPL402 kernel: 0000000000000000 000000000000000a ffff8109c3bc47a0 ffff81065527e820 Mar 26 09:30:01 ALPL402 kernel: 0002c0f67dda758d 00000000000027cb ffff8109c3bc4988 000000051105e218 Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:01 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:01 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:01 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_resource_iterate+0x1ad/0x240 Mar 26 09:30:01 ALPL402 kernel: [] dequeue_task+0x18/0x37 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_312 D ffff8109d09e30c0 0 18680 1 18681 18679 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8109c4b11840 0000000000000046 ffff81013dc500c0 ffffffff88be73df Mar 26 09:30:01 ALPL402 kernel: ffff81063f72be00 000000000000000a ffff8109c3bc4040 ffff8109d09e30c0 Mar 26 09:30:01 ALPL402 kernel: 0002c0ed9e28be5c 0000000000165fdd ffff8109c3bc4228 0000000388a7f662 Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:01 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_block+0xc0/0x120 Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xc47/0x2e70 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_checksum_bulk+0x36e/0x5a0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:01 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:01 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_313 D ffff810001015120 0 18681 1 18682 18680 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8105265a76d0 0000000000000046 ffff81058acaa9f0 0000000000000000 Mar 26 09:30:01 ALPL402 kernel: 0000000000000000 000000000000000a ffff81046d73f7e0 ffff810655184860 Mar 26 09:30:01 ALPL402 kernel: 0002c0f256a6f493 000000000014c939 ffff81046d73f9c8 000000021105aa08 Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:01 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_checksum_bulk+0x375/0x5a0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:01 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:01 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_314 D ffff810c3a4ae100 0 18682 1 18683 18681 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8109c7c038b0 0000000000000046 ffff8104bc6a0e00 ffff8103fc3b0b00 Mar 26 09:30:01 ALPL402 kernel: 0000000000000001 000000000000000a ffff8109c34fc7e0 ffff810c3a4ae100 Mar 26 09:30:01 ALPL402 kernel: 0002c0ee3083c5e8 000000000000d3fe ffff8109c34fc9c8 00000003ffffffff Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:01 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:01 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_315 D ffff810001015120 0 18683 1 18684 18682 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8102ef6c96d0 0000000000000046 0000000000000029 ffff8102f01411f8 Mar 26 09:30:01 ALPL402 kernel: 0000000000000001 000000000000000a ffff81046d73f080 ffff810655184860 Mar 26 09:30:01 ALPL402 kernel: 0002c0f67e8726d0 00000000000038d1 ffff81046d73f268 0000000211060df0 Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:01 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:01 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:01 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_316 D ffff8106550e1420 0 18684 1 18685 18683 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff810526045770 0000000000000046 0000000000000020 0909090909090930 Mar 26 09:30:01 ALPL402 kernel: ffff810526045810 000000000000000a ffff81046c712820 ffff8106552227e0 Mar 26 09:30:01 ALPL402 kernel: 0002c0eed23e3304 000000000000d889 ffff81046c712a08 000000040f889840 Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:01 ALPL402 kernel: [] add_to_page_cache_lru+0x1c/0x23 Mar 26 09:30:01 ALPL402 kernel: [] find_or_create_page+0x4b/0x72 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:01 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:01 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:01 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:01 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_317 D ffff8106550f2120 0 18685 1 18686 18684 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8109ce5b56d0 0000000000000046 ffff8104ff781c68 0000000000000000 Mar 26 09:30:01 ALPL402 kernel: 0000000000000000 000000000000000a ffff8109c34fc080 ffff8106552de860 Mar 26 09:30:01 ALPL402 kernel: 0002c0f7bd26eaef 000000000000259e ffff8109c34fc268 0000000611060df0 Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:01 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:01 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:01 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_318 D ffff8106550e1420 0 18686 1 18687 18685 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8109cea236d0 0000000000000046 00000000000000df ffff810793644a68 Mar 26 09:30:01 ALPL402 kernel: 0000000000000000 000000000000000a ffff8109c39aa820 ffff8106552227e0 Mar 26 09:30:01 ALPL402 kernel: 0002c0f28bfe2c35 0000000000004a79 ffff8109c39aaa08 000000041105e218 Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:01 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:01 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:01 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_319 D ffff8106550fa7a0 0 18687 1 18688 18686 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8109d048f8b0 0000000000000046 ffff810b45955a00 ffff810b61a9d200 Mar 26 09:30:01 ALPL402 kernel: 0000000000000001 000000000000000a ffff8109c39aa0c0 ffff8106553247a0 Mar 26 09:30:01 ALPL402 kernel: 0002c0ed598a660e 000000000001176a ffff8109c39aa2a8 00000007ffffffff Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:01 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:01 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_320 D ffff81061add4100 0 18688 1 18689 18687 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8109d07416d0 0000000000000046 ffff81045dd297f0 0000000000000000 Mar 26 09:30:01 ALPL402 kernel: 0000000000000000 000000000000000a ffff810c34c75860 ffff81061add4100 Mar 26 09:30:01 ALPL402 kernel: 0002c0fa3eae5085 0000000000002f40 ffff810c34c75a48 0000000311060df0 Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:01 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:01 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:01 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_321 D ffff81000100caa0 0 18689 1 18690 18688 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff81044ad378b0 0000000000000046 ffff8102c680c400 ffff81041d1f6680 Mar 26 09:30:01 ALPL402 kernel: 0000000000000001 000000000000000a ffff81046c7120c0 ffff810640047820 Mar 26 09:30:01 ALPL402 kernel: 0002c0ee06c1d27b 000000000000ca63 ffff81046c7122a8 00000001ffffffff Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:01 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:01 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_322 D ffff81000101d7a0 0 18690 1 18691 18689 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff81044a6578b0 0000000000000046 ffff8103351cf800 ffff81037d82d980 Mar 26 09:30:01 ALPL402 kernel: 0000000000000001 000000000000000a ffff810546e05860 ffff8106551987a0 Mar 26 09:30:01 ALPL402 kernel: 0002c0f60763896e 000000000000d929 ffff810546e05a48 00000003ffffffff Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:01 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:01 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_323 D ffff810001015120 0 18691 1 18692 18690 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8104485e38b0 0000000000000046 ffff81052ab93e00 ffff810450394e00 Mar 26 09:30:01 ALPL402 kernel: 0000000000000001 000000000000000a ffff810546e05100 ffff810655184860 Mar 26 09:30:01 ALPL402 kernel: 0002c0f5adc790ae 000000000000eade ffff810546e052e8 00000002ffffffff Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:01 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:01 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_324 D ffff8106550fa7a0 0 18692 1 18693 18691 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8102ef5ef6d0 0000000000000046 0000000000000006 ffff8108b6acba54 Mar 26 09:30:01 ALPL402 kernel: 0000000000000001 000000000000000a ffff81044c53a7a0 ffff8106553247a0 Mar 26 09:30:01 ALPL402 kernel: 0002c0ef3acfee2e 0000000000003aef ffff81044c53a988 0000000711060608 Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:01 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:01 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:01 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_325 D ffff8106550fa7a0 0 18693 1 18694 18692 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8109d29676d0 0000000000000046 ffff810825a489b0 0000000000000000 Mar 26 09:30:01 ALPL402 kernel: 0000000000000000 000000000000000a ffff810c34c75100 ffff8106553247a0 Mar 26 09:30:01 ALPL402 kernel: 0002c107fc800c16 0000000000002bf1 ffff810c34c752e8 000000071105d978 Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:01 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:01 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:01 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_326 D ffff8106550f2120 0 18694 1 18695 18693 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8109d22716d0 0000000000000046 00000000000000cb ffff810376562948 Mar 26 09:30:01 ALPL402 kernel: 0000000000000001 000000000000000a ffff8109d2a217a0 ffff8106552de860 Mar 26 09:30:01 ALPL402 kernel: 0002c0ef64db0a52 0000000000002b7a ffff8109d2a21988 000000061105cdf8 Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:01 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:01 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:01 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_327 D ffff8106550e1420 0 18695 1 18696 18694 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8102eaf9d6d0 0000000000000046 ffff8103ad3c4ca8 0000000000000000 Mar 26 09:30:01 ALPL402 kernel: 0000000000000000 000000000000000a ffff81044c53a040 ffff8106552227e0 Mar 26 09:30:01 ALPL402 kernel: 0002c0f9342a10ae 0000000000002622 ffff81044c53a228 000000041105e218 Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:01 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:01 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:01 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_328 D ffff81000101d7a0 0 18696 1 18697 18695 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8109d284f770 0000000000000046 0000000000000020 0909090909090938 Mar 26 09:30:01 ALPL402 kernel: ffff8109d284f810 000000000000000a ffff8109d2a21040 ffff8106551987a0 Mar 26 09:30:01 ALPL402 kernel: 0002c0f9a5d86efc 000000000000ce1d ffff8109d2a21228 00000003d7ec24e0 Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:01 ALPL402 kernel: [] add_to_page_cache_lru+0x1c/0x23 Mar 26 09:30:01 ALPL402 kernel: [] find_or_create_page+0x4b/0x72 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:01 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:01 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:01 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:01 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_329 D ffff810001015120 0 18697 1 18698 18696 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8102eaf9f840 0000000000000046 ffff8103328e5678 ffffffff88be73df Mar 26 09:30:01 ALPL402 kernel: ffff81063f72be00 000000000000000a ffff81044b9bf7e0 ffff810655184860 Mar 26 09:30:01 ALPL402 kernel: 0002c0eea2f3b2b9 000000000015e48d ffff81044b9bf9c8 0000000288a7f662 Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xc47/0x2e70 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_checksum_bulk+0x330/0x5a0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:01 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:01 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_330 D ffff810001015120 0 18698 1 18699 18697 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8102eafb3770 0000000000000046 0000000000000020 0909090909090938 Mar 26 09:30:01 ALPL402 kernel: ffff8102eafb3810 000000000000000a ffff81044b9bf080 ffff810655184860 Mar 26 09:30:01 ALPL402 kernel: 0002c0f1982d3701 000000000000efa5 ffff81044b9bf268 00000002d22a6918 Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:01 ALPL402 kernel: [] add_to_page_cache_lru+0x1c/0x23 Mar 26 09:30:01 ALPL402 kernel: [] find_or_create_page+0x4b/0x72 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:01 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:01 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:01 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:01 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_331 D ffff81000100caa0 0 18699 1 18700 18698 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8102eafc58b0 0000000000000046 ffff81044b8d4200 ffff8103f0373500 Mar 26 09:30:01 ALPL402 kernel: 0000000000000001 000000000000000a ffff81044b568820 ffff810640047820 Mar 26 09:30:01 ALPL402 kernel: 0002c0ee8107af0c 000000000000b062 ffff81044b568a08 00000001ffffffff Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:01 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:01 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_332 D ffff81061f7bd7a0 0 18700 1 18701 18699 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8102eafc76d0 0000000000000046 0000000000000007 ffff81019a716048 Mar 26 09:30:01 ALPL402 kernel: 0000000000000001 000000000000000a ffff81044b5680c0 ffff81061f7bd7a0 Mar 26 09:30:01 ALPL402 kernel: 0002c0f82b0d2640 0000000000003a68 ffff81044b5682a8 0000000711060608 Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] mutex_lock+0x13/0x1d Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:01 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:01 ALPL402 kernel: [] :ko2iblnd:kiblnd_init_tx_msg+0x154/0x1d0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:01 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:01 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_333 D ffff8106550e1420 0 18701 1 18702 18700 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8109d2ccf770 0000000000000046 0000000000000020 0909090909090933 Mar 26 09:30:01 ALPL402 kernel: ffff8109d2ccf810 000000000000000a ffff8109d05697e0 ffff8106552227e0 Mar 26 09:30:01 ALPL402 kernel: 0002c0ef46252555 000000000000ff08 ffff8109d05699c8 00000004864e7918 Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:01 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:01 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:01 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:01 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:01 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:01 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:01 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:01 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:01 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:01 ALPL402 kernel: Mar 26 09:30:01 ALPL402 kernel: ll_ost_io_334 D ffff8106550e9aa0 0 18702 1 18703 18701 (L-TLB) Mar 26 09:30:01 ALPL402 kernel: ffff8109d2891770 0000000000000046 0000000000000020 0909090909090930 Mar 26 09:30:01 ALPL402 kernel: ffff8109d2891810 000000000000000a ffff8109d0569080 ffff81065527e820 Mar 26 09:30:01 ALPL402 kernel: 0002c0f0e53b4b6e 000000000000e5f9 ffff8109d0569268 00000005bdb72f00 Mar 26 09:30:01 ALPL402 kernel: Call Trace: Mar 26 09:30:01 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:01 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:01 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:01 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:01 ALPL402 kernel: [] add_to_page_cache_lru+0x1c/0x23 Mar 26 09:30:01 ALPL402 kernel: [] find_or_create_page+0x4b/0x72 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:01 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:01 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:02 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:02 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:02 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_335 D ffff8106550e9aa0 0 18703 1 18704 18702 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8109d37c16d0 0000000000000046 00000000000000c4 ffff8106e002190c Mar 26 09:30:02 ALPL402 kernel: 0000000000000001 000000000000000a ffff8109d09e3820 ffff81065527e820 Mar 26 09:30:02 ALPL402 kernel: 0002c0edd58c9d15 000000000000319c ffff8109d09e3a08 00000005110609a0 Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:02 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:02 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:02 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_336 D ffff81000101d7a0 0 18704 1 18705 18703 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8109d448f770 0000000000000046 0000000000000020 0909090909090936 Mar 26 09:30:02 ALPL402 kernel: ffff8109d448f810 000000000000000a ffff8106f70510c0 ffff8106551987a0 Mar 26 09:30:02 ALPL402 kernel: 0002c0f13878a5ba 000000000000e904 ffff8106f70512a8 000000038f58be28 Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:02 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:02 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:02 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:02 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:02 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_337 D ffff810001015120 0 18705 1 18706 18704 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8109d491f770 0000000000000046 0000000000000020 0909090909090934 Mar 26 09:30:02 ALPL402 kernel: ffff8109d491f810 000000000000000a ffff8109d01f3860 ffff810655184860 Mar 26 09:30:02 ALPL402 kernel: 0002c1037fb771d6 000000000000f986 ffff8109d01f3a48 00000002b69770a8 Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:02 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:02 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:02 ALPL402 kernel: [] :lnet:lnet_prep_send+0x67/0xb0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x1bc/0x320 Mar 26 09:30:02 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:02 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:02 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_foreach+0x11a/0x390 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_338 D ffff81000101d7a0 0 18706 1 18707 18705 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8109d40df840 0000000000000046 ffff81013dc500c0 ffffffff88be73df Mar 26 09:30:02 ALPL402 kernel: ffff81063f72be00 0000000000000009 ffff8109d09e30c0 ffff8106551987a0 Mar 26 09:30:02 ALPL402 kernel: 0002c0ed9e6f1ded 00000000000d92d6 ffff8109d09e32a8 0000000388a7f662 Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xc47/0x2e70 Mar 26 09:30:02 ALPL402 kernel: [] thread_return+0x62/0xfe Mar 26 09:30:02 ALPL402 kernel: [] __cond_resched+0x1c/0x44 Mar 26 09:30:02 ALPL402 kernel: [] cond_resched+0x37/0x42 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:02 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:02 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_339 D ffff810611b74820 0 18707 1 18708 18706 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff810453695770 0000000000000046 0000000000000020 0909090909090933 Mar 26 09:30:02 ALPL402 kernel: ffff810453695810 000000000000000a ffff8105266a3860 ffff810611b74820 Mar 26 09:30:02 ALPL402 kernel: 0002c0ee00500c9c 000000000000da13 ffff8105266a3a48 00000001193ac5b8 Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] :ldiskfs:ldiskfs_bread+0xe/0x80 Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:02 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:02 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:02 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:02 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:02 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_340 D ffff8109cec22860 0 18708 1 18709 18707 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8102ef5e38b0 0000000000000046 ffff8107e5828800 ffff810a4cdce3c0 Mar 26 09:30:02 ALPL402 kernel: 0000000000000001 000000000000000a ffff8105266a3100 ffff8109cec22860 Mar 26 09:30:02 ALPL402 kernel: 0002c0ee072a9644 000000000000af61 ffff8105266a32e8 00000006ffffffff Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:02 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] move_tasks+0x22c/0x2ec Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_341 D ffff8106550e1420 0 18709 1 18710 18708 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8109d3107840 0000000000000046 0000000000000286 ffffffff88be73ba Mar 26 09:30:02 ALPL402 kernel: ffff81063f72be00 000000000000000a ffff810c3658c7a0 ffff8106552227e0 Mar 26 09:30:02 ALPL402 kernel: 0002c0eef0b5ffc5 0000000000147511 ffff810c3658c988 0000000488a7f662 Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xc47/0x2e70 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_checksum_bulk+0x2e2/0x5a0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:02 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:02 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_342 D ffff8106550e9aa0 0 18710 1 18711 18709 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8109d798f8b0 0000000000000046 ffff810908914600 ffff8107a56ec840 Mar 26 09:30:02 ALPL402 kernel: 0000000000000001 000000000000000a ffff810c3658c040 ffff81065527e820 Mar 26 09:30:02 ALPL402 kernel: 0002c0ee363f85dc 000000000000b9a8 ffff810c3658c228 00000005ffffffff Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:02 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_343 D ffff81061f7bd7a0 0 18711 1 18712 18710 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff810b774e9770 0000000000000046 0000000000000020 0909090909090932 Mar 26 09:30:02 ALPL402 kernel: ffff810b774e9810 000000000000000a ffff8109c340d7e0 ffff81061f7bd7a0 Mar 26 09:30:02 ALPL402 kernel: 0002c0f13868a8ef 00000000000101e1 ffff8109c340d9c8 0000000703a559f0 Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] :ldiskfs:ldiskfs_bread+0xe/0x80 Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:02 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:02 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:02 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:02 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:02 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_344 D ffff810001015120 0 18712 1 18713 18711 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8109d0bc38b0 0000000000000046 ffff81031008ee00 ffff81031fddb0c0 Mar 26 09:30:02 ALPL402 kernel: 0000000000000001 000000000000000a ffff8109c340d080 ffff810655184860 Mar 26 09:30:02 ALPL402 kernel: 0002c0edfc1344bf 000000000000b682 ffff8109c340d268 00000002ffffffff Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:02 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_345 D ffff8109daa09860 0 18713 1 18714 18712 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff81045faf38b0 0000000000000046 ffff8103fd02a000 ffff81049e72acc0 Mar 26 09:30:02 ALPL402 kernel: 0000000000000001 000000000000000a ffff8105321e17a0 ffff8109daa09860 Mar 26 09:30:02 ALPL402 kernel: 0002c0ed7ef55bbc 000000000000c7c1 ffff8105321e1988 00000002ffffffff Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:02 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_346 D ffff810001015120 0 18714 1 18716 18713 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8109d0343770 0000000000000046 0000000000000020 0909090909090939 Mar 26 09:30:02 ALPL402 kernel: ffff8109d0343810 000000000000000a ffff8109c34a5820 ffff810655184860 Mar 26 09:30:02 ALPL402 kernel: 0002c0f505302e3d 000000000000e9bf ffff8109c34a5a08 00000002486e0690 Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:02 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:02 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:02 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:02 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:02 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_347 D ffff81000101d7a0 0 18716 1 18717 18714 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8109cfe8f8b0 0000000000000046 ffff810624f55800 ffff8104ea208200 Mar 26 09:30:02 ALPL402 kernel: 0000000000000001 000000000000000a ffff8106b9fd3860 ffff8106551987a0 Mar 26 09:30:02 ALPL402 kernel: 0002c0ee41ad4d8e 000000000000b745 ffff8106b9fd3a48 00000003ffffffff Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:02 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_348 S ffff8106550fa7a0 0 18717 1 18719 18716 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff810464f41e20 0000000000000046 ffff8106142521b0 ffffffff88c48e20 Mar 26 09:30:02 ALPL402 kernel: ffff8105ea51c400 000000000000000a ffff8105321e1040 ffff8106553247a0 Mar 26 09:30:02 ALPL402 kernel: 0002c278bbbc4fdd 00000000000034a2 ffff8105321e1228 00000007b2678a40 Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_rw_prolong_locks+0x2e0/0x450 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:02 ALPL402 kernel: [] __wake_up+0x38/0x4f Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_349 D ffff810631fd8040 0 18719 1 18721 18717 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8109cd5c9770 0000000000000046 0000000000000020 0909090909090937 Mar 26 09:30:02 ALPL402 kernel: ffff8109cd5c9810 000000000000000a ffff8109c34a50c0 ffff810631fd8040 Mar 26 09:30:02 ALPL402 kernel: 0002c0ee2f9db1d8 000000000000edaa ffff8109c34a52a8 000000063dc7e180 Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] :ldiskfs:ldiskfs_bread+0xe/0x80 Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:02 ALPL402 kernel: [] add_to_page_cache_lru+0x1c/0x23 Mar 26 09:30:02 ALPL402 kernel: [] find_or_create_page+0x4b/0x72 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:02 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:02 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:02 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:02 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:02 ALPL402 kernel: [] dequeue_task+0x18/0x37 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_350 D ffff810263c14100 0 18721 1 18722 18719 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8109c93478b0 0000000000000046 ffff810aca012000 ffff81094aa65cc0 Mar 26 09:30:02 ALPL402 kernel: 0000000000000001 000000000000000a ffff810b6e1797a0 ffff810263c14100 Mar 26 09:30:02 ALPL402 kernel: 0002c0ee429d76fe 000000000000af22 ffff810b6e179988 00000006ffffffff Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:02 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] dequeue_task+0x18/0x37 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_351 D ffff8106550f2120 0 18722 1 18723 18721 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8109c5ef78b0 0000000000000046 ffff810930d3dc00 ffff810a92c5c380 Mar 26 09:30:02 ALPL402 kernel: 0000000000000001 000000000000000a ffff810b6e179040 ffff8106552de860 Mar 26 09:30:02 ALPL402 kernel: 0002c0ef288a1a7e 00000000000099bc ffff810b6e179228 00000006ffffffff Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:02 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_352 D ffff810449c0d860 0 18723 1 18724 18722 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8109c61578b0 0000000000000046 ffff8104cfbae800 ffff81031fddb840 Mar 26 09:30:02 ALPL402 kernel: 0000000000000001 000000000000000a ffff8109d76b17e0 ffff810449c0d860 Mar 26 09:30:02 ALPL402 kernel: 0002c0ee07ec854a 000000000000cb1f ffff8109d76b19c8 00000001ffffffff Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:02 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_353 D ffff810001015120 0 18724 1 18725 18723 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8105349dd8b0 0000000000000046 ffff81037e587200 ffff8103d82facc0 Mar 26 09:30:02 ALPL402 kernel: 0000000000000001 000000000000000a ffff8104665937e0 ffff810655184860 Mar 26 09:30:02 ALPL402 kernel: 0002c1230e10b5fa 0000000000014d76 ffff8104665939c8 00000002ffffffff Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:02 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x8c/0x360 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_354 D ffff81000101d7a0 0 18725 1 18726 18724 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8105321938b0 0000000000000046 ffff8103a8b22c00 ffff810397c17680 Mar 26 09:30:02 ALPL402 kernel: 0000000000000001 000000000000000a ffff810466593080 ffff8106551987a0 Mar 26 09:30:02 ALPL402 kernel: 0002c0ee04069a0a 000000000000bbe8 ffff810466593268 00000003ffffffff Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:02 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_355 D ffff81000101d7a0 0 18726 1 18727 18725 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8105265956d0 0000000000000046 ffff81034cea3930 0000000000000000 Mar 26 09:30:02 ALPL402 kernel: 0000000000000000 000000000000000a ffff810464e20820 ffff8106551987a0 Mar 26 09:30:02 ALPL402 kernel: 0002c0f504b1f1ed 000000000000375a ffff810464e20a08 000000031105aa08 Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:02 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:02 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:02 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_356 D ffff8105c5d560c0 0 18727 1 18728 18726 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8102ec9fd770 0000000000000046 0000000000000020 0909090909090938 Mar 26 09:30:02 ALPL402 kernel: ffff8102ec9fd810 000000000000000a ffff810464e200c0 ffff8105c5d560c0 Mar 26 09:30:02 ALPL402 kernel: 0002c0ed7f1612dc 000000000000ef11 ffff810464e202a8 000000043b87ff00 Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] :ldiskfs:ldiskfs_bread+0xe/0x80 Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:02 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:02 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:02 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:02 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:02 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:02 ALPL402 kernel: [] dequeue_task+0x18/0x37 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_357 D ffff8106550fa7a0 0 18728 1 18729 18727 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8109c34f38b0 0000000000000046 ffff8108fe4d4600 ffff810683e44540 Mar 26 09:30:02 ALPL402 kernel: 0000000000000001 000000000000000a ffff8109d76b1080 ffff8106553247a0 Mar 26 09:30:02 ALPL402 kernel: 0002c0edfed8ebf5 000000000000cfa0 ffff8109d76b1268 00000007ffffffff Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:02 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_358 D ffff8106550fa7a0 0 18729 1 18730 18728 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8109c38356d0 0000000000000046 00000000000000ae ffff8107b4f2881c Mar 26 09:30:02 ALPL402 kernel: 0000000000000001 000000000000000a ffff8109d7b9b820 ffff8106553247a0 Mar 26 09:30:02 ALPL402 kernel: 0002c0ee399536a1 00000000000037bc ffff8109d7b9ba08 000000071105e218 Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:02 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:02 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_prolong_locks_iter+0x0/0x180 Mar 26 09:30:02 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x230/0x460 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_iterate+0x1ad/0x240 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:02 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:02 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:02 ALPL402 kernel: Mar 26 09:30:02 ALPL402 kernel: ll_ost_io_359 D ffff8105f13cb080 0 18730 1 18731 18729 (L-TLB) Mar 26 09:30:02 ALPL402 kernel: ffff8109c38698b0 0000000000000046 ffff810ace0c9e00 ffff8109c0c1f540 Mar 26 09:30:02 ALPL402 kernel: 0000000000000001 000000000000000a ffff8109d6120040 ffff8105f13cb080 Mar 26 09:30:02 ALPL402 kernel: 0002c0ee454f0260 000000000000c2fb ffff8109d6120228 00000006ffffffff Mar 26 09:30:02 ALPL402 kernel: Call Trace: Mar 26 09:30:02 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:02 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:02 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:02 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:02 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:02 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:02 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:02 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:02 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:03 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ll_ost_io_360 D ffff81000100caa0 0 18731 1 18732 18730 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8109c34516d0 0000000000000046 ffff810935e34c68 0000000000000000 Mar 26 09:30:03 ALPL402 kernel: 0000000000000000 000000000000000a ffff8109c6376860 ffff810640047820 Mar 26 09:30:03 ALPL402 kernel: 0002c0f18cda5528 00000000000049d7 ffff8109c6376a48 000000011105e218 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:03 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:03 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:03 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:03 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:03 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:03 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:03 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] sync_page+0x0/0x42 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ll_ost_io_361 D ffff81000100caa0 0 18732 1 18733 18731 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8102ecabb8b0 0000000000000046 ffff8105af116200 ffff81022ca24e40 Mar 26 09:30:03 ALPL402 kernel: 0000000000000001 000000000000000a ffff810464f20860 ffff810640047820 Mar 26 09:30:03 ALPL402 kernel: 0002c0ee3cb83a01 000000000000aaf1 ffff810464f20a48 00000001ffffffff Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:03 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:03 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:03 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:03 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ll_ost_io_362 D ffff81000101d7a0 0 18733 1 18734 18732 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8102ec8d38b0 0000000000000046 ffff8105aadc4000 ffff8104ff23c9c0 Mar 26 09:30:03 ALPL402 kernel: 0000000000000001 000000000000000a ffff810464f20100 ffff8106551987a0 Mar 26 09:30:03 ALPL402 kernel: 0002c0eda5f15fef 000000000000ba69 ffff810464f202e8 00000003ffffffff Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:03 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:03 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:03 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:03 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ll_ost_io_363 D ffff81000101d7a0 0 18734 1 18735 18733 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8104637d78b0 0000000000000046 ffff8103df06a600 ffff81034bb19080 Mar 26 09:30:03 ALPL402 kernel: 0000000000000001 000000000000000a ffff810463c537a0 ffff8106551987a0 Mar 26 09:30:03 ALPL402 kernel: 0002c0ee58490177 000000000000aaed ffff810463c53988 00000003ffffffff Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:03 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:03 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:03 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:03 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ll_ost_io_364 D ffff8106550fa7a0 0 18735 1 18736 18734 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8102ea86f6d0 0000000000000046 ffff8104838d4ab0 0000000000000000 Mar 26 09:30:03 ALPL402 kernel: 0000000000000000 000000000000000a ffff810463c53040 ffff8106553247a0 Mar 26 09:30:03 ALPL402 kernel: 0002c0fd6f615460 0000000000003275 ffff810463c53228 000000071105a7e0 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:03 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:03 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:03 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:03 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:03 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:03 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:03 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ll_ost_io_365 D ffff8106550fa7a0 0 18736 1 18737 18735 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8109c34b78b0 0000000000000046 ffff810ad1ace000 ffff810ab0534c80 Mar 26 09:30:03 ALPL402 kernel: 0000000000000001 000000000000000a ffff8109d7b9b0c0 ffff8106553247a0 Mar 26 09:30:03 ALPL402 kernel: 0002c0ee3bc02e67 0000000000009bf7 ffff8109d7b9b2a8 00000007ffffffff Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:03 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:03 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:03 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:03 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ll_ost_io_366 D ffff8106550e1420 0 18737 1 18738 18736 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8106b95098b0 0000000000000046 ffff8106a871ea00 ffff8107cee91540 Mar 26 09:30:03 ALPL402 kernel: 0000000000000001 000000000000000a ffff8109d77097a0 ffff8106552227e0 Mar 26 09:30:03 ALPL402 kernel: 0002c0edfbb8372b 000000000000b53d ffff8109d7709988 00000004ffffffff Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:03 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:03 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:03 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:03 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ll_ost_io_367 D ffff8109c39aa820 0 18738 1 18739 18737 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8106b95678b0 0000000000000046 ffff8109d9525a00 ffff8108558c0980 Mar 26 09:30:03 ALPL402 kernel: 0000000000000001 000000000000000a ffff8109d7709040 ffff8109c39aa820 Mar 26 09:30:03 ALPL402 kernel: 0002c0ee5829bd77 0000000000009a10 ffff8109d7709228 00000004ffffffff Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:03 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:03 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:03 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:03 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ll_ost_io_368 D ffff810001004420 0 18739 1 18740 18738 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8106b9fa58b0 0000000000000046 ffff8104d98ca400 ffff8105daef39c0 Mar 26 09:30:03 ALPL402 kernel: 0000000000000001 000000000000000a ffff8109d76d47e0 ffffffff8031db60 Mar 26 09:30:03 ALPL402 kernel: 0002c0edfba4a8e9 000000000000b848 ffff8109d76d49c8 00000000ffffffff Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:03 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:03 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:03 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:03 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_24 S ffff810001004420 0 18740 1 18741 18739 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8102ea977ea0 0000000000000046 ffff810c1864f200 ffff8109ea326698 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8102ead480c0 ffffffff8031db60 Mar 26 09:30:03 ALPL402 kernel: 0002c127e4caf19c 00000000000092df ffff8102ead482a8 0000000000000282 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] __drain_alien_cache+0x51/0x66 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_25 S ffff8106550f2120 0 18741 1 18784 18740 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8106b10e7ea0 0000000000000046 ffff81039a11d600 ffff8105347e4098 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8109d76d4080 ffff8106552de860 Mar 26 09:30:03 ALPL402 kernel: 0002c11a1f88cab9 0000000000008dcf ffff8109d76d4268 0000000600000282 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_26 S ffff8106550e1420 0 18784 1 18785 18741 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8106af6f1ea0 0000000000000046 ffff810349fff600 ffff8104e079fad8 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106b0ed4820 ffff8106552227e0 Mar 26 09:30:03 ALPL402 kernel: 0002c11f4e4684ef 000000000000b561 ffff8106b0ed4a08 0000000400000286 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_27 S ffff8106550e9aa0 0 18785 1 18786 18784 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8106af00bea0 0000000000000046 ffff810c03aabe00 ffff8106d15635d8 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106b12ed860 ffff81065527e820 Mar 26 09:30:03 ALPL402 kernel: 0002c120722f8ef3 00000000000070d2 ffff8106b12eda48 0000000500000286 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_28 S ffff810001004420 0 18786 1 18787 18785 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8106aadbdea0 0000000000000046 ffff8104e85a5400 ffff810387ac26d8 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106b0ef3080 ffffffff8031db60 Mar 26 09:30:03 ALPL402 kernel: 0002c124a80e6441 00000000000072f5 ffff8106b0ef3268 0000000000000282 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_29 S ffff8106550fa7a0 0 18787 1 18788 18786 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8106aadc1ea0 0000000000000046 ffff81080f31c600 ffff810953d967d8 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8109c6376100 ffff8106553247a0 Mar 26 09:30:03 ALPL402 kernel: 0002c11ed2bebf67 0000000000006f95 ffff8109c63762e8 0000000700000286 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_30 S ffff8106550e9aa0 0 18788 1 18789 18787 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8106aadc3ea0 0000000000000046 ffff810a76a24c00 ffff810938b57ed8 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106b09ae080 ffff81065527e820 Mar 26 09:30:03 ALPL402 kernel: 0002c11a1f6cab24 000000000000a322 ffff8106b09ae268 00000005bcefd5c0 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_31 S ffff8106550f2120 0 18789 1 18790 18788 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8106aadc5ea0 0000000000000046 ffff8103fef9e400 ffff8102d7fc5c98 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106abd41820 ffff8106552de860 Mar 26 09:30:03 ALPL402 kernel: 0002c1207874a798 0000000000007412 ffff8106abd41a08 0000000600000282 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_32 S ffff8106550fa7a0 0 18790 1 18791 18789 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8106abaa3ea0 0000000000000046 ffff810bf53a0a00 ffff8106ac9c1b98 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106abd410c0 ffff8106553247a0 Mar 26 09:30:03 ALPL402 kernel: 0002c120789b048b 000000000000712a ffff8106abd412a8 0000000700000282 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_33 S ffff8106550e9aa0 0 18791 1 18945 18790 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8106aadc9ea0 0000000000000046 ffff81051fbdba00 ffff81019a64ec98 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106abd43860 ffff81065527e820 Mar 26 09:30:03 ALPL402 kernel: 0002c118c635202e 0000000000009f89 ffff8106abd43a48 0000000500000282 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_34 S ffff8106550fa7a0 0 18945 1 18946 18791 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8102d2f97ea0 0000000000000046 ffff810ada209800 ffff810b9f2babd8 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8102d4dfa820 ffff8106553247a0 Mar 26 09:30:03 ALPL402 kernel: 0002c118c6bc06a4 0000000000007dc3 ffff8102d4dfaa08 0000000700000286 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_35 S ffff8106550e9aa0 0 18946 1 18947 18945 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff81069d4b3ea0 0000000000000046 ffff8109fe3cfe00 ffff81098f421898 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106b902b7a0 ffff81065527e820 Mar 26 09:30:03 ALPL402 kernel: 0002c11a55080719 0000000000007627 ffff8106b902b988 0000000500000286 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_36 S ffff81000100caa0 0 18947 1 18948 18946 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff81069d4b5ea0 0000000000000046 ffff81042dbef800 ffff810197a472d8 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106b12ed100 ffff810640047820 Mar 26 09:30:03 ALPL402 kernel: 0002c123da188fcc 00000000000067be ffff8106b12ed2e8 0000000100000282 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_37 S ffff81000101d7a0 0 18948 1 18949 18947 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff81069d4b7ea0 0000000000000046 ffff8105de869800 ffff81056e5840d8 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106a16ae7a0 ffff8106551987a0 Mar 26 09:30:03 ALPL402 kernel: 0002c120118bf061 0000000000007951 ffff8106a16ae988 0000000300000282 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_38 S ffff81000100caa0 0 18949 1 18950 18948 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff81069d4b9ea0 0000000000000046 ffff81036ca89c00 ffff8102dae79c98 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106b0a4a080 ffff810640047820 Mar 26 09:30:03 ALPL402 kernel: 0002c121bd1ad39e 000000000000b2f3 ffff8106b0a4a268 0000000100000286 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_39 S ffff8106550fa7a0 0 18950 1 18951 18949 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff8102d2b99ea0 0000000000000046 ffff810487d22e00 ffff81015907d898 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8102d4dfa0c0 ffff8106553247a0 Mar 26 09:30:03 ALPL402 kernel: 0002c12071b29616 000000000000b6e8 ffff8102d4dfa2a8 0000000700000286 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_40 S ffff81000101d7a0 0 18951 1 18952 18950 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff81069cd9bea0 0000000000000046 ffff81034d373600 ffff8104e17750d8 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106b0907100 ffff8106551987a0 Mar 26 09:30:03 ALPL402 kernel: 0002c11a89b3c602 0000000000006e26 ffff8106b09072e8 0000000300000286 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_41 S ffff8106550e1420 0 18952 1 18953 18951 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff81069cd9dea0 0000000000000046 ffff8105fe3e0800 ffff81025453dad8 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff81069db43820 ffff8106552227e0 Mar 26 09:30:03 ALPL402 kernel: 0002c11ed2ab7a91 0000000000006c2c ffff81069db43a08 0000000400000286 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_42 S ffff81000100caa0 0 18953 1 18954 18952 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff81069b801ea0 0000000000000046 ffff810b3a436e00 ffff810a8ee578d8 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106b0899820 ffff810640047820 Mar 26 09:30:03 ALPL402 kernel: 0002c11ecbfd77e5 000000000000a602 ffff8106b0899a08 0000000100000282 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_43 S ffff8106550e9aa0 0 18954 1 18955 18953 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff81069b803ea0 0000000000000046 ffff810a055c7400 ffff810b642cb0d8 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106b08f9040 ffff81065527e820 Mar 26 09:30:03 ALPL402 kernel: 0002c12071ec44a8 0000000000006e08 ffff8106b08f9228 0000000500000282 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_44 S ffff8106550f2120 0 18955 1 18956 18954 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff81069b805ea0 0000000000000046 ffff81032566a800 ffff8105e4f54798 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106a14f0100 ffff8106552de860 Mar 26 09:30:03 ALPL402 kernel: 0002c1206b76421e 000000000000a7fb ffff8106a14f02e8 0000000600000282 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_45 S ffff8106550e1420 0 18956 1 19050 18955 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff81069b807ea0 0000000000000046 ffff8103435ad800 ffff81046e071798 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106b0907860 ffff8106552227e0 Mar 26 09:30:03 ALPL402 kernel: 0002c123dbd664c0 000000000000833e ffff8106b0907a48 0000000400000282 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_46 S ffff810001004420 0 19050 1 19051 18956 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff810675c81ea0 0000000000000046 ffff810ac7862c00 ffff8106ea881698 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106b0853100 ffffffff8031db60 Mar 26 09:30:03 ALPL402 kernel: 0002c123da4cf170 000000000000881b ffff8106b08532e8 0000000000000286 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_47 S ffff8106550fa7a0 0 19051 1 19052 19050 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff810675c83ea0 0000000000000046 ffff81049a1a5800 ffff810413d0b0d8 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106a16ae040 ffff8106553247a0 Mar 26 09:30:03 ALPL402 kernel: 0002c11a54efa4b3 0000000000006ac4 ffff8106a16ae228 0000000700000282 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_48 S ffff8106550e1420 0 19052 1 19053 19051 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff810675c85ea0 0000000000000046 ffff810803896a00 ffff8109f42ba7d8 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106b19de820 ffff8106552227e0 Mar 26 09:30:03 ALPL402 kernel: 0002c11ca7adf84a 0000000000006e56 ffff8106b19dea08 0000000400000282 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_49 S ffff8106550e9aa0 0 19053 1 19054 19052 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff810675c87ea0 0000000000000046 ffff810369520a00 ffff8101baddfd98 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106b0ef37e0 ffff81065527e820 Mar 26 09:30:03 ALPL402 kernel: 0002c1171aebfd23 0000000000008af9 ffff8106b0ef39c8 0000000500000286 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_50 S ffff8106550e9aa0 0 19054 1 19055 19053 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff810675c89ea0 0000000000000046 ffff81037af20a00 ffff8104db671d98 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106abd43100 ffff81065527e820 Mar 26 09:30:03 ALPL402 kernel: 0002c12580b609d8 000000000000c076 ffff8106abd432e8 0000000500000286 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ldlm_bl_51 S ffff8106550fa7a0 0 19055 1 19171 19054 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff810675c8bea0 0000000000000046 ffff810a76a24a00 ffff8106a3c02a98 Mar 26 09:30:03 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106b08990c0 ffff8106553247a0 Mar 26 09:30:03 ALPL402 kernel: 0002c11a547d57e1 000000000000814f ffff8106b08992a8 0000000700000286 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ll_ost_io_369 D ffff810001004420 0 19171 1 19172 19055 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff81060f79b8b0 0000000000000046 ffff8103ba104400 ffff810547ec7e00 Mar 26 09:30:03 ALPL402 kernel: 0000000000000001 000000000000000a ffff81069db430c0 ffffffff8031db60 Mar 26 09:30:03 ALPL402 kernel: 0002c0ee705cc481 000000000000b210 ffff81069db432a8 00000000ffffffff Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:03 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:03 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:03 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:03 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ll_ost_io_370 D ffff810001015120 0 19172 1 19173 19171 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff81060e8bd6d0 0000000000000046 ffff8108910f78b0 0000000000000000 Mar 26 09:30:03 ALPL402 kernel: 0000000000000000 000000000000000a ffff8105c5d56820 ffff810655184860 Mar 26 09:30:03 ALPL402 kernel: 0002c1032262edb9 000000000000379b ffff8105c5d56a08 000000021105eab8 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:03 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:03 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:03 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:03 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:03 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:03 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:03 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ll_ost_io_371 D ffff810001004420 0 19173 1 19174 19172 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff81060e8bf8b0 0000000000000046 ffff8103d62f2e00 ffff810528fd93c0 Mar 26 09:30:03 ALPL402 kernel: 0000000000000001 000000000000000a ffff810607c12080 ffffffff8031db60 Mar 26 09:30:03 ALPL402 kernel: 0002c0edc21235f3 000000000000c465 ffff810607c12268 00000000ffffffff Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:03 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:03 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:03 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:03 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ll_ost_io_372 D ffff81061fb91820 0 19174 1 19175 19173 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff81060e8ef8b0 0000000000000046 ffff8107e5828c00 ffff810ace7183c0 Mar 26 09:30:03 ALPL402 kernel: 0000000000000001 000000000000000a ffff810607c127e0 ffff81061fb91820 Mar 26 09:30:03 ALPL402 kernel: 0002c0ee04b9a43b 000000000000a6d2 ffff810607c129c8 00000007ffffffff Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:03 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:03 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:03 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:03 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ll_ost_io_373 D ffff8106550f2120 0 19175 1 19176 19174 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff81060e919770 0000000000000046 0000000000000020 0909090909090938 Mar 26 09:30:03 ALPL402 kernel: ffff81060e919810 000000000000000a ffff81060e8fc7e0 ffff8106552de860 Mar 26 09:30:03 ALPL402 kernel: 0002c0edf3c2710d 00000000000094b4 ffff81060e8fc9c8 000000060e31ff00 Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:03 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:03 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:03 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:03 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:03 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:03 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:03 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:03 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:03 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ll_ost_io_374 D ffff8106550e1420 0 19176 1 19177 19175 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff81060e91b8b0 0000000000000046 ffff810a06142800 ffff810a03ade240 Mar 26 09:30:03 ALPL402 kernel: 0000000000000001 000000000000000a ffff8105c5d560c0 ffff8106552227e0 Mar 26 09:30:03 ALPL402 kernel: 0002c0ee4088cf50 000000000000932c ffff8105c5d562a8 00000004ffffffff Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:03 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:03 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:03 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:03 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:03 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:03 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:03 ALPL402 kernel: Mar 26 09:30:03 ALPL402 kernel: ll_ost_io_375 D ffff8106550fa7a0 0 19177 1 19178 19176 (L-TLB) Mar 26 09:30:03 ALPL402 kernel: ffff81060e92d8b0 0000000000000046 ffff810a76f85e00 ffff81086bfd3e00 Mar 26 09:30:03 ALPL402 kernel: 0000000000000001 000000000000000a ffff8109d01f3100 ffff8106553247a0 Mar 26 09:30:03 ALPL402 kernel: 0002c11a55242cfb 000000000000a446 ffff8109d01f32e8 00000007ffffffff Mar 26 09:30:03 ALPL402 kernel: Call Trace: Mar 26 09:30:03 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:03 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:03 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:03 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:03 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:03 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:03 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_376 D ffff81000100caa0 0 19178 1 19179 19177 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff81060e92f8b0 0000000000000046 ffff810322049000 ffff8105483b5b00 Mar 26 09:30:04 ALPL402 kernel: 0000000000000001 000000000000000a ffff81060e8fc080 ffff810640047820 Mar 26 09:30:04 ALPL402 kernel: 0002c0ee0127a485 0000000000011162 ffff81060e8fc268 00000001ffffffff Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:04 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_377 D ffff810449f04080 0 19179 1 19180 19178 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff81060e9418b0 0000000000000046 ffff8104b09ee800 ffff8104c27cc800 Mar 26 09:30:04 ALPL402 kernel: 0000000000000001 000000000000000a ffff81060e905820 ffff810449f04080 Mar 26 09:30:04 ALPL402 kernel: 0002c0ee80d809a1 000000000000b753 ffff81060e905a08 00000001ffffffff Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:04 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_378 D ffff810001015120 0 19180 1 19181 19179 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff81060e943840 0000000000000046 ffff8102c11ad040 ffffffff88be73df Mar 26 09:30:04 ALPL402 kernel: ffff81063f72be00 000000000000000a ffff8106b902b040 ffff810655184860 Mar 26 09:30:04 ALPL402 kernel: 0002c105fb73688a 000000000015d048 ffff8106b902b228 0000000288a7f662 Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xc47/0x2e70 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_checksum_bulk+0x2bb/0x5a0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:04 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:04 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_379 D ffff810001015120 0 19181 1 19182 19180 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff81060e9556d0 0000000000000046 00000000000001df ffff810bebacad08 Mar 26 09:30:04 ALPL402 kernel: 0000000000000001 000000000000000a ffff81060e9050c0 ffff810655184860 Mar 26 09:30:04 ALPL402 kernel: 0002c0f21a09806a 0000000000003dc9 ffff81060e9052a8 000000021105e218 Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:04 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:04 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:04 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_380 D ffff8106550f2120 0 19182 1 19183 19181 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff81060e9578b0 0000000000000046 ffff810723bae000 ffff81094aa65240 Mar 26 09:30:04 ALPL402 kernel: 0000000000000001 000000000000000a ffff81060e907860 ffff8106552de860 Mar 26 09:30:04 ALPL402 kernel: 0002c0ee3cf0e9ac 000000000000c03d ffff81060e907a48 00000006ffffffff Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:04 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] dequeue_task+0x18/0x37 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_381 D ffff8106550fa7a0 0 19183 1 19184 19182 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff81060e9696d0 0000000000000046 ffff810627c40578 0000000000000000 Mar 26 09:30:04 ALPL402 kernel: ffff8105ea91ba40 0000000000000009 ffff81060e907100 ffff8106553247a0 Mar 26 09:30:04 ALPL402 kernel: 0002c0edda214829 00000000000009c5 ffff81060e9072e8 0000000700000000 Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] thread_return+0x62/0xfe Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:04 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:04 ALPL402 kernel: [] :ko2iblnd:kiblnd_init_tx_msg+0x154/0x1d0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:04 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:04 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_382 D ffff8106550e1420 0 19184 1 19185 19183 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff81060e9938b0 0000000000000046 ffff810839aa0e00 ffff810bb6544e40 Mar 26 09:30:04 ALPL402 kernel: 0000000000000001 000000000000000a ffff81060e9137a0 ffff8106552227e0 Mar 26 09:30:04 ALPL402 kernel: 0002c0edfa19d2a6 000000000000bfcd ffff81060e913988 00000004ffffffff Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:04 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_383 D ffff8106550f2120 0 19185 1 19186 19184 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff81060e99d770 0000000000000046 0000000000000020 0909090909090931 Mar 26 09:30:04 ALPL402 kernel: ffff81060e99d810 000000000000000a ffff81060e913040 ffff8106552de860 Mar 26 09:30:04 ALPL402 kernel: 0002c0ef4dc7e449 000000000000f294 ffff81060e913228 000000063b634408 Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:04 ALPL402 kernel: [] add_to_page_cache_lru+0x1c/0x23 Mar 26 09:30:04 ALPL402 kernel: [] find_or_create_page+0x4b/0x72 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:04 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:04 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:04 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:04 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_384 D ffff8109da465040 0 19186 1 19187 19185 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff81060eaa3770 0000000000000046 0000000000000020 0909090909090934 Mar 26 09:30:04 ALPL402 kernel: ffff81060eaa3810 000000000000000a ffff81060e9157e0 ffff8109da465040 Mar 26 09:30:04 ALPL402 kernel: 0002c0eed4bdb178 000000000000c3ba ffff81060e9159c8 0000000326a0b768 Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] :ldiskfs:ldiskfs_bread+0xe/0x80 Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:04 ALPL402 kernel: [] add_to_page_cache_lru+0x1c/0x23 Mar 26 09:30:04 ALPL402 kernel: [] find_or_create_page+0x4b/0x72 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:04 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:04 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:04 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:04 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_385 D ffff810248008040 0 19187 1 19188 19186 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff81060eaa78b0 0000000000000046 ffff81061349e000 ffff8103af9f4380 Mar 26 09:30:04 ALPL402 kernel: 0000000000000001 000000000000000a ffff8106b08d5040 ffff810248008040 Mar 26 09:30:04 ALPL402 kernel: 0002c0edf63853ef 000000000000b91c ffff8106b08d5228 00000003ffffffff Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:04 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_386 D ffff81000101d7a0 0 19188 1 19189 19187 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff81060ead96d0 0000000000000046 000000000000000d ffff8105865e70a8 Mar 26 09:30:04 ALPL402 kernel: 0000000000000000 000000000000000a ffff8106b08f97a0 ffff8106551987a0 Mar 26 09:30:04 ALPL402 kernel: 0002c0f8702f3c4f 0000000000004fe8 ffff8106b08f9988 000000031105aa08 Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:04 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:04 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:04 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_387 D ffff81000101d7a0 0 19189 1 19190 19188 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff81060eb016d0 0000000000000046 00000000000001b6 ffff8107d8f64c24 Mar 26 09:30:04 ALPL402 kernel: 0000000000000000 000000000000000a ffff810308f8b860 ffff8106551987a0 Mar 26 09:30:04 ALPL402 kernel: 0002c0efcb4d7b37 0000000000005dc9 ffff810308f8ba48 000000031105e218 Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:04 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:04 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:04 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_388 D ffff8106550e9aa0 0 19190 1 19191 19189 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff8106141578b0 0000000000000046 ffff810a029a8600 ffff810a6ae66e00 Mar 26 09:30:04 ALPL402 kernel: 0000000000000001 000000000000000a ffff81060e915080 ffff81065527e820 Mar 26 09:30:04 ALPL402 kernel: 0002c0edc1ea4b20 000000000000cdb6 ffff81060e915268 00000005ffffffff Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:04 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_389 D ffff8106550f2120 0 19191 1 19192 19190 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff810614171770 0000000000000046 0000000000000020 0909090909090934 Mar 26 09:30:04 ALPL402 kernel: ffff810614171810 000000000000000a ffff81060eabf820 ffff8106552de860 Mar 26 09:30:04 ALPL402 kernel: 0002c0edd26781b7 000000000000dcba ffff81060eabfa08 000000063fe72ac8 Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:04 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:04 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:04 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:04 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:04 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_390 D ffff8106550e9aa0 0 19192 1 19193 19191 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff8106142138b0 0000000000000046 ffff8108181a4400 ffff8107e18829c0 Mar 26 09:30:04 ALPL402 kernel: 0000000000000001 000000000000000a ffff81060eabf0c0 ffff81065527e820 Mar 26 09:30:04 ALPL402 kernel: 0002c0ee090ce6c6 00000000000096bb ffff81060eabf2a8 00000005ffffffff Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:04 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_391 D ffff8106550e9aa0 0 19193 1 19194 19192 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff8106143678b0 0000000000000046 ffff810a3a286a00 ffff8107cee91e40 Mar 26 09:30:04 ALPL402 kernel: 0000000000000001 000000000000000a ffff81060eac8860 ffff81065527e820 Mar 26 09:30:04 ALPL402 kernel: 0002c0ee44614f3c 000000000000c7a6 ffff81060eac8a48 00000005ffffffff Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:04 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_392 D ffff81000101d7a0 0 19194 1 19195 19193 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff81061310d8b0 0000000000000046 ffff810534ccbe00 ffff8104818ff680 Mar 26 09:30:04 ALPL402 kernel: 0000000000000001 000000000000000a ffff8109d7dee040 ffff8106551987a0 Mar 26 09:30:04 ALPL402 kernel: 0002c0ee61bed63d 000000000000af86 ffff8109d7dee228 00000003ffffffff Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:04 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_393 D ffff810001015120 0 19195 1 19196 19194 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff8106132cd6d0 0000000000000046 0000000000000081 ffff810860af6600 Mar 26 09:30:04 ALPL402 kernel: 0000000000000001 000000000000000a ffff81060eac8100 ffff810655184860 Mar 26 09:30:04 ALPL402 kernel: 0002c0efb28a3334 0000000000003f3b ffff81060eac82e8 000000021105e218 Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:04 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:04 ALPL402 kernel: [] :ko2iblnd:kiblnd_init_tx_msg+0x154/0x1d0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:04 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:04 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_394 D ffff81000101d7a0 0 19196 1 19197 19195 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff8106132cf8b0 0000000000000046 ffff8103be9eec00 ffff81041f083500 Mar 26 09:30:04 ALPL402 kernel: 0000000000000001 000000000000000a ffff81060eadb820 ffff8106551987a0 Mar 26 09:30:04 ALPL402 kernel: 0002c0ee4ff42ad2 000000000000b641 ffff81060eadba08 00000003ffffffff Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:04 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_395 D ffff8105f13c1040 0 19197 1 19198 19196 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff8106132e1890 0000000000000046 ffff8106215f9ac0 000500000a030445 Mar 26 09:30:04 ALPL402 kernel: 000500000a030337 000000000000000a ffff81060f43a7a0 ffff8105f13c1040 Mar 26 09:30:04 ALPL402 kernel: 0002c0f9baadb52b 0000000000008c08 ffff81060f43a988 000000023ba6e038 Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_parent_lock+0x36/0x220 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x2cf/0x740 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:__filter_oa2dentry+0x49/0x240 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_setattr+0xb9/0x3b0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:04 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:04 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_396 D ffff8106550fa7a0 0 19198 1 19199 19197 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff8106132ed6d0 0000000000000046 00000000000000b8 ffff8102d067e870 Mar 26 09:30:04 ALPL402 kernel: 0000000000000001 000000000000000a ffff81060f43a040 ffff8106553247a0 Mar 26 09:30:04 ALPL402 kernel: 0002c0f4e13f6752 0000000000003042 ffff81060f43a228 0000000711060608 Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:04 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:04 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:04 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_397 D ffff8106550fa7a0 0 19199 1 19200 19198 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff8106132fb770 0000000000000046 0000000000000020 0909090909090932 Mar 26 09:30:04 ALPL402 kernel: ffff8106132fb810 000000000000000a ffff81060f43b7e0 ffff8106553247a0 Mar 26 09:30:04 ALPL402 kernel: 0002c0f9c36aa3db 0000000000010111 ffff81060f43b9c8 00000007cc5f3d50 Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:04 ALPL402 kernel: [] add_to_page_cache_lru+0x1c/0x23 Mar 26 09:30:04 ALPL402 kernel: [] find_or_create_page+0x4b/0x72 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:04 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:04 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:04 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:04 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_398 D ffff8106550e9aa0 0 19200 1 19201 19199 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff81061355b6d0 0000000000000046 ffff810880f13d28 0000000000000000 Mar 26 09:30:04 ALPL402 kernel: 0000000000000000 000000000000000a ffff81069f1017e0 ffff81065527e820 Mar 26 09:30:04 ALPL402 kernel: 0002c102709b46e5 000000000002ae72 ffff81069f1019c8 000000051105f9d0 Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:04 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:04 ALPL402 kernel: [] :ko2iblnd:kiblnd_init_tx_msg+0x154/0x1d0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:04 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:04 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_399 D ffff8106550e1420 0 19201 1 19202 19200 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff8106135656d0 0000000000000046 ffff81038ac7c3b8 0000000000000000 Mar 26 09:30:04 ALPL402 kernel: 0000000000000000 000000000000000a ffff8106d119d7a0 ffff8106552227e0 Mar 26 09:30:04 ALPL402 kernel: 0002c0f92309f29a 00000000000036ef ffff8106d119d988 0000000411060608 Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:04 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:04 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:04 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:04 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:04 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:04 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:04 ALPL402 kernel: Mar 26 09:30:04 ALPL402 kernel: ll_ost_io_400 D ffff810001015120 0 19202 1 19203 19201 (L-TLB) Mar 26 09:30:04 ALPL402 kernel: ffff8106135678b0 0000000000000046 ffff8104129bc200 ffff8103f5e519c0 Mar 26 09:30:04 ALPL402 kernel: 0000000000000001 000000000000000a ffff810613415820 ffff810655184860 Mar 26 09:30:04 ALPL402 kernel: 0002c0ee57f47d5a 000000000000b689 ffff810613415a08 00000002ffffffff Mar 26 09:30:04 ALPL402 kernel: Call Trace: Mar 26 09:30:04 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:04 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:04 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:04 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:04 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:04 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:04 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:04 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_401 D ffff810001004420 0 19203 1 19204 19202 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff8106135738b0 0000000000000046 ffff8105571dc800 ffff810615157800 Mar 26 09:30:05 ALPL402 kernel: 0000000000000001 000000000000000a ffff8106134150c0 ffffffff8031db60 Mar 26 09:30:05 ALPL402 kernel: 0002c0ed8c546f24 000000000000c81e ffff8106134152a8 00000000ffffffff Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:05 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_402 D ffff81000100caa0 0 19204 1 19205 19203 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff8106135a5840 0000000000000046 0000000000000286 ffffffff88be73ba Mar 26 09:30:05 ALPL402 kernel: ffff81063f72be00 000000000000000a ffff810613585860 ffff810640047820 Mar 26 09:30:05 ALPL402 kernel: 0002c0eef4299930 000000000014c1a1 ffff810613585a48 0000000188a7f662 Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xc47/0x2e70 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_checksum_bulk+0x336/0x5a0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:05 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:05 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_403 D ffff81000101d7a0 0 19205 1 19206 19204 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff81061370b840 0000000000000046 0000000000000286 ffffffff88be73ba Mar 26 09:30:05 ALPL402 kernel: ffff81063f72be00 000000000000000a ffff810613585100 ffff8106551987a0 Mar 26 09:30:05 ALPL402 kernel: 0002c0eee9c31dd6 000000000014b2e6 ffff8106135852e8 0000000388a7f662 Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xc47/0x2e70 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_checksum_bulk+0x36e/0x5a0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:05 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:05 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_404 D ffff81061fa47860 0 19206 1 19207 19205 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff810611833770 0000000000000046 0000000000000020 0909090909090930 Mar 26 09:30:05 ALPL402 kernel: ffff810611833810 000000000000000a ffff8106118157a0 ffff81061fa47860 Mar 26 09:30:05 ALPL402 kernel: 0002c0ef7156a77a 000000000000f2fd ffff810611815988 000000073be56d50 Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] :ldiskfs:ldiskfs_bread+0xe/0x80 Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:05 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:05 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:05 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:05 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:05 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_405 D ffff8106550e1420 0 19207 1 19208 19206 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff81061183d8b0 0000000000000046 ffff810a741fac00 ffff8109343143c0 Mar 26 09:30:05 ALPL402 kernel: 0000000000000001 000000000000000a ffff810611815040 ffff8106552227e0 Mar 26 09:30:05 ALPL402 kernel: 0002c0ee0b94be7f 000000000000bbe7 ffff810611815228 00000004ffffffff Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:05 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_406 D ffff8106550fa7a0 0 19208 1 19209 19207 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff81061183f8b0 0000000000000046 ffff810a6d77c600 ffff810a0af57540 Mar 26 09:30:05 ALPL402 kernel: 0000000000000001 000000000000000a ffff810613546860 ffff8106553247a0 Mar 26 09:30:05 ALPL402 kernel: 0002c0ee2fc51dba 000000000000a318 ffff810613546a48 00000007ffffffff Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:05 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_resource_iterate+0x1ad/0x240 Mar 26 09:30:05 ALPL402 kernel: [] dequeue_task+0x18/0x37 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_407 D ffff8106550fa7a0 0 19209 1 19210 19208 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff81061184b8b0 0000000000000046 ffff81070cee6800 ffff8108d1777e00 Mar 26 09:30:05 ALPL402 kernel: 0000000000000001 000000000000000a ffff810613546100 ffff8106553247a0 Mar 26 09:30:05 ALPL402 kernel: 0002c0ee41495c63 000000000000c7d0 ffff8106135462e8 00000007ffffffff Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:05 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_408 D ffff81000101d7a0 0 19210 1 19211 19209 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff81061195f8b0 0000000000000046 ffff81036aaac000 ffff81032a495b00 Mar 26 09:30:05 ALPL402 kernel: 0000000000000001 000000000000000a ffff8106118237e0 ffff8106551987a0 Mar 26 09:30:05 ALPL402 kernel: 0002c0f60746b7ee 00000000000123b6 ffff8106118239c8 00000003ffffffff Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:05 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_409 D ffff81000100caa0 0 19211 1 19212 19210 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff8106158db8b0 0000000000000046 ffff8103e7670000 ffff8104fffaae40 Mar 26 09:30:05 ALPL402 kernel: 0000000000000001 000000000000000a ffff8106b0853860 ffff810640047820 Mar 26 09:30:05 ALPL402 kernel: 0002c0ee3b58c8f8 000000000000c843 ffff8106b0853a48 00000001ffffffff Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:05 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_410 D ffff81000101d7a0 0 19212 1 19213 19211 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff81061546f6d0 0000000000000046 ffff8104c2c3fe68 0000000000000000 Mar 26 09:30:05 ALPL402 kernel: 0000000000000000 000000000000000a ffff81060eadb0c0 ffff8106551987a0 Mar 26 09:30:05 ALPL402 kernel: 0002c0fd2c0047bb 0000000000003392 ffff81060eadb2a8 000000031105aa08 Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] cache_alloc_refill+0x108/0x188 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:05 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:05 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:05 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_411 D ffff810001004420 0 19213 1 19214 19212 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff8106154738b0 0000000000000046 ffff81047d818e00 ffff8105160c1b40 Mar 26 09:30:05 ALPL402 kernel: 0000000000000001 0000000000000009 ffff810611823080 ffffffff8031db60 Mar 26 09:30:05 ALPL402 kernel: 0002c0ee61aa9cc6 000000000000ab91 ffff810611823268 00000000ffffffff Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:05 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_412 D ffff8106550f2120 0 19214 1 19215 19213 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff810615f436d0 0000000000000046 0000000000000005 ffff8106c09b703c Mar 26 09:30:05 ALPL402 kernel: 0000000000000001 000000000000000a ffff81069e513100 ffff8106552de860 Mar 26 09:30:05 ALPL402 kernel: 0002c0f85b53f30e 0000000000003541 ffff81069e5132e8 000000061105aa08 Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:05 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:05 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:05 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_413 D ffff8106550fa7a0 0 19215 1 19216 19214 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff810615f4d6d0 0000000000000046 ffff81059c3c6830 0000000000000000 Mar 26 09:30:05 ALPL402 kernel: 0000000000000000 000000000000000a ffff810615db1820 ffff8106553247a0 Mar 26 09:30:05 ALPL402 kernel: 0002c0f99a04c4d6 0000000000003ca5 ffff810615db1a08 000000071105e218 Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:05 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_checksum_bulk+0x2f5/0x5a0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:05 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:05 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_414 D ffff8106550e9aa0 0 19216 1 19217 19215 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff810615fd78b0 0000000000000046 ffff810a06142600 ffff810c15722540 Mar 26 09:30:05 ALPL402 kernel: 0000000000000001 000000000000000a ffff8106b19de0c0 ffff81065527e820 Mar 26 09:30:05 ALPL402 kernel: 0002c0ee4312512d 000000000000c287 ffff8106b19de2a8 00000005ffffffff Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:05 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_415 D ffff8106550fa7a0 0 19217 1 19218 19216 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff81061701f8b0 0000000000000046 ffff8108c5120600 ffff810b5b10b6c0 Mar 26 09:30:05 ALPL402 kernel: 0000000000000001 000000000000000a ffff8109d6eaa860 ffff8106553247a0 Mar 26 09:30:05 ALPL402 kernel: 0002c0edf89e51a8 000000000000bcf1 ffff8109d6eaaa48 00000007ffffffff Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:05 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] dequeue_task+0x18/0x37 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_416 D ffff81000100caa0 0 19218 1 19219 19217 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff8106170358b0 0000000000000046 ffff8104c1bc7000 ffff810543991980 Mar 26 09:30:05 ALPL402 kernel: 0000000000000001 000000000000000a ffff8106bcde5080 ffff810640047820 Mar 26 09:30:05 ALPL402 kernel: 0002c0ed5768f367 0000000000010265 ffff8106bcde5268 00000001ffffffff Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:05 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] dequeue_task+0x18/0x37 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_417 D ffff8105c5d56820 0 19219 1 19220 19218 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff8106170378b0 0000000000000046 ffff8104b1d3d600 ffff81061a4346c0 Mar 26 09:30:05 ALPL402 kernel: 0000000000000001 000000000000000a ffff8106b0a4a7e0 ffff8105c5d56820 Mar 26 09:30:05 ALPL402 kernel: 0002c0edfa8b2d83 000000000000d85a ffff8106b0a4a9c8 00000000ffffffff Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:05 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_418 D ffff810001015120 0 19220 1 19221 19219 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff81061704d800 0000000000000046 ffff81028288ad60 ffff810543819b40 Mar 26 09:30:05 ALPL402 kernel: ffff810543819b40 000000000000000a ffff810615db10c0 ffff810655184860 Mar 26 09:30:05 ALPL402 kernel: 0002c0ed578ab473 00000000000020c3 ffff810615db12a8 00000002ffffffff Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_log_wait_commit+0xa3/0xf5 Mar 26 09:30:05 ALPL402 kernel: [] autoremove_wake_function+0x0/0x2e Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_commit_wait+0xab/0xd0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0x1eb4/0x2e70 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:05 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:05 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_419 D ffff81061f05d080 0 19221 1 19222 19220 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff810617059770 0000000000000046 0000000000000020 0909090909090933 Mar 26 09:30:05 ALPL402 kernel: ffff810617059810 000000000000000a ffff81060f43b080 ffff81061f05d080 Mar 26 09:30:05 ALPL402 kernel: 0002c0f0dcd1879b 00000000000152ca ffff81060f43b268 00000002b7a4ce28 Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] :ldiskfs:ldiskfs_bread+0xe/0x80 Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:05 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_fmd_expire_nolock+0x1d3/0x1f0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:05 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:05 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:05 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_resource_foreach+0x11a/0x390 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_420 D ffff81060241c860 0 19222 1 19223 19221 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff810617201840 0000000000000046 ffff8103328e5678 ffffffff88be73df Mar 26 09:30:05 ALPL402 kernel: ffff81063f72be00 000000000000000a ffff810c37e48820 ffff81060241c860 Mar 26 09:30:05 ALPL402 kernel: 0002c0ee720d49ef 00000000001599fa ffff810c37e48a08 0000000788a7f662 Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:05 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_block+0xc0/0x120 Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xc47/0x2e70 Mar 26 09:30:05 ALPL402 kernel: [] :ko2iblnd:kiblnd_init_tx_msg+0x154/0x1d0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_checksum_bulk+0x387/0x5a0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:05 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:05 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_421 D ffff8106550e9aa0 0 19223 1 19224 19222 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff8106173038b0 0000000000000046 ffff8106fd096800 ffff810ae9ef0c80 Mar 26 09:30:05 ALPL402 kernel: 0000000000000001 000000000000000a ffff810615916860 ffff81065527e820 Mar 26 09:30:05 ALPL402 kernel: 0002c0ed8ab32f9e 00000000000114bc ffff810615916a48 00000005ffffffff Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:05 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_422 D ffff8105ec9c7080 0 19224 1 19225 19223 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff81061730d8b0 0000000000000046 ffff810b71747800 ffff810b58176840 Mar 26 09:30:05 ALPL402 kernel: 0000000000000001 000000000000000a ffff810611b707a0 ffff8105ec9c7080 Mar 26 09:30:05 ALPL402 kernel: 0002c0ed577f0b4f 000000000000feb8 ffff810611b70988 00000006ffffffff Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:05 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_423 D ffff8106550fa7a0 0 19225 1 19227 19224 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff81061730f6d0 0000000000000046 ffff810991d29c28 0000000000000000 Mar 26 09:30:05 ALPL402 kernel: 0000000000000000 000000000000000a ffff810611b70040 ffff8106553247a0 Mar 26 09:30:05 ALPL402 kernel: 0002c0f9f0badbcf 0000000000025a5c ffff810611b70228 000000071105aa08 Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:05 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_checksum_bulk+0x341/0x5a0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:05 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:05 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_425 D ffff810001015120 0 19226 1 19228 19227 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff81061785d6d0 0000000000000046 0000000000001300 ffff81050506a00c Mar 26 09:30:05 ALPL402 kernel: 0000000000000000 000000000000000a ffff810615916100 ffff810655184860 Mar 26 09:30:05 ALPL402 kernel: 0002c0eee62a0504 000000000014eb23 ffff8106159162e8 00000002110609a0 Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:05 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_checksum_bulk+0x2a6/0x5a0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:05 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:05 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:05 ALPL402 kernel: Mar 26 09:30:05 ALPL402 kernel: ll_ost_io_424 D ffff810001004420 0 19227 1 19226 19225 (L-TLB) Mar 26 09:30:05 ALPL402 kernel: ffff81061785f8b0 0000000000000046 ffff81033acbb400 ffff81058aa62080 Mar 26 09:30:05 ALPL402 kernel: 0000000000000001 000000000000000a ffff810611b727e0 ffffffff8031db60 Mar 26 09:30:05 ALPL402 kernel: 0002c0ee3d19b0eb 000000000000a845 ffff810611b729c8 00000000ffffffff Mar 26 09:30:05 ALPL402 kernel: Call Trace: Mar 26 09:30:05 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:05 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:05 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:05 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:05 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:05 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:05 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:05 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:05 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:05 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_426 D ffff810001004420 0 19228 1 19229 19226 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff810617a47840 0000000000000046 0000000000000286 ffffffff88be73ba Mar 26 09:30:06 ALPL402 kernel: ffff81063f72be00 000000000000000a ffff810611b72080 ffffffff8031db60 Mar 26 09:30:06 ALPL402 kernel: 0002c0eef7d514f2 000000000014cd33 ffff810611b72268 0000000088a7f662 Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xc47/0x2e70 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_checksum_bulk+0x302/0x5a0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:06 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:06 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_427 D ffff81046d73f080 0 19229 1 19230 19228 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff810617a51770 0000000000000046 0000000000000020 0909090909090932 Mar 26 09:30:06 ALPL402 kernel: ffff810617a51810 000000000000000a ffff810611b74820 ffff81046d73f080 Mar 26 09:30:06 ALPL402 kernel: 0002c0f19b15d54e 000000000000f6eb ffff810611b74a08 00000003fc7534e0 Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] :ldiskfs:ldiskfs_bread+0xe/0x80 Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:06 ALPL402 kernel: [] add_to_page_cache_lru+0x1c/0x23 Mar 26 09:30:06 ALPL402 kernel: [] find_or_create_page+0x4b/0x72 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:06 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:06 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:06 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:06 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_428 D ffff8106550e1420 0 19230 1 19231 19229 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff8106160938b0 0000000000000046 ffff810a88ef0000 ffff810aafbc6c80 Mar 26 09:30:06 ALPL402 kernel: 0000000000000001 000000000000000a ffff8106160887a0 ffff8106552227e0 Mar 26 09:30:06 ALPL402 kernel: 0002c0eec27768d9 000000000000b5dd ffff810616088988 00000004ffffffff Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:06 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:06 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_429 D ffff8106550f2120 0 19231 1 19232 19230 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff8106161d7770 0000000000000046 0000000000000020 0909090909090933 Mar 26 09:30:06 ALPL402 kernel: ffff8106161d7810 000000000000000a ffff810611b740c0 ffff8106552de860 Mar 26 09:30:06 ALPL402 kernel: 0002c0edd00cf030 000000000000fd1a ffff810611b742a8 000000063feb70a8 Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:06 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:06 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:06 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:06 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:06 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_430 D ffff810b84d4f7a0 0 19232 1 19233 19231 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff810617695770 0000000000000046 0000000000000020 0909090909090935 Mar 26 09:30:06 ALPL402 kernel: ffff810617695810 000000000000000a ffff8109dd2967e0 ffff810b84d4f7a0 Mar 26 09:30:06 ALPL402 kernel: 0002c0ef4a02464b 000000000000e3a6 ffff8109dd2969c8 00000007c8d53690 Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] :ldiskfs:ldiskfs_bread+0xe/0x80 Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:06 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:06 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:06 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:06 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:06 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_431 D ffff8106550e1420 0 19233 1 19234 19232 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff81026fe836d0 0000000000000046 ffff81050e3fa8f0 0000000000000000 Mar 26 09:30:06 ALPL402 kernel: 0000000000000000 000000000000000a ffff81054aaaf100 ffff8106552227e0 Mar 26 09:30:06 ALPL402 kernel: 0002c0fc837e3337 00000000000268fe ffff81054aaaf2e8 000000041105aa08 Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:06 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_checksum_bulk+0x352/0x5a0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:06 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:06 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_432 D ffff810001004420 0 19234 1 19235 19233 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff81026fe8d6d0 0000000000000046 0000000000000100 ffff810a2d6da03c Mar 26 09:30:06 ALPL402 kernel: 0000000000000001 000000000000000a ffff8107480ca7e0 ffffffff8031db60 Mar 26 09:30:06 ALPL402 kernel: 0002c0ed9d678c36 00000000000fa71c ffff8107480ca9c8 00000000110609a0 Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:06 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_checksum_bulk+0x324/0x5a0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:06 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:06 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_433 D ffff810001015120 0 19235 1 19236 19234 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff81026f8596d0 0000000000000046 ffff8105194cbe28 0000000000000000 Mar 26 09:30:06 ALPL402 kernel: 0000000000000000 000000000000000a ffff810616088040 ffff810655184860 Mar 26 09:30:06 ALPL402 kernel: 0002c10a1d6a3f65 0000000000002921 ffff810616088228 000000021105b640 Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:06 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:06 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:06 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_434 D ffff810001004420 0 19236 1 19237 19235 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff81026f97b6d0 0000000000000046 0000000000000200 ffff8104e4c1d030 Mar 26 09:30:06 ALPL402 kernel: 0000000000000001 000000000000000a ffff8105e8488040 ffffffff8031db60 Mar 26 09:30:06 ALPL402 kernel: 0002c109465bbb6a 000000000001acc5 ffff8105e8488228 000000001105ca60 Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:06 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:06 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:06 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_435 D ffff810001015120 0 19237 1 19238 19236 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff81026fa7d8b0 0000000000000046 ffff8105c50bf000 ffff8103f34c03c0 Mar 26 09:30:06 ALPL402 kernel: 0000000000000001 000000000000000a ffff81026f9677e0 ffff810655184860 Mar 26 09:30:06 ALPL402 kernel: 0002c0ef0b08d026 000000000000c8f2 ffff81026f9679c8 00000002ffffffff Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:06 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:06 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_436 D ffff8109d0976080 0 19238 1 19239 19237 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff81026f6d9770 0000000000000046 0000000000000020 0909090909090939 Mar 26 09:30:06 ALPL402 kernel: ffff81026f6d9810 000000000000000a ffff81063fd70100 ffff8109d0976080 Mar 26 09:30:06 ALPL402 kernel: 0002c0f9a62ea288 000000000000f8ee ffff81063fd702e8 0000000630ab1918 Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] :ldiskfs:ldiskfs_bread+0xe/0x80 Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:06 ALPL402 kernel: [] add_to_page_cache_lru+0x1c/0x23 Mar 26 09:30:06 ALPL402 kernel: [] find_or_create_page+0x4b/0x72 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:06 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:06 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:06 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:06 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_437 D ffff8106550f2120 0 19239 1 19240 19238 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff81026ae5b6d0 0000000000000046 ffff810bc659de28 0000000000000000 Mar 26 09:30:06 ALPL402 kernel: 0000000000000000 000000000000000a ffff8104db68a820 ffff8106552de860 Mar 26 09:30:06 ALPL402 kernel: 0002c1021586c9b7 000000000000303a ffff8104db68aa08 000000061105eab8 Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:06 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:06 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:06 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_438 D ffff8105f13d6820 0 19240 1 19241 19239 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff810268cf38b0 0000000000000046 ffff8106fc4d1800 ffff8106bce41500 Mar 26 09:30:06 ALPL402 kernel: 0000000000000001 000000000000000a ffff810268cd3860 ffff8105f13d6820 Mar 26 09:30:06 ALPL402 kernel: 0002c0ed580e5df7 0000000000011bb2 ffff810268cd3a48 00000005ffffffff Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:06 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:06 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] move_tasks+0x22c/0x2ec Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_439 D ffff8106550f2120 0 19241 1 19242 19240 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff810267e5b8b0 0000000000000046 ffff810a6982fa00 ffff810683e44840 Mar 26 09:30:06 ALPL402 kernel: 0000000000000001 000000000000000a ffff810268cd3100 ffff8106552de860 Mar 26 09:30:06 ALPL402 kernel: 0002c0ee3c7ab838 000000000000acf7 ffff810268cd32e8 00000006ffffffff Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:06 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:06 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_440 D ffff810001015120 0 19242 1 19243 19241 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff810267e858b0 0000000000000046 ffff8103937bee00 ffff8105036a0840 Mar 26 09:30:06 ALPL402 kernel: 0000000000000001 000000000000000a ffff8102686a47a0 ffff810655184860 Mar 26 09:30:06 ALPL402 kernel: 0002c0ef0178f839 000000000000eddc ffff8102686a4988 00000002ffffffff Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:06 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:06 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_441 D ffff81000101d7a0 0 19243 1 19247 19242 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff810267e87770 0000000000000046 0000000000000020 0909090909090938 Mar 26 09:30:06 ALPL402 kernel: ffff810267e87810 000000000000000a ffff810267d0c7e0 ffff8106551987a0 Mar 26 09:30:06 ALPL402 kernel: 0002c0ef6fffe7a4 000000000000f50f ffff810267d0c9c8 000000031a95e4e0 Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:06 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:06 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:06 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:06 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:06 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_442 D ffff810001004420 0 19247 1 19248 19243 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff810265a1d8b0 0000000000000046 ffff810482526600 ffff8105eb8dc3c0 Mar 26 09:30:06 ALPL402 kernel: 0000000000000001 000000000000000a ffff810c37e480c0 ffffffff8031db60 Mar 26 09:30:06 ALPL402 kernel: 0002c0eda561e816 000000000000dbd2 ffff810c37e482a8 00000000ffffffff Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:06 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:06 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_443 D ffff810001004420 0 19248 1 19436 19247 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff810265a1f770 0000000000000046 0000000000000020 0909090909090938 Mar 26 09:30:06 ALPL402 kernel: ffff810265a1f810 000000000000000a ffff81026598b820 ffffffff8031db60 Mar 26 09:30:06 ALPL402 kernel: 0002c0ee6fca6d1a 000000000000e5d6 ffff81026598ba08 00000000225b25b8 Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:06 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:06 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:06 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:06 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:06 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_444 D ffff8106550e9aa0 0 19436 1 19437 19248 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff81026398f8b0 0000000000000046 ffff810b39c68400 ffff81072bafd540 Mar 26 09:30:06 ALPL402 kernel: 0000000000000001 000000000000000a ffff810263fae7e0 ffff81065527e820 Mar 26 09:30:06 ALPL402 kernel: 0002c0ee04258e22 000000000000add2 ffff810263fae9c8 00000005ffffffff Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:06 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:06 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_445 D ffff8106550f2120 0 19437 1 19438 19436 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff8102619e1770 0000000000000046 0000000000000020 0909090909090931 Mar 26 09:30:06 ALPL402 kernel: ffff8102619e1810 000000000000000a ffff810265bb80c0 ffff8106552de860 Mar 26 09:30:06 ALPL402 kernel: 0002c0f9c9a2e088 000000000000d9e9 ffff810265bb82a8 000000065b98ec78 Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:06 ALPL402 kernel: [] add_to_page_cache_lru+0x1c/0x23 Mar 26 09:30:06 ALPL402 kernel: [] find_or_create_page+0x4b/0x72 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:06 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:06 ALPL402 kernel: [] :lnet:lnet_prep_send+0x67/0xb0 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:06 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:06 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:06 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_resource_foreach+0x11a/0x390 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_446 D ffff8106550e9aa0 0 19438 1 19439 19437 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff8102609ff8b0 0000000000000046 ffff810b14625c00 ffff810bebd2d240 Mar 26 09:30:06 ALPL402 kernel: 0000000000000001 000000000000000a ffff810265ace860 ffff81065527e820 Mar 26 09:30:06 ALPL402 kernel: 0002c0ee45373084 000000000000c077 ffff810265acea48 00000005ffffffff Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:06 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:06 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_447 D ffff8106550e1420 0 19439 1 19441 19438 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff810260a096d0 0000000000000046 ffff8101f1e885b8 0000000000000000 Mar 26 09:30:06 ALPL402 kernel: 0000000000000000 000000000000000a ffff8102649807e0 ffff8106552227e0 Mar 26 09:30:06 ALPL402 kernel: 0002c0f3c3ed74dd 00000000000033d0 ffff8102649809c8 000000041105b640 Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:06 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:06 ALPL402 kernel: [] :ko2iblnd:kiblnd_init_tx_msg+0x154/0x1d0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:06 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:06 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_448 D ffff810001004420 0 19441 1 19442 19439 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff81025fe718b0 0000000000000046 ffff81034f870800 ffff8103f85c8b40 Mar 26 09:30:06 ALPL402 kernel: 0000000000000001 000000000000000a ffff81026598b0c0 ffffffff8031db60 Mar 26 09:30:06 ALPL402 kernel: 0002c0ee0a016e65 000000000000bb0a ffff81026598b2a8 00000000ffffffff Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:06 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:06 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_449 D ffff810001015120 0 19442 1 19445 19441 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff81025fe738b0 0000000000000046 ffff810158e85200 ffff8106049cb0c0 Mar 26 09:30:06 ALPL402 kernel: 0000000000000001 000000000000000a ffff810263f8d820 ffff810655184860 Mar 26 09:30:06 ALPL402 kernel: 0002c0ee4fdcef26 000000000000d947 ffff810263f8da08 00000002ffffffff Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:06 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:06 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_450 D ffff81000100caa0 0 19445 1 19446 19442 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff81026cb256d0 0000000000000046 0000000000000001 ffff81024d9d02d8 Mar 26 09:30:06 ALPL402 kernel: 0000000000000000 000000000000000a ffff810b805d7040 ffff810640047820 Mar 26 09:30:06 ALPL402 kernel: 0002c0ed6e1fd7d1 0000000000004e3a ffff810b805d7228 0000000111060608 Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:06 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:06 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:06 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:06 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:06 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:06 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:06 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:06 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:06 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:06 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:06 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:06 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:06 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:06 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:06 ALPL402 kernel: Mar 26 09:30:06 ALPL402 kernel: ll_ost_io_451 D ffff81000101d7a0 0 19446 1 19447 19445 (L-TLB) Mar 26 09:30:06 ALPL402 kernel: ffff81025ecf38b0 0000000000000046 ffff8105b81c6c00 ffff8103ee829080 Mar 26 09:30:06 ALPL402 kernel: 0000000000000001 000000000000000a ffff8105f010e820 ffff8106551987a0 Mar 26 09:30:06 ALPL402 kernel: 0002c0ed7fc2d436 000000000000d47d ffff8105f010ea08 00000003ffffffff Mar 26 09:30:06 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:07 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_452 D ffff8106550f2120 0 19447 1 19448 19446 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff81025ea8f8b0 0000000000000046 ffff810b3ce7e000 ffff810afbc66840 Mar 26 09:30:07 ALPL402 kernel: 0000000000000001 000000000000000a ffff810265bb8820 ffff8106552de860 Mar 26 09:30:07 ALPL402 kernel: 0002c0ee066f01b7 000000000000c605 ffff810265bb8a08 00000006ffffffff Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:07 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_453 D ffff810c3961d040 0 19448 1 19449 19447 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff81025e4538b0 0000000000000046 ffff810960eb3000 ffff810a19771c80 Mar 26 09:30:07 ALPL402 kernel: 0000000000000001 000000000000000a ffff810263f8d0c0 ffff810c3961d040 Mar 26 09:30:07 ALPL402 kernel: 0002c0edfda251d6 000000000000c607 ffff810263f8d2a8 00000004ffffffff Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:07 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_454 D ffff8106550e9aa0 0 19449 1 19452 19448 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff81025e45d8b0 0000000000000046 ffff8109433b8200 ffff810c364083c0 Mar 26 09:30:07 ALPL402 kernel: 0000000000000001 000000000000000a ffff810265aed7a0 ffff81065527e820 Mar 26 09:30:07 ALPL402 kernel: 0002c1086af96580 000000000000e9e2 ffff810265aed988 00000005ffffffff Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:07 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_455 D ffff8105ec2b4820 0 19452 1 19453 19449 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff81025e071770 0000000000000046 0000000000000020 0909090909090936 Mar 26 09:30:07 ALPL402 kernel: ffff81025e071810 000000000000000a ffff810265aed040 ffff8105ec2b4820 Mar 26 09:30:07 ALPL402 kernel: 0002c0f50d303f4c 000000000000f9ea ffff810265aed228 00000004b0ae80a8 Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] :ldiskfs:ldiskfs_bread+0xe/0x80 Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:07 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:07 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:07 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:07 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:07 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_456 D ffff810001015120 0 19453 1 19454 19452 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff81025e0738b0 0000000000000046 ffff81035cec2000 ffff81038d39e800 Mar 26 09:30:07 ALPL402 kernel: 0000000000000001 000000000000000a ffff81026547c7e0 ffff810655184860 Mar 26 09:30:07 ALPL402 kernel: 0002c0ee09a1e504 000000000000bb4c ffff81026547c9c8 00000002ffffffff Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:07 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_457 D ffff810001004420 0 19454 1 19455 19453 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff81025e08d8b0 0000000000000046 ffff8104d5a9d400 ffff81049475db00 Mar 26 09:30:07 ALPL402 kernel: 0000000000000001 000000000000000a ffff81026387d7e0 ffffffff8031db60 Mar 26 09:30:07 ALPL402 kernel: 0002c0edfb8778c7 000000000000ad7d ffff81026387d9c8 00000000ffffffff Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:07 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_458 D ffff8105e80ea040 0 19455 1 19474 19454 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff81025e08f770 0000000000000046 0000000000000020 0909090909090933 Mar 26 09:30:07 ALPL402 kernel: ffff81025e08f810 000000000000000a ffff81026547c080 ffff8105e80ea040 Mar 26 09:30:07 ALPL402 kernel: 0002c0f2b9ddc3ae 000000000000ddc1 ffff81026547c268 0000000321e3a180 Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] :ldiskfs:ldiskfs_bread+0xe/0x80 Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:07 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:07 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x1bc/0x320 Mar 26 09:30:07 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:07 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:07 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_459 D ffff810a8b0850c0 0 19474 1 19475 19455 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff81025c5a78b0 0000000000000046 ffff8103eab8e800 ffff8103d4ce9b40 Mar 26 09:30:07 ALPL402 kernel: 0000000000000001 000000000000000a ffff810264af8860 ffff810a8b0850c0 Mar 26 09:30:07 ALPL402 kernel: 0002c113989edea6 0000000000009230 ffff810264af8a48 00000003ffffffff Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:07 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_460 D ffff8106550e9aa0 0 19475 1 19476 19474 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff81025c5b18b0 0000000000000046 ffff810a86f10c00 ffff8107de119b00 Mar 26 09:30:07 ALPL402 kernel: 0000000000000001 000000000000000a ffff8102649d07e0 ffff81065527e820 Mar 26 09:30:07 ALPL402 kernel: 0002c0ee3d1ca2bd 000000000000b8b8 ffff8102649d09c8 00000005ffffffff Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:07 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:07 ALPL402 kernel: [] dequeue_task+0x18/0x37 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_461 D ffff8106550f2120 0 19476 1 19477 19475 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff8102629d58b0 0000000000000046 ffff810b39c68c00 ffff81081c65bb00 Mar 26 09:30:07 ALPL402 kernel: 0000000000000001 000000000000000a ffff810308f8b100 ffff8106552de860 Mar 26 09:30:07 ALPL402 kernel: 0002c0ee070a11c6 000000000000b221 ffff810308f8b2e8 00000006ffffffff Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:07 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_462 D ffff8106550fa7a0 0 19477 1 19478 19476 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff81027091d8b0 0000000000000046 ffff810afe93b600 ffff810b6230c6c0 Mar 26 09:30:07 ALPL402 kernel: 0000000000000001 000000000000000a ffff8106b08d57a0 ffff8106553247a0 Mar 26 09:30:07 ALPL402 kernel: 0002c0f8d519a4cb 000000000000bf8c ffff8106b08d5988 00000007ffffffff Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:07 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_463 D ffff8106550fa7a0 0 19478 1 19479 19477 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff81025c11d6d0 0000000000000046 ffff810c114727f0 0000000000000000 Mar 26 09:30:07 ALPL402 kernel: 0000000000000000 000000000000000a ffff810264a007a0 ffff8106553247a0 Mar 26 09:30:07 ALPL402 kernel: 0002c11bb32e7739 0000000000002e2d ffff810264a00988 000000071105b640 Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:07 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:07 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:07 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_464 D ffff810001015120 0 19479 1 19480 19478 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff81025c1e56d0 0000000000000046 ffff8107ddeb99b0 0000000000000000 Mar 26 09:30:07 ALPL402 kernel: 0000000000000000 000000000000000a ffff810264a00040 ffff810655184860 Mar 26 09:30:07 ALPL402 kernel: 0002c0edf6861f7c 0000000000024ee7 ffff810264a00228 000000021105ba90 Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:07 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:07 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:07 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_465 D ffff810001004420 0 19480 1 19481 19479 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff81025c24f8b0 0000000000000046 ffff8103132e0800 ffff8105819b4680 Mar 26 09:30:07 ALPL402 kernel: 0000000000000001 000000000000000a ffff810c38afc040 ffffffff8031db60 Mar 26 09:30:07 ALPL402 kernel: 0002c0ee4184f78b 000000000000d687 ffff810c38afc228 00000000ffffffff Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:07 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_466 D ffff810001015120 0 19481 1 19482 19480 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff81025c3756d0 0000000000000046 0000000000000132 ffff810564f4e870 Mar 26 09:30:07 ALPL402 kernel: 0000000000000001 000000000000000a ffff8102646147e0 ffff810655184860 Mar 26 09:30:07 ALPL402 kernel: 0002c0f21474a3de 00000000000039f5 ffff8102646149c8 000000021105aa08 Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:07 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:07 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:07 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_467 D ffff81000101d7a0 0 19482 1 19483 19481 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff81025b7878b0 0000000000000046 ffff810594435e00 ffff8102dab0c840 Mar 26 09:30:07 ALPL402 kernel: 0000000000000001 000000000000000a ffff8105e93d80c0 ffff8106551987a0 Mar 26 09:30:07 ALPL402 kernel: 0002c0ee1dec7fd3 000000000000a8a5 ffff8105e93d82a8 00000003ffffffff Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:07 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_468 D ffff81061fa47860 0 19483 1 19484 19482 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff81025acd3840 0000000000000046 ffff8103328e5678 ffffffff88be73df Mar 26 09:30:07 ALPL402 kernel: ffff81063f72be00 000000000000000a ffff810a8b085820 ffff81061fa47860 Mar 26 09:30:07 ALPL402 kernel: 0002c0edaab8406c 000000000015ba5e ffff810a8b085a08 0000000788a7f662 Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:07 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_block+0xc0/0x120 Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xc47/0x2e70 Mar 26 09:30:07 ALPL402 kernel: [] :ko2iblnd:kiblnd_init_tx_msg+0x154/0x1d0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_checksum_bulk+0x302/0x5a0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:07 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:07 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_469 D ffff810c35c157e0 0 19484 1 19485 19483 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff81025a88b8b0 0000000000000046 ffff81067d474c00 ffff810bded13080 Mar 26 09:30:07 ALPL402 kernel: 0000000000000001 000000000000000a ffff810263f687a0 ffff810c35c157e0 Mar 26 09:30:07 ALPL402 kernel: 0002c10fb97466fa 0000000000008cf6 ffff810263f68988 00000007ffffffff Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:07 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_470 D ffff8106550e1420 0 19485 1 19486 19484 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff81025a42b6d0 0000000000000046 ffff810846c3fea8 0000000000000000 Mar 26 09:30:07 ALPL402 kernel: 0000000000000000 000000000000000a ffff8102686a4040 ffff8106552227e0 Mar 26 09:30:07 ALPL402 kernel: 0002c0f029908cdb 0000000000002d57 ffff8102686a4228 000000041105e218 Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:07 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:07 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:07 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_471 D ffff8106550fa7a0 0 19486 1 19487 19485 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff8106b2b4b6d0 0000000000000046 ffff810c2f29dda8 0000000000000000 Mar 26 09:30:07 ALPL402 kernel: 0000000000000000 000000000000000a ffff81069e513860 ffff8106553247a0 Mar 26 09:30:07 ALPL402 kernel: 0002c0ee559217c0 00000000000030ca ffff81069e513a48 00000007110609a0 Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:07 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:07 ALPL402 kernel: [] :ko2iblnd:kiblnd_init_tx_msg+0x154/0x1d0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:07 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:07 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_472 D ffff81000101d7a0 0 19487 1 19488 19486 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff8106b2b558b0 0000000000000046 ffff8105e7662c00 ffff810540c64080 Mar 26 09:30:07 ALPL402 kernel: 0000000000000001 000000000000000a ffff810265997100 ffff8106551987a0 Mar 26 09:30:07 ALPL402 kernel: 0002c116b27af403 000000000000ac8b ffff8102659972e8 00000003ffffffff Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:07 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_473 D ffff81000101d7a0 0 19488 1 19489 19487 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff8102f0a138b0 0000000000000046 ffff81052208dc00 ffff810450d32380 Mar 26 09:30:07 ALPL402 kernel: 0000000000000001 000000000000000a ffff810263c14860 ffff8106551987a0 Mar 26 09:30:07 ALPL402 kernel: 0002c0ef2828d2e8 000000000000934c ffff810263c14a48 00000003ffffffff Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:07 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_474 D ffff81000100caa0 0 19489 1 19490 19488 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff81025a3298b0 0000000000000046 ffff81034dd83e00 ffff810334e03980 Mar 26 09:30:07 ALPL402 kernel: 0000000000000001 0000000000000009 ffff810265ae77a0 ffff810640047820 Mar 26 09:30:07 ALPL402 kernel: 0002c0ee03981a81 000000000000c8a5 ffff810265ae7988 00000001ffffffff Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:07 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:07 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:07 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:07 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:07 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:07 ALPL402 kernel: Mar 26 09:30:07 ALPL402 kernel: ll_ost_io_475 D ffff810001015120 0 19490 1 19491 19489 (L-TLB) Mar 26 09:30:07 ALPL402 kernel: ffff810259c4d770 0000000000000046 0000000000000020 0909090909090936 Mar 26 09:30:07 ALPL402 kernel: ffff810259c4d810 000000000000000a ffff8109d6eaa100 ffff810655184860 Mar 26 09:30:07 ALPL402 kernel: 0002c0f9d0578831 000000000000f828 ffff8109d6eaa2e8 00000002b454c5b8 Mar 26 09:30:07 ALPL402 kernel: Call Trace: Mar 26 09:30:07 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:07 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:07 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:07 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:07 ALPL402 kernel: [] add_to_page_cache_lru+0x1c/0x23 Mar 26 09:30:07 ALPL402 kernel: [] find_or_create_page+0x4b/0x72 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:07 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:07 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:08 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:08 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:08 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_476 D ffff8106550e9aa0 0 19491 1 19492 19490 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff810259e4b770 0000000000000046 0000000000000020 0909090909090937 Mar 26 09:30:08 ALPL402 kernel: ffff810259e4b810 000000000000000a ffff8105f12707e0 ffff81065527e820 Mar 26 09:30:08 ALPL402 kernel: 0002c0f5066ba712 000000000000d4ff ffff8105f12709c8 00000005cf3f9768 Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:08 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:08 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:08 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:08 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:08 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_477 D ffff8106550e1420 0 19492 1 19493 19491 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff8102598498b0 0000000000000046 ffff8106a46d2c00 ffff8109343140c0 Mar 26 09:30:08 ALPL402 kernel: 0000000000000001 000000000000000a ffff8102649d87a0 ffff8106552227e0 Mar 26 09:30:08 ALPL402 kernel: 0002c0ee0a7c9ba3 000000000000b626 ffff8102649d8988 00000004ffffffff Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:08 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:08 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_478 D ffff8106550e9aa0 0 19493 1 19494 19492 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff81025994f6d0 0000000000000046 0000000000000006 ffff8107eb75c048 Mar 26 09:30:08 ALPL402 kernel: 0000000000000001 000000000000000a ffff810265997860 ffff81065527e820 Mar 26 09:30:08 ALPL402 kernel: 0002c0f85ba39628 0000000000002686 ffff810265997a48 000000051105aa08 Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:08 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:08 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:08 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_479 D ffff8106550fa7a0 0 19494 1 19495 19493 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff8102599798b0 0000000000000046 ffff810acfa1d800 ffff810a646a7e00 Mar 26 09:30:08 ALPL402 kernel: 0000000000000001 000000000000000a ffff810264ac10c0 ffff8106553247a0 Mar 26 09:30:08 ALPL402 kernel: 0002c0ee74c757c5 000000000000bdc3 ffff810264ac12a8 00000007ffffffff Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:08 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:08 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_480 D ffff810001015120 0 19495 1 19496 19494 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff81025997b770 0000000000000046 0000000000000020 0909090909090937 Mar 26 09:30:08 ALPL402 kernel: ffff81025997b810 000000000000000a ffff810264ac1820 ffff810655184860 Mar 26 09:30:08 ALPL402 kernel: 0002c0f50b540d0b 00000000000110f1 ffff810264ac1a08 00000002486e0330 Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:08 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:08 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:08 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:08 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:08 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_481 D ffff81000101d7a0 0 19496 1 19497 19495 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff810259aa76d0 0000000000000046 ffff8105aaa65438 0000000000000000 Mar 26 09:30:08 ALPL402 kernel: 0000000000000000 000000000000000a ffff81026552d820 ffff8106551987a0 Mar 26 09:30:08 ALPL402 kernel: 0002c0f6ddb30330 0000000000002af9 ffff81026552da08 00000003110609a0 Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:08 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:08 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:08 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_482 D ffff81000101d7a0 0 19497 1 19498 19496 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff810259aaf770 0000000000000046 0000000000000020 0909090909090937 Mar 26 09:30:08 ALPL402 kernel: ffff810259aaf810 000000000000000a ffff8104cc6d67e0 ffff8106551987a0 Mar 26 09:30:08 ALPL402 kernel: 0002c0f51f00b273 000000000000f516 ffff8104cc6d69c8 0000000332b18180 Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:08 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:08 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:08 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:08 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:08 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_483 D ffff81000101d7a0 0 19498 1 19499 19497 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff810259bdd8b0 0000000000000046 ffff8103ea331e00 ffff810561cab240 Mar 26 09:30:08 ALPL402 kernel: 0000000000000001 000000000000000a ffff8107480ca080 ffff8106551987a0 Mar 26 09:30:08 ALPL402 kernel: 0002c0ee3d1ee0c1 000000000000c52a ffff8107480ca268 00000003ffffffff Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:08 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:08 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_484 D ffff8106550fa7a0 0 19499 1 19500 19498 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff8102594e56d0 0000000000000046 ffff81018f405c28 0000000000000000 Mar 26 09:30:08 ALPL402 kernel: 0000000000000000 000000000000000a ffff81026552d0c0 ffff8106553247a0 Mar 26 09:30:08 ALPL402 kernel: 0002c0f2ff60689f 0000000000003140 ffff81026552d2a8 000000071105aa08 Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:08 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:08 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:08 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_485 D ffff8106550fa7a0 0 19500 1 19501 19499 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff810259609770 0000000000000046 0000000000000020 0909090909090934 Mar 26 09:30:08 ALPL402 kernel: ffff810259609810 000000000000000a ffff8102649d8040 ffff8106553247a0 Mar 26 09:30:08 ALPL402 kernel: 0002c0ee1ec75016 0000000000009b93 ffff8102649d8228 000000073dc7eac8 Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:08 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:08 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:08 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:08 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:08 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_486 D ffff8106550f2120 0 19501 1 19502 19500 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff81025911d8b0 0000000000000046 ffff8109ac1b5e00 ffff810aa0590b40 Mar 26 09:30:08 ALPL402 kernel: 0000000000000001 000000000000000a ffff810265ae7040 ffff8106552de860 Mar 26 09:30:08 ALPL402 kernel: 0002c116d0c60146 000000000001580f ffff810265ae7228 00000006ffffffff Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:08 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:08 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x8c/0x360 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_487 D ffff8106550f2120 0 19502 1 19503 19501 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff8102592e3770 0000000000000046 0000000000000020 0909090909090936 Mar 26 09:30:08 ALPL402 kernel: ffff8102592e3810 000000000000000a ffff810263c14100 ffff8106552de860 Mar 26 09:30:08 ALPL402 kernel: 0002c0f0e59fc1ce 000000000000e8b4 ffff810263c142e8 000000069abcf690 Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:08 ALPL402 kernel: [] add_to_page_cache_lru+0x1c/0x23 Mar 26 09:30:08 ALPL402 kernel: [] find_or_create_page+0x4b/0x72 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:08 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:08 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:08 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:08 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_488 D ffff8106b902b040 0 19503 1 19504 19502 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff810258d618b0 0000000000000046 ffff81043aa1c000 ffff8101893e13c0 Mar 26 09:30:08 ALPL402 kernel: 0000000000000001 000000000000000a ffff8106b0ed40c0 ffff8106b902b040 Mar 26 09:30:08 ALPL402 kernel: 0002c0ee01e8a1aa 000000000000c5ea ffff8106b0ed42a8 00000003ffffffff Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:08 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:08 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_489 D ffff810001015120 0 19504 1 19505 19503 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff810258e296d0 0000000000000046 ffff81021fbe0a70 0000000000000000 Mar 26 09:30:08 ALPL402 kernel: 0000000000000000 000000000000000a ffff8105f02140c0 ffff810655184860 Mar 26 09:30:08 ALPL402 kernel: 0002c0ed639a00da 000000000000636f ffff8105f02142a8 000000021105b640 Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:08 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:08 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:08 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_490 D ffff810001004420 0 19505 1 19506 19504 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff8102589856d0 0000000000000046 ffff8101d5cf33b8 0000000000000000 Mar 26 09:30:08 ALPL402 kernel: 0000000000000000 000000000000000a ffff810264a7c100 ffffffff8031db60 Mar 26 09:30:08 ALPL402 kernel: 0002c0eea6c3e745 0000000000003530 ffff810264a7c2e8 000000001105e218 Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:08 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:08 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:08 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_491 D ffff81000101d7a0 0 19506 1 19507 19505 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff810258a8b6d0 0000000000000046 ffff810658153c68 0000000000000000 Mar 26 09:30:08 ALPL402 kernel: 0000000000000000 000000000000000a ffff8106b09ae7e0 ffff8106551987a0 Mar 26 09:30:08 ALPL402 kernel: 0002c0f9ae331893 0000000000001d09 ffff8106b09ae9c8 000000031105ba90 Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:08 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:08 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:08 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_492 D ffff8106550e9aa0 0 19507 1 19508 19506 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff81025239d770 0000000000000046 0000000000000020 0909090909090934 Mar 26 09:30:08 ALPL402 kernel: ffff81025239d810 000000000000000a ffff810252052860 ffff81065527e820 Mar 26 09:30:08 ALPL402 kernel: 0002c0f0cbb31ba0 000000000000e11c ffff810252052a48 000000053517b4e0 Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:08 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_fmd_expire_nolock+0x1d3/0x1f0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:08 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:08 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:08 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_493 D ffff810a49e837a0 0 19508 1 19509 19507 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff810251d45840 0000000000000046 ffff8103328e5678 ffffffff88be73df Mar 26 09:30:08 ALPL402 kernel: ffff81063f72be00 000000000000000a ffff810252052100 ffff810a49e837a0 Mar 26 09:30:08 ALPL402 kernel: 0002c0eea60c9879 000000000015ce3b ffff8102520522e8 0000000688a7f662 Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:08 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_block+0xc0/0x120 Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xc47/0x2e70 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_checksum_bulk+0x2bb/0x5a0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:target_committed_to_req+0x40/0x120 Mar 26 09:30:08 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_494 D ffff8102eb9d97e0 0 19509 1 19510 19508 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff810251e4b8b0 0000000000000046 ffff81096e316c00 ffff810683e446c0 Mar 26 09:30:08 ALPL402 kernel: 0000000000000001 000000000000000a ffff8102643d20c0 ffff8102eb9d97e0 Mar 26 09:30:08 ALPL402 kernel: 0002c0edf2ed9ce9 000000000000dd7d ffff8102643d22a8 00000005ffffffff Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:08 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:08 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_495 D ffff8106550f2120 0 19510 1 19511 19509 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff810251a396d0 0000000000000046 ffff81016223ce28 0000000000000000 Mar 26 09:30:08 ALPL402 kernel: 0000000000000000 000000000000000a ffff81069f101080 ffff8106552de860 Mar 26 09:30:08 ALPL402 kernel: 0002c0fb8767d74a 0000000000002650 ffff81069f101268 000000061105aa08 Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:08 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:08 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:08 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_496 D ffff810001004420 0 19511 1 19512 19510 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff81025156d770 0000000000000046 0000000000000020 0909090909090933 Mar 26 09:30:08 ALPL402 kernel: ffff81025156d810 000000000000000a ffff8106c5d17860 ffffffff8031db60 Mar 26 09:30:08 ALPL402 kernel: 0002c0edf3bc58ea 000000000000e4fd ffff8106c5d17a48 000000003eff9840 Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:08 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:08 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:08 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:08 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:08 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_497 D ffff810001015120 0 19512 1 19513 19511 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff8102510876d0 0000000000000046 ffff8101de7d3478 0000000000000000 Mar 26 09:30:08 ALPL402 kernel: 0000000000000000 000000000000000a ffff810263fae080 ffff810655184860 Mar 26 09:30:08 ALPL402 kernel: 0002c0f7ac39cc67 0000000000002a6a ffff810263fae268 0000000211060608 Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:08 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:08 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:08 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_498 D ffff810001015120 0 19513 1 19514 19512 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff81024900b770 0000000000000046 0000000000000020 0909090909090934 Mar 26 09:30:08 ALPL402 kernel: ffff81024900b810 000000000000000a ffff810b7e03d820 ffff810655184860 Mar 26 09:30:08 ALPL402 kernel: 0002c0f0e9c2bed5 000000000000d740 ffff810b7e03da08 0000000239c679f0 Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:08 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:08 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:08 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:08 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:08 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_499 D ffff81000101d7a0 0 19514 1 19515 19513 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff81024b65b6d0 0000000000000046 ffff81013dd07478 0000000000000000 Mar 26 09:30:08 ALPL402 kernel: 0000000000000000 000000000000000a ffff81072f8567e0 ffff8106551987a0 Mar 26 09:30:08 ALPL402 kernel: 0002c0ee249d73f9 0000000000002f4a ffff81072f8569c8 000000031105b640 Mar 26 09:30:08 ALPL402 kernel: Call Trace: Mar 26 09:30:08 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:08 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:08 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:08 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:08 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:08 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:08 ALPL402 kernel: [] :ko2iblnd:kiblnd_init_tx_msg+0x154/0x1d0 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:08 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:08 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:08 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:08 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ldlm_resource_iterate+0x1ad/0x240 Mar 26 09:30:08 ALPL402 kernel: [] dequeue_task+0x18/0x37 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:08 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:08 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:08 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:08 ALPL402 kernel: Mar 26 09:30:08 ALPL402 kernel: ll_ost_io_500 D ffff810619c28080 0 19515 1 19516 19514 (L-TLB) Mar 26 09:30:08 ALPL402 kernel: ffff81024b1d76d0 0000000000000046 ffff8103f9e3fd28 0000000000000000 Mar 26 09:30:08 ALPL402 kernel: 0000000000000000 000000000000000a ffff810264a35860 ffff810619c28080 Mar 26 09:30:09 ALPL402 kernel: 0002c0ee482f4ab8 0000000000147c2f ffff810264a35a48 000000071105cdf8 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:09 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:09 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:09 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:09 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:09 ALPL402 kernel: [] :ko2iblnd:kiblnd_init_tx_msg+0x154/0x1d0 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_checksum_bulk+0x378/0x5a0 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:09 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:09 ALPL402 kernel: [] :obdclass:class_handle2object+0xf6/0x170 Mar 26 09:30:09 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:09 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ll_ost_io_501 D ffff8106550e9aa0 0 19516 1 19517 19515 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff81024925b770 0000000000000046 0000000000000020 0909090909090936 Mar 26 09:30:09 ALPL402 kernel: ffff81024925b810 000000000000000a ffff8106c5a81080 ffff81065527e820 Mar 26 09:30:09 ALPL402 kernel: 0002c0eed27c7fd6 000000000000cc5e ffff8106c5a81268 000000053fb380a8 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:09 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:09 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:09 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:09 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:09 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:09 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:09 ALPL402 kernel: [] cache_alloc_refill+0x88/0x188 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:09 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:09 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:09 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ll_ost_io_502 D ffff8106550e9aa0 0 19517 1 19518 19516 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff81024ab638b0 0000000000000046 ffff810a46ee7400 ffff81072bafdcc0 Mar 26 09:30:09 ALPL402 kernel: 0000000000000001 000000000000000a ffff810264a7c860 ffff81065527e820 Mar 26 09:30:09 ALPL402 kernel: 0002c0ee0bbf0cd2 000000000000a08a ffff810264a7ca48 00000005ffffffff Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:09 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:09 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:09 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:09 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:09 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ll_ost_io_503 D ffff8106550e9aa0 0 19518 1 19519 19517 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff810248e716d0 0000000000000046 ffff81095acf0ca8 0000000000000000 Mar 26 09:30:09 ALPL402 kernel: 0000000000000000 000000000000000a ffff81024b105820 ffff81065527e820 Mar 26 09:30:09 ALPL402 kernel: 0002c0edda22a54b 000000000000243c ffff81024b105a08 000000051105e218 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:09 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:09 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:09 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:09 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:09 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:09 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:09 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ll_ost_io_504 D ffff810001004420 0 19519 1 19520 19518 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff81024af6b8b0 0000000000000046 ffff810409952e00 ffff810528fd9cc0 Mar 26 09:30:09 ALPL402 kernel: 0000000000000001 000000000000000a ffff8102649d0080 ffffffff8031db60 Mar 26 09:30:09 ALPL402 kernel: 0002c0ee3d747c6b 000000000000c3d9 ffff8102649d0268 00000000ffffffff Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:09 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:09 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:09 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:09 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:09 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ll_ost_io_505 D ffff8109c3bc4040 0 19520 1 19521 19519 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff81024c265840 0000000000000046 ffff81013dc500c0 ffffffff88be73df Mar 26 09:30:09 ALPL402 kernel: ffff81063f72be00 000000000000000a ffff810264af8100 ffff8109c3bc4040 Mar 26 09:30:09 ALPL402 kernel: 0002c0ed9ddb43c6 0000000000165734 ffff810264af82e8 0000000388a7f662 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xcf/0x210 Mar 26 09:30:09 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_block+0xc0/0x120 Mar 26 09:30:09 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:09 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xc47/0x2e70 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_checksum_bulk+0x387/0x5a0 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:09 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:09 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:09 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ll_ost_io_506 D ffff8102686a47a0 0 19521 1 19522 19520 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff81024b5e5770 0000000000000046 0000000000000020 0909090909090934 Mar 26 09:30:09 ALPL402 kernel: ffff81024b5e5810 000000000000000a ffff8102480087a0 ffff8102686a47a0 Mar 26 09:30:09 ALPL402 kernel: 0002c0edff988977 000000000000ed67 ffff810248008988 000000033e8a6768 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ldiskfs:ldiskfs_bread+0xe/0x80 Mar 26 09:30:09 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:09 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:09 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:09 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:09 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:09 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:09 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:09 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:09 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:09 ALPL402 kernel: [] dequeue_task+0x18/0x37 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:09 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ll_ost_io_507 D ffff81000101d7a0 0 19522 1 19523 19521 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff8102498d16d0 0000000000000046 ffff8105434f5ea8 0000000000000000 Mar 26 09:30:09 ALPL402 kernel: 0000000000000000 000000000000000a ffff810248008040 ffff8106551987a0 Mar 26 09:30:09 ALPL402 kernel: 0002c10b46d3975d 00000000000026b0 ffff810248008228 000000031105b138 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:09 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:09 ALPL402 kernel: [] :ldiskfs:ldiskfs_get_blocks+0xaa/0x210 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:09 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_brw_start+0x35c/0x490 Mar 26 09:30:09 ALPL402 kernel: [] :lquota:filter_quota_acquire+0x0/0x120 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_commitrw_write+0xe4d/0x2e70 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_brw_write+0x1c99/0x2480 Mar 26 09:30:09 ALPL402 kernel: [] :lnet:LNetMDBind+0x301/0x450 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_set_limit+0x35/0xf0 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_handle+0x2bc2/0x55c0 Mar 26 09:30:09 ALPL402 kernel: [] :obdclass:class_handle2object+0xe0/0x170 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:__ldlm_handle2lock+0x2f8/0x360 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:09 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ll_ost_io_508 D ffff8106550f2120 0 19523 1 19524 19522 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff8102498f98b0 0000000000000046 ffff810bd1649e00 ffff810683e44b40 Mar 26 09:30:09 ALPL402 kernel: 0000000000000001 000000000000000a ffff810263f68040 ffff8106552de860 Mar 26 09:30:09 ALPL402 kernel: 0002c0edc2b7be24 000000000000aa70 ffff810263f68228 00000006ffffffff Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:09 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:09 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:09 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:09 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:09 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ll_ost_io_509 D ffff8106550fa7a0 0 19524 1 19525 19523 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff8102498f58b0 0000000000000046 ffff810921b44a00 ffff810ac27fd540 Mar 26 09:30:09 ALPL402 kernel: 0000000000000001 000000000000000a ffff81024800a7e0 ffff8106553247a0 Mar 26 09:30:09 ALPL402 kernel: 0002c115ee78be49 0000000000011a49 ffff81024800a9c8 00000007ffffffff Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:09 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:09 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:09 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:09 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:09 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ll_ost_io_510 D ffff8106550e1420 0 19525 1 19526 19524 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff8102498f7770 0000000000000046 0000000000000020 0909090909090933 Mar 26 09:30:09 ALPL402 kernel: ffff8102498f7810 000000000000000a ffff810264a35100 ffff8106552227e0 Mar 26 09:30:09 ALPL402 kernel: 0002c0ee1e67ef4c 000000000000cc6f ffff810264a352e8 0000000415c7b258 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:09 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:09 ALPL402 kernel: [] d_rehash_cond+0x2c/0x46 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:09 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:09 ALPL402 kernel: [] find_or_create_page+0x22/0x72 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_setattr_internal+0x595/0x1d60 Mar 26 09:30:09 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_fid2dentry+0x512/0x740 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_fmd_get+0x2b7/0x320 Mar 26 09:30:09 ALPL402 kernel: [] __up_write+0x27/0xf2 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_setattr+0x1c1/0x3b0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_truncate+0x1d9/0x270 Mar 26 09:30:09 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:09 ALPL402 kernel: [] :lvfs:lprocfs_counter_add+0x33/0x100 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_punch+0x9c8/0xce0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_version+0x35/0xf0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_handle+0x3138/0x55c0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_resource_get+0x1d9/0xa60 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:09 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ll_ost_io_511 D ffff8106550e9aa0 0 19526 1 19527 19525 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff8102480e38b0 0000000000000046 ffff810af65ef400 ffff810b2e43b980 Mar 26 09:30:09 ALPL402 kernel: 0000000000000001 000000000000000a ffff8109d7dee7a0 ffff81065527e820 Mar 26 09:30:09 ALPL402 kernel: 0002c0edd1067913 000000000000e357 ffff8109d7dee988 00000005ffffffff Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:09 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_lock_remove_from_lru+0x74/0xe0 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:09 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_version_get_check+0x91/0x2a0 Mar 26 09:30:09 ALPL402 kernel: [] __down_write_nested+0x12/0x92 Mar 26 09:30:09 ALPL402 kernel: [] :libcfs:cfs_alloc+0x68/0xc0 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_destroy+0xa2d/0x1f90 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_blocking_ast+0x0/0x2a0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_completion_ast+0x0/0x880 Mar 26 09:30:09 ALPL402 kernel: [] :obdclass:lustre_hash_del+0x1fa/0x400 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply_flags+0x86a/0x950 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_resource_putref_internal+0x3ab/0x460 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_lock_put+0x372/0x3d0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_destroy+0x660/0x790 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_check_version_v2+0x8/0x20 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_get_opc+0x35/0xf0 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_handle+0x1566/0x55c0 Mar 26 09:30:09 ALPL402 kernel: [] dequeue_task+0x18/0x37 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:09 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ll_ost_creat_ S ffff8105e7d680c0 0 19527 1 19528 19526 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff81023dab5e20 0000000000000046 0000000000000000 0000000000000000 Mar 26 09:30:09 ALPL402 kernel: 0000000000000000 000000000000000a ffff8102643d2820 ffff8105e7d680c0 Mar 26 09:30:09 ALPL402 kernel: 0002c278bbafe939 000000000000067f ffff8102643d2a08 0000000788999872 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ll_ost_creat_ D ffff810001015120 0 19528 1 19529 19527 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff81022cf6b7a0 0000000000000046 ffff8105ea97eb70 ffff8105ee2be800 Mar 26 09:30:09 ALPL402 kernel: ffffffff00000001 000000000000000a ffff8102655610c0 ffff810655184860 Mar 26 09:30:09 ALPL402 kernel: 0002c0ed577f3dfd 0000000000002672 ffff8102655612a8 0000000200000000 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:do_get_write_access+0x3e3/0x418 Mar 26 09:30:09 ALPL402 kernel: [] __mutex_lock_slowpath+0x60/0x9b Mar 26 09:30:09 ALPL402 kernel: [] .text.lock.mutex+0xf/0x14 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:__jbd2_log_wait_for_space+0x5d/0x1ad Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:start_this_handle+0x346/0x3cf Mar 26 09:30:09 ALPL402 kernel: [] lookup_one_len+0x53/0x61 Mar 26 09:30:09 ALPL402 kernel: [] :jbd2:jbd2_journal_start+0xad/0xe1 Mar 26 09:30:09 ALPL402 kernel: [] :fsfilt_ldiskfs:fsfilt_ldiskfs_start+0x4c2/0x590 Mar 26 09:30:09 ALPL402 kernel: [] _atomic_dec_and_lock+0x39/0x57 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_precreate+0xf95/0x19b0 Mar 26 09:30:09 ALPL402 kernel: [] :lnet:lnet_ni_send+0x96/0xe0 Mar 26 09:30:09 ALPL402 kernel: [] dput+0x2c/0x114 Mar 26 09:30:09 ALPL402 kernel: [] :obdfilter:filter_create+0x11cf/0x17e0 Mar 26 09:30:09 ALPL402 kernel: [] :lnet:LNetPut+0x720/0x830 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptl_send_buf+0x3f3/0x5b0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_msg_add_version+0x34/0x110 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_send_reply+0x5e8/0x600 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lustre_pack_reply+0x29/0xb0 Mar 26 09:30:09 ALPL402 kernel: [] :ost:ost_handle+0x1281/0x55c0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_handle_request+0x984/0xe00 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x2e5/0x310 Mar 26 09:30:09 ALPL402 kernel: [] __wake_up_common+0x3e/0x68 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0xf16/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_52 S ffff8106550f2120 0 19529 1 19530 19528 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff810225da1ea0 0000000000000046 ffff8105473a2800 ffff81015907d998 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810265aba7a0 ffff8106552de860 Mar 26 09:30:09 ALPL402 kernel: 0002c11ecbd11863 0000000000007219 ffff810265aba988 0000000600000282 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_53 S ffff8106550f2120 0 19530 1 19531 19529 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff810225da3ea0 0000000000000046 ffff8105ab430a00 ffff8102ef925e98 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810226665820 ffff8106552de860 Mar 26 09:30:09 ALPL402 kernel: 0002c11719e26ea4 000000000000a496 ffff810226665a08 0000000600000282 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_54 S ffff8106550e9aa0 0 19531 1 19532 19530 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff810225da7ea0 0000000000000046 ffff8105aa0db800 ffff81057088a5d8 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8102266650c0 ffff81065527e820 Mar 26 09:30:09 ALPL402 kernel: 0002c120722947db 0000000000006446 ffff8102266652a8 0000000500000282 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_55 S ffff8106550e1420 0 19532 1 19533 19531 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff810225da9ea0 0000000000000046 ffff8104c87d8400 ffff8106200674d8 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810226666860 ffff8106552227e0 Mar 26 09:30:09 ALPL402 kernel: 0002c11ea690038f 000000000000de34 ffff810226666a48 0000000400000286 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_56 S ffff8106550f2120 0 19533 1 19534 19532 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff810225dabea0 0000000000000046 ffff810a084a6200 ffff810c3accf098 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810226666100 ffff8106552de860 Mar 26 09:30:09 ALPL402 kernel: 0002c1206b96c194 0000000000004bf7 ffff8102266662e8 0000000600000286 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_57 S ffff8106550e1420 0 19534 1 19535 19533 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff810225dafea0 0000000000000046 ffff810aff9ec000 ffff810967437ad8 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8102266867a0 ffff8106552227e0 Mar 26 09:30:09 ALPL402 kernel: 0002c117335efcd0 0000000000005fbb ffff810226686988 0000000400000282 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_58 S ffff810001004420 0 19535 1 19536 19534 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff8102258bdea0 0000000000000046 ffff810afe03fe00 ffff810aac853dd8 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff81022666c7e0 ffffffff8031db60 Mar 26 09:30:09 ALPL402 kernel: 0002c123dbd5ee46 0000000000007f8c ffff81022666c9c8 0000000000000282 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_59 S ffff8106550fa7a0 0 19536 1 19537 19535 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff81024a27fea0 0000000000000046 ffff810aff9eca00 ffff810967437ad8 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff81026387d080 ffff8106553247a0 Mar 26 09:30:09 ALPL402 kernel: 0002c1173336b483 000000000000784d ffff81026387d268 0000000700000286 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_60 S ffff8106550f2120 0 19537 1 19538 19536 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff8102251f5ea0 0000000000000046 ffff810211c7da00 ffff8105eac46cd8 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8102258a0860 ffff8106552de860 Mar 26 09:30:09 ALPL402 kernel: 0002c123da31c9c7 000000000000b0e4 ffff8102258a0a48 0000000600000282 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :obdclass:class_handle_free_cb+0x0/0x110 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_61 S ffff8106550e1420 0 19538 1 19539 19537 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff81022530fea0 0000000000000046 ffff8109fe3cf400 ffff810a93087b98 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff81022666c080 ffff8106552227e0 Mar 26 09:30:09 ALPL402 kernel: 0002c11695c5f65c 000000000000a43c ffff81022666c268 0000000400000282 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_62 S ffff8106550e1420 0 19539 1 19540 19538 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff810225311ea0 0000000000000046 ffff810218116600 ffff810317fbe9d8 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8102258a0100 ffff8106552227e0 Mar 26 09:30:09 ALPL402 kernel: 0002c122fbbc0d32 000000000000ac99 ffff8102258a02e8 0000000400000282 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_63 S ffff8106550f2120 0 19540 1 19541 19539 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff810225313ea0 0000000000000046 ffff810aff9eca00 ffff810967437ad8 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810265aba040 ffff8106552de860 Mar 26 09:30:09 ALPL402 kernel: 0002c1171ac66436 00000000000062e6 ffff810265aba228 0000000600000286 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] dummy_inode_permission+0x0/0x3 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_64 S ffff8106550e1420 0 19541 1 19542 19540 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff810225315ea0 0000000000000046 ffff8103a66ff600 ffff81035971be98 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8102252f97a0 ffff8106552227e0 Mar 26 09:30:09 ALPL402 kernel: 0002c124a82069b7 00000000000095dd ffff8102252f9988 0000000400000286 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_65 S ffff8106550e1420 0 19542 1 19543 19541 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff810224cabea0 0000000000000046 ffff8104ee4f1400 ffff810138988598 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8102255a7820 ffff8106552227e0 Mar 26 09:30:09 ALPL402 kernel: 0002c11f4e6050bf 00000000000092f0 ffff8102255a7a08 0000000400000282 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] dummy_inode_permission+0x0/0x3 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_66 S ffff8106550e1420 0 19543 1 19544 19542 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff810224cb1ea0 0000000000000046 ffff810ada209200 ffff810b9f2babd8 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8102252f9040 ffff8106552227e0 Mar 26 09:30:09 ALPL402 kernel: 0002c118cd08f328 0000000000006096 ffff8102252f9228 0000000400000286 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_67 S ffff8106550e1420 0 19544 1 19545 19543 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff810224cb3ea0 0000000000000046 ffff810aff9ec400 ffff8106bfd11d98 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810a49e83040 ffff8106552227e0 Mar 26 09:30:09 ALPL402 kernel: 0002c1171aa66586 00000000000055e2 ffff810a49e83228 0000000400000286 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_68 S ffff8106550fa7a0 0 19545 1 19546 19544 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff810224d91ea0 0000000000000046 ffff810877a96600 ffff810c375fd5d8 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810224d837e0 ffff8106553247a0 Mar 26 09:30:09 ALPL402 kernel: 0002c1169660869d 000000000000630b ffff810224d839c8 0000000700000282 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_69 S ffff810001004420 0 19546 1 19547 19545 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff810224d95ea0 0000000000000046 ffff810ae7b33800 ffff8106a57fb398 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810225301820 ffffffff8031db60 Mar 26 09:30:09 ALPL402 kernel: 0002c11f63802e4e 000000000000aa7c ffff810225301a08 0000000000000282 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_70 S ffff810001004420 0 19547 1 19548 19546 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff810224d97ea0 0000000000000046 ffff8109bdc43600 ffff8107d43bf8d8 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 0000000000000009 ffff8102253010c0 ffffffff8031db60 Mar 26 09:30:09 ALPL402 kernel: 0002c11a1f862aed 00000000000067c6 ffff8102253012a8 0000000000000282 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ll_ost_creat_ S ffff8106550fa7a0 0 19548 1 19549 19547 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff810223735e20 0000000000000046 0000000000000000 0000000000000000 Mar 26 09:30:09 ALPL402 kernel: 0000000000000000 000000000000000a ffff8102255a70c0 ffff8106553247a0 Mar 26 09:30:09 ALPL402 kernel: 0002c278bbaff1a1 0000000000000309 ffff8102255a72a8 0000000713587940 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_71 S ffff8106550f2120 0 19549 1 19550 19548 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff8106c9c55ea0 0000000000000046 ffff810af3ec6e00 ffff8106589cccd8 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106cd0f1860 ffff8106552de860 Mar 26 09:30:09 ALPL402 kernel: 0002c122feac6b63 000000000000873d ffff8106cd0f1a48 0000000600000286 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ldiskfs:ldiskfs_destroy_inode+0x0/0x90 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_72 S ffff8106550f2120 0 19550 1 19551 19549 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff8102c9b8bea0 0000000000000046 ffff81036a851200 ffff8105296f6698 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810265561820 ffff8106552de860 Mar 26 09:30:09 ALPL402 kernel: 0002c121bdb2201b 000000000000a221 ffff810265561a08 0000000600000286 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_73 S ffff8106550fa7a0 0 19551 1 19552 19550 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff8102c9171ea0 0000000000000046 ffff8103d7b8c800 ffff81058eafd898 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff81026f967080 ffff8106553247a0 Mar 26 09:30:09 ALPL402 kernel: 0002c1171a7d93ad 0000000000006cdb ffff81026f967268 0000000700000282 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_74 S ffff8106550e9aa0 0 19552 1 19553 19551 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff8102c97bfea0 0000000000000046 ffff810c1864f000 ffff810c3b7d05d8 Mar 26 09:30:09 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8105f0110100 ffff81065527e820 Mar 26 09:30:09 ALPL402 kernel: 0002c127e511e2c0 0000000000009444 ffff8105f01102e8 0000000500000282 Mar 26 09:30:09 ALPL402 kernel: Call Trace: Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:09 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:09 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:09 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:09 ALPL402 kernel: Mar 26 09:30:09 ALPL402 kernel: ldlm_bl_75 S ffff8106550e9aa0 0 19553 1 19554 19552 (L-TLB) Mar 26 09:30:09 ALPL402 kernel: ffff8106de52fea0 0000000000000046 ffff8103a2ebf400 ffff81053d6042d8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106ce1687a0 ffff81065527e820 Mar 26 09:30:10 ALPL402 kernel: 0002c11ecbaf5546 000000000000ae95 ffff8106ce168988 0000000500000286 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_76 S ffff81000100caa0 0 19554 1 19555 19553 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8106cd0ffea0 0000000000000046 ffff810ac9312600 ffff81080a0dc998 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106ce168040 ffff810640047820 Mar 26 09:30:10 ALPL402 kernel: 0002c124a75ed0a2 0000000000007627 ffff8106ce168228 0000000100000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_77 S ffff8106550e1420 0 19555 1 19556 19554 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8106ccdcfea0 0000000000000046 ffff810b61560e00 ffff810c3accf698 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106ce1f37e0 ffff8106552227e0 Mar 26 09:30:10 ALPL402 kernel: 0002c1207198fce5 0000000000008390 ffff8106ce1f39c8 0000000400000286 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_78 S ffff81000100caa0 0 19556 1 19557 19555 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8106ccca9ea0 0000000000000046 ffff8103d5feca00 ffff810342942d98 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106ce1f3080 ffff810640047820 Mar 26 09:30:10 ALPL402 kernel: 0002c122ff29640e 000000000000fd58 ffff8106ce1f3268 0000000100000286 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :obdclass:class_handle_free_cb+0x0/0x110 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_79 S ffff8106550e9aa0 0 19557 1 19558 19556 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8106cc1e1ea0 0000000000000046 ffff8103c4cdc800 ffff81030d2b77d8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106ce5b4820 ffff81065527e820 Mar 26 09:30:10 ALPL402 kernel: 0002c1207201ad29 0000000000006484 ffff8106ce5b4a08 0000000500000286 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_80 S ffff8106550f2120 0 19558 1 19559 19557 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8106cc385ea0 0000000000000046 ffff810351df3600 ffff8101d0be29d8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106ce5b40c0 ffff8106552de860 Mar 26 09:30:10 ALPL402 kernel: 0002c124a7e26dc4 0000000000007333 ffff8106ce5b42a8 0000000600000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_81 S ffff8106550e1420 0 19559 1 19560 19558 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8102c99c7ea0 0000000000000046 ffff81052f18f200 ffff810054277ed8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810265ace100 ffff8106552227e0 Mar 26 09:30:10 ALPL402 kernel: 0002c12071ed1e50 0000000000006468 ffff810265ace2e8 0000000400000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_82 S ffff8106550fa7a0 0 19560 1 19561 19559 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8102c9a95ea0 0000000000000046 ffff810bf53a0000 ffff8109f42ba0d8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff81024800a080 ffff8106553247a0 Mar 26 09:30:10 ALPL402 kernel: 0002c121bd737de5 0000000000009f21 ffff81024800a268 0000000700000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_83 S ffff810001004420 0 19561 1 19562 19560 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8106cc37bea0 0000000000000046 ffff810514ae7600 ffff81029a348e98 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810224d83080 ffffffff8031db60 Mar 26 09:30:10 ALPL402 kernel: 0002c11b197d7bc0 0000000000006221 ffff810224d83268 0000000000000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_84 S ffff81000100caa0 0 19562 1 19563 19561 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8106de841ea0 0000000000000046 ffff8101ce07b200 ffff810246fabed8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106e9d3d860 ffff810640047820 Mar 26 09:30:10 ALPL402 kernel: 0002c124a75cf6ce 0000000000009f9a ffff8106e9d3da48 0000000100000286 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_85 S ffff8106550fa7a0 0 19563 1 19564 19562 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8106deef9ea0 0000000000000046 ffff810ba93d6000 ffff810979d6a4d8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810264980080 ffff8106553247a0 Mar 26 09:30:10 ALPL402 kernel: 0002c118c616e289 0000000000008a77 ffff810264980268 0000000700000286 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_86 S ffff8106550fa7a0 0 19564 1 20451 19563 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff81021c1d1ea0 0000000000000046 ffff81081b145a00 ffff810ae2db0b98 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810226686040 ffff8106553247a0 Mar 26 09:30:10 ALPL402 kernel: 0002c124fe0e2700 00000000000093bd ffff810226686228 0000000700000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_87 S ffff8106550fa7a0 0 20451 1 20452 19564 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8109a141bea0 0000000000000046 ffff810479e61000 ffff8103419b2098 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810b94d8a0c0 ffff8106553247a0 Mar 26 09:30:10 ALPL402 kernel: 0002c127e4de3186 0000000000007b37 ffff810b94d8a2a8 0000000700000060 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_88 S ffff8106550fa7a0 0 20452 1 23331 20451 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8104aadcfea0 0000000000000046 ffff810479e61600 ffff810394e85598 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8104baa5c7e0 ffff8106553247a0 Mar 26 09:30:10 ALPL402 kernel: 0002c127e4446983 000000000000a01f ffff8104baa5c9c8 0000000700000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ll_ost_creat_ S ffff810a4c44e820 0 23331 1 23332 20452 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810821e25e20 0000000000000046 0000000000000000 0000000000000000 Mar 26 09:30:10 ALPL402 kernel: 0000000000000000 000000000000000a ffff8106cd0f1100 ffff810a4c44e820 Mar 26 09:30:10 ALPL402 kernel: 0002c278bbaf69cb 00000000000157ea ffff8106cd0f12e8 0000000688999872 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ll_ost_creat_ S ffff8102643d2820 0 23332 1 31378 23331 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8101af2e3e20 0000000000000046 00000000eb33baae ffffffff8887b6d0 Mar 26 09:30:10 ALPL402 kernel: 0000000000000000 000000000000000a ffff8101b84bc820 ffff8102643d2820 Mar 26 09:30:10 ALPL402 kernel: 0002c278bbafe2ba 000000000001b9ef ffff8101b84bca08 00000007f16db828 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :lnet:LNetMDAttach+0x370/0x4b0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_post_idle_rqbds+0x38/0xe0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_10 S ffff8106550e1420 0 31378 1 31379 23332 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810c2e6e5e20 0000000000000046 0000000055135b9d ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff81016e331c00 000000000000000a ffff810bc0f7b0c0 ffff8106552227e0 Mar 26 09:30:10 ALPL402 kernel: 0002c1f7ef04b195 000000000000077f ffff810bc0f7b2a8 000000044e05ee40 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] __mod_timer+0xff/0x10e Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_11 S ffff8106550f2120 0 31379 1 31380 31378 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810c2e6e7e20 0000000000000046 0000000055135e7e ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff8100a0278c00 000000000000000a ffff810bc0f7b820 ffff8106552de860 Mar 26 09:30:10 ALPL402 kernel: 0002c1ddfa470da9 0000000000007cbf ffff810bc0f7ba08 0000000688999872 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_cancel_handler+0x308/0x690 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_12 S ffff8106550fa7a0 0 31380 1 31381 31379 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810b403d3e20 0000000000000046 0000000055135cdf ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff8104d3ba0400 000000000000000a ffff810b7cd07100 ffff8106553247a0 Mar 26 09:30:10 ALPL402 kernel: 0002c17d8113a011 00000000000078f7 ffff810b7cd072e8 0000000788999872 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_cancel_handler+0x308/0x690 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_13 S ffff810b7ebb20c0 0 31381 1 31382 31380 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff81096dfd3e20 0000000000000046 00000000eb328b6e ffffffff8887b6d0 Mar 26 09:30:10 ALPL402 kernel: ffff8105ebfad850 000000000000000a ffff810a4c44e0c0 ffff810b7ebb20c0 Mar 26 09:30:10 ALPL402 kernel: 0002c24d036406c1 00000000001188fb ffff810a4c44e2a8 00000005ebfad828 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :lnet:LNetMDAttach+0x370/0x4b0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_post_idle_rqbds+0x38/0xe0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_14 S ffff8106550fa7a0 0 31382 1 31390 31381 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff81070a695e20 0000000000000046 0000000055135b72 ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff810033675400 000000000000000a ffff8109541c5100 ffff8106553247a0 Mar 26 09:30:10 ALPL402 kernel: 0002c17dbc8e5f85 00000000000007d9 ffff8109541c52e8 000000079c0b6d40 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] __mod_timer+0xff/0x10e Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_15 S ffff8106550f2120 0 31390 1 31416 31382 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810ad23e9e20 0000000000000046 0000000055135bc6 ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff810016ae8800 000000000000000a ffff810841569040 ffff8106552de860 Mar 26 09:30:10 ALPL402 kernel: 0002c1ff0b0bd6ad 0000000000000817 ffff810841569228 000000065b96b0c0 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] __mod_timer+0xff/0x10e Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_16 S ffff8106550e1420 0 31416 1 31417 31390 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810a537c7e20 0000000000000046 0000000055135ba4 ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff8105d2e87400 000000000000000a ffff810b78f090c0 ffff8106552227e0 Mar 26 09:30:10 ALPL402 kernel: 0002c1fe31c71f85 00000000000008fd ffff810b78f092a8 00000004602642c0 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] __mod_timer+0xff/0x10e Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_17 S ffff8106550e9aa0 0 31417 1 31418 31416 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff81080c17be20 0000000000000046 0000000055136065 ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff8105e8455800 000000000000000a ffff810b26f197e0 ffff81065527e820 Mar 26 09:30:10 ALPL402 kernel: 0002c24f0e4626a5 0000000000007417 ffff810b26f199c8 0000000588999872 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_cancel_handler+0x308/0x690 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_18 S ffff8106550fa7a0 0 31418 1 31419 31417 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810bcbc31e20 0000000000000046 0000000055135d67 ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff81047ec25c00 000000000000000a ffff810ae0c977a0 ffff8106553247a0 Mar 26 09:30:10 ALPL402 kernel: 0002c19d2fb25dd7 0000000000007780 ffff810ae0c97988 0000000788999872 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_cancel_handler+0x308/0x690 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_19 S ffff81000101d7a0 0 31419 1 31420 31418 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810b27f5fe20 0000000000000046 0000000055135be3 ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff8101d3205400 000000000000000a ffff810b78f09820 ffff8106551987a0 Mar 26 09:30:10 ALPL402 kernel: 0002c21825424ec5 0000000000001023 ffff810b78f09a08 00000003393bd240 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] __mod_timer+0xff/0x10e Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_20 S ffff8106550e1420 0 31420 1 432 31419 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810af2a9fe20 0000000000000046 0000000055135eed ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff8105f04ec000 000000000000000a ffff8109541c5860 ffff8106552227e0 Mar 26 09:30:10 ALPL402 kernel: 0002c1f7b3911201 000000000000760a ffff8109541c5a48 0000000488999872 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_cancel_handler+0x308/0x690 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_21 S ffff8106550e1420 0 432 1 433 31420 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810a28b8de20 0000000000000046 0000000055135cdd ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff810078b8c000 000000000000000a ffff810b26f19080 ffff8106552227e0 Mar 26 09:30:10 ALPL402 kernel: 0002c17cec883b6d 00000000000088e6 ffff810b26f19268 0000000488999872 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_cancel_handler+0x308/0x690 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_22 S ffff8106550fa7a0 0 433 1 434 432 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8109306ebe20 0000000000000046 0000000055135b76 ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff81002bc3a400 000000000000000a ffff8109dd296080 ffff8106553247a0 Mar 26 09:30:10 ALPL402 kernel: 0002c19d6b2cbdc2 0000000000000784 ffff8109dd296268 00000007f5a388c0 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] __mod_timer+0xff/0x10e Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_23 S ffff8106550f2120 0 434 1 435 433 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810bd055fe20 0000000000000046 0000000055135ec3 ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff81006a11fc00 000000000000000a ffff810856197080 ffff8106552de860 Mar 26 09:30:10 ALPL402 kernel: 0002c1edf2299f2f 0000000000007464 ffff810856197268 0000000688999872 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_cancel_handler+0x308/0x690 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_24 S ffff8106550e1420 0 435 1 436 434 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8106a31f9e20 0000000000000046 0000000055135f08 ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff8105834afc00 000000000000000a ffff810873a3b7a0 ffff8106552227e0 Mar 26 09:30:10 ALPL402 kernel: 0002c1fdf644e551 00000000000127fb ffff810873a3b988 0000000488999872 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_cancel_handler+0x308/0x690 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_25 S ffff8106550e1420 0 436 1 11868 435 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff81098456be20 0000000000000046 0000000055135b62 ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff810536e8a400 000000000000000a ffff810b94d8a820 ffff8106552227e0 Mar 26 09:30:10 ALPL402 kernel: 0002c15167fc3fe2 00000000000007d0 ffff810b94d8aa08 000000048c44a940 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] __mod_timer+0xff/0x10e Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_89 S ffff8106550e1420 0 11868 1 11869 436 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff81019b865ea0 0000000000000046 ffff810c1864fa00 ffff810a8ee57dd8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8104caa74820 ffff8106552227e0 Mar 26 09:30:10 ALPL402 kernel: 0002c127e3f20f5c 000000000000be4a ffff8104caa74a08 0000000400000286 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] dummy_inode_permission+0x0/0x3 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_90 S ffff8106550e1420 0 11869 1 11870 11868 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8101cbb67ea0 0000000000000046 ffff810ae7b33800 ffff810c3b57c9d8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8104c97427a0 ffff8106552227e0 Mar 26 09:30:10 ALPL402 kernel: 0002c121bd93f119 0000000000008c4a ffff8104c9742988 0000000400000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_91 S ffff810001004420 0 11870 1 11871 11869 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810258155ea0 0000000000000046 ffff810aff9ecc00 ffff8108ea74e2d8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff81061fcf0860 ffffffff8031db60 Mar 26 09:30:10 ALPL402 kernel: 0002c1171a912ab2 0000000000009cce ffff81061fcf0a48 0000000000000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] dummy_inode_permission+0x0/0x3 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_92 S ffff8106550f2120 0 11871 1 11872 11870 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff81019f9adea0 0000000000000046 ffff8103a8f93800 ffff8102e82216d8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8105e93c4860 ffff8106552de860 Mar 26 09:30:10 ALPL402 kernel: 0002c11a1f8ac19f 0000000000007201 ffff8105e93c4a48 0000000600000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] dummy_inode_permission+0x0/0x3 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_93 S ffff8106550f2120 0 11872 1 11873 11871 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8102581c9ea0 0000000000000046 ffff810a62185e00 ffff810c3accf698 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8104db68a0c0 ffff8106552de860 Mar 26 09:30:10 ALPL402 kernel: 0002c1206b76e551 0000000000006db8 ffff8104db68a2a8 0000000600000008 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_94 S ffff8106550e1420 0 11873 1 16116 11872 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810bba7ebea0 0000000000000046 ffff810a76a24600 ffff8106d3c235d8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810b4ddb0040 ffff8106552227e0 Mar 26 09:30:10 ALPL402 kernel: 0002c11ecc847a0c 00000000000091ec ffff810b4ddb0228 0000000400000286 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_26 S ffff8106550f2120 0 16116 1 16117 11873 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810c18a09e20 0000000000000046 0000000055135f77 ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff810468c62800 000000000000000a ffff810873a3b040 ffff8106552de860 Mar 26 09:30:10 ALPL402 kernel: 0002c217e9c5e4c1 000000000000848c ffff810873a3b228 0000000688999872 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_cancel_handler+0x308/0x690 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_27 S ffff8106550e1420 0 16117 1 16118 16116 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8102f1d8de20 0000000000000046 0000000055135b4f ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff81019b0c1400 000000000000000a ffff8104baa5c080 ffff8106552227e0 Mar 26 09:30:10 ALPL402 kernel: 0002c17d280552b9 0000000000000b84 ffff8104baa5c268 000000047b646ac0 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] __mod_timer+0xff/0x10e Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_28 S ffff8106550f2120 0 16118 1 16119 16117 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8102026b7e20 0000000000000046 0000000055135b8f ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff81048899a800 000000000000000a ffff8105ed871820 ffff8106552de860 Mar 26 09:30:10 ALPL402 kernel: 0002c1ee2da89e4d 0000000000000946 ffff8105ed871a08 00000006599b3ac0 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] __mod_timer+0xff/0x10e Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_29 S ffff8106550f2120 0 16119 1 16120 16118 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff81015ffbfe20 0000000000000046 0000000055136065 ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff8100511a1c00 000000000000000a ffff8102f45a5820 ffff8106552de860 Mar 26 09:30:10 ALPL402 kernel: 0002c24f15bb54d8 000000000000757b ffff8102f45a5a08 0000000688999872 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_cancel_handler+0x308/0x690 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_30 S ffff8106550e1420 0 16120 1 23319 16119 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8101a8b61e20 0000000000000046 0000000055135b65 ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff8105e6fdf000 000000000000000a ffff8105eca03100 ffff8106552227e0 Mar 26 09:30:10 ALPL402 kernel: 0002c15793b6fc5f 00000000000008c9 ffff8105eca032e8 00000004a7d271c0 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] __mod_timer+0xff/0x10e Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_31 S ffff8106550f2120 0 23319 1 23320 16120 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810548c4be20 0000000000000046 0000000055135c63 ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff810625431c00 000000000000000a ffff8104cc6d6080 ffff8106552de860 Mar 26 09:30:10 ALPL402 kernel: 0002c160c88667ce 0000000000008a54 ffff8104cc6d6268 0000000688999872 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_cancel_handler+0x308/0x690 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_32 S ffff8106550f2120 0 23320 1 23321 23319 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff81011bad1e20 0000000000000046 0000000055135c69 ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff8105d2e87400 000000000000000a ffff81044553b100 ffff8106552de860 Mar 26 09:30:10 ALPL402 kernel: 0002c16204ef48bc 000000000000793f ffff81044553b2e8 0000000688999872 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_cancel_handler+0x308/0x690 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_33 S ffff8106550e9aa0 0 23321 1 23322 23320 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810512eb5e20 0000000000000046 0000000055135cbd ffffffff8896fbe0 Mar 26 09:30:10 ALPL402 kernel: ffff8100a0278c00 000000000000000a ffff81044553b860 ffff81065527e820 Mar 26 09:30:10 ALPL402 kernel: 0002c1759f0b7d10 0000000000008875 ffff81044553ba48 0000000588999872 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_cancel_handler+0x308/0x690 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_cn_34 S ffff8106550f2120 0 23322 1 16186 23321 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff81058057de20 0000000000000046 00000000eb2b08a6 ffffffff8887b6d0 Mar 26 09:30:10 ALPL402 kernel: ffff8105ebfacc50 000000000000000a ffff8104caa81080 ffff8106552de860 Mar 26 09:30:10 ALPL402 kernel: 0002c1de35bd06e3 0000000000000b6e ffff8104caa81268 00000006c73bb9c0 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :lnet:LNetMDAttach+0x370/0x4b0 Mar 26 09:30:10 ALPL402 kernel: [] __mod_timer+0xff/0x10e Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_post_idle_rqbds+0x38/0xe0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_95 S ffff81000101d7a0 0 16186 1 16187 23322 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810b10947ea0 0000000000000046 ffff8101b25dfc00 ffff810620073398 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810b597f5100 ffff8106551987a0 Mar 26 09:30:10 ALPL402 kernel: 0002c124a77b5294 0000000000005ef3 ffff810b597f52e8 0000000300000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ldiskfs:ldiskfs_destroy_inode+0x0/0x90 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_96 S ffff8106550e1420 0 16187 1 3827 16186 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810333d73ea0 0000000000000046 ffff8109ac1b5c00 ffff8107b6eaa098 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8103ffe0c7e0 ffff8106552227e0 Mar 26 09:30:10 ALPL402 kernel: 0002c1171ac53a1a 000000000000529d ffff8103ffe0c9c8 0000000400000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_97 S ffff810001004420 0 3827 1 3828 16187 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810182825ea0 0000000000000046 ffff810a9ae73600 ffff8106ac9c1a98 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff81049e9f37a0 ffffffff8031db60 Mar 26 09:30:10 ALPL402 kernel: 0002c116d0b577df 000000000000a2da ffff81049e9f3988 0000000000000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] filp_close+0x5c/0x64 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_98 S ffff8106550e9aa0 0 3828 1 5484 3827 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8109799adea0 0000000000000046 ffff8105606e4600 ffff810620073398 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810b7e3ab100 ffff81065527e820 Mar 26 09:30:10 ALPL402 kernel: 0002c124a798b053 00000000000084fc ffff810b7e3ab2e8 000000050000003b Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_99 S ffff8106550f2120 0 5484 1 5485 3828 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810339bb9ea0 0000000000000046 ffff8104eac3be00 ffff81055debbe98 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff81030adaf860 ffff8106552de860 Mar 26 09:30:10 ALPL402 kernel: 0002c122fb839537 000000000000bab5 ffff81030adafa48 0000000600000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_100 S ffff8106550e9aa0 0 5485 1 5506 5484 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8105b818bea0 0000000000000046 ffff81072cbc7a00 ffff8106a9fcfe98 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8101e568c080 ffff81065527e820 Mar 26 09:30:10 ALPL402 kernel: 0002c120786cdc62 0000000000005b98 ffff8101e568c268 0000000500000286 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_101 S ffff8105efcde080 0 5506 1 5507 5485 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810319ad3ea0 0000000000000046 ffff810a9ae73c00 ffff8106ac9c1a98 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff81057651b820 ffff8105efcde080 Mar 26 09:30:10 ALPL402 kernel: 0002c116d0b34cd2 00000000000070c1 ffff81057651ba08 0000000600000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_handle_bl_callback+0x1c8/0x230 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_102 S ffff8106550e1420 0 5507 1 5508 5506 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810aa938fea0 0000000000000046 ffff8109fe3cfc00 ffff810b8035e8d8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810b81178820 ffff8106552227e0 Mar 26 09:30:10 ALPL402 kernel: 0002c11a5545d077 00000000000075c9 ffff810b81178a08 0000000400000286 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_103 S ffff8106550fa7a0 0 5508 1 5509 5507 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810805d65ea0 0000000000000046 ffff81045c3b0a00 ffff81030c3b9b98 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810a503687e0 ffff8106553247a0 Mar 26 09:30:10 ALPL402 kernel: 0002c116b1ff108f 0000000000008e42 ffff810a503689c8 0000000700000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_104 S ffff8106550e9aa0 0 5509 1 5510 5508 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8108389f7ea0 0000000000000046 ffff81088f255a00 ffff8109f42badd8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8108561977e0 ffff81065527e820 Mar 26 09:30:10 ALPL402 kernel: 0002c11ca75a0e00 000000000000b152 ffff8108561979c8 0000000500000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_105 S ffff8106550f2120 0 5510 1 5511 5509 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8101e455fea0 0000000000000046 ffff810a76a24e00 ffff810aa9db2e98 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8101e568c7e0 ffff8106552de860 Mar 26 09:30:10 ALPL402 kernel: 0002c11a1fd150e7 0000000000005402 ffff8101e568c9c8 0000000600000286 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_106 S ffff810001004420 0 5511 1 5512 5510 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810631811ea0 0000000000000046 ffff810b15903800 ffff810aac8538d8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff81022117b820 ffffffff8031db60 Mar 26 09:30:10 ALPL402 kernel: 0002c116961d4e3b 00000000000090da ffff81022117ba08 0000000000000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_107 S ffff8106550e9aa0 0 5512 1 5513 5511 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8107b629fea0 0000000000000046 ffff810b97ac5800 ffff810804d379d8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810b805d77a0 ffff81065527e820 Mar 26 09:30:10 ALPL402 kernel: 0002c124a79b0191 00000000000050be ffff810b805d7988 0000000500000286 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :obdclass:class_handle_free_cb+0x0/0x110 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] dummy_inode_permission+0x0/0x3 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_108 S ffff8106550e1420 0 5513 1 5514 5512 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810a280a5ea0 0000000000000046 ffff810ada209a00 ffff81066ae047d8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810267d0c080 ffff8106552227e0 Mar 26 09:30:10 ALPL402 kernel: 0002c11ca790a1d9 000000000000af32 ffff810267d0c268 0000000400000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_109 S ffff810001004420 0 5514 1 5515 5513 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810b98879ea0 0000000000000046 ffff810803896a00 ffff8106f74887d8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106a14f0860 ffffffff8031db60 Mar 26 09:30:10 ALPL402 kernel: 0002c11b195b359c 000000000000bd26 ffff8106a14f0a48 0000000000000286 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_110 S ffff8106550e1420 0 5515 1 5516 5514 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8108441c9ea0 0000000000000046 ffff8106c7007000 ffff81027067b398 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff81024b1050c0 ffff8106552227e0 Mar 26 09:30:10 ALPL402 kernel: 0002c116b218402a 0000000000007504 ffff81024b1052a8 0000000400000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_111 S ffff8106550f2120 0 5516 1 5517 5515 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810807b87ea0 0000000000000046 ffff81080f31c600 ffff810953d967d8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810c3a4b0040 ffff8106552de860 Mar 26 09:30:10 ALPL402 kernel: 0002c11ecbe9f398 00000000000055c4 ffff810c3a4b0228 0000000600000282 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_112 S ffff8106550e9aa0 0 5517 1 5518 5516 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff8109e9599ea0 0000000000000046 ffff8102ffd3d400 ffff81016a906cd8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810b7f878100 ffff81065527e820 Mar 26 09:30:10 ALPL402 kernel: 0002c1206be73d2f 000000000000918e ffff810b7f8782e8 0000000500000286 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:10 ALPL402 kernel: ldlm_bl_113 S ffff81000101d7a0 0 5518 1 5519 5517 (L-TLB) Mar 26 09:30:10 ALPL402 kernel: ffff810549bddea0 0000000000000046 ffff8104a0cf5000 ffff8103221628d8 Mar 26 09:30:10 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8103eb025860 ffff8106551987a0 Mar 26 09:30:10 ALPL402 kernel: 0002c1181b839b20 000000000000954f ffff8103eb025a48 00000003000000b0 Mar 26 09:30:10 ALPL402 kernel: Call Trace: Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:10 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:10 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:10 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:10 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: ldlm_bl_114 S ffff81000100caa0 0 5519 1 5520 5518 (L-TLB) Mar 26 09:30:11 ALPL402 kernel: ffff8108d7d29ea0 0000000000000046 ffff81072b466a00 ffff81071c74cc98 Mar 26 09:30:11 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810b597f5860 ffff810640047820 Mar 26 09:30:11 ALPL402 kernel: 0002c11a21ff73fd 00000000000077d7 ffff810b597f5a48 0000000100000286 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: ldlm_bl_115 S ffff810001004420 0 5520 1 5521 5519 (L-TLB) Mar 26 09:30:11 ALPL402 kernel: ffff810aa8b2fea0 0000000000000046 ffff810b3a436400 ffff810c3ab320d8 Mar 26 09:30:11 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8106e9d3d100 ffffffff8031db60 Mar 26 09:30:11 ALPL402 kernel: 0002c1194603363a 000000000000b419 ffff8106e9d3d2e8 0000000000000286 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: ldlm_bl_116 S ffff8106550e9aa0 0 5521 1 5522 5520 (L-TLB) Mar 26 09:30:11 ALPL402 kernel: ffff81092caedea0 0000000000000046 ffff810ac9312e00 ffff8106d145b1d8 Mar 26 09:30:11 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810c385eb860 ffff81065527e820 Mar 26 09:30:11 ALPL402 kernel: 0002c124a810b44e 0000000000004bfc ffff810c385eba48 0000000500000282 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:11 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: ldlm_bl_117 S ffff81000101d7a0 0 5522 1 5523 5521 (L-TLB) Mar 26 09:30:11 ALPL402 kernel: ffff81087c483ea0 0000000000000046 ffff810a79928600 ffff810aac853dd8 Mar 26 09:30:11 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff81078ac3f7a0 ffff8106551987a0 Mar 26 09:30:11 ALPL402 kernel: 0002c11f4e6a6100 0000000000009107 ffff81078ac3f988 00000003000000b0 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: ldlm_bl_118 S ffff81000101d7a0 0 5523 1 5524 5522 (L-TLB) Mar 26 09:30:11 ALPL402 kernel: ffff81074619bea0 0000000000000046 ffff8109ac1b5600 ffff810c323da698 Mar 26 09:30:11 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810b7e03d0c0 ffff8106551987a0 Mar 26 09:30:11 ALPL402 kernel: 0002c1188ad89faf 000000000000aa07 ffff810b7e03d2a8 0000000300000282 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:11 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: ldlm_bl_119 S ffff8106550fa7a0 0 5524 1 5525 5523 (L-TLB) Mar 26 09:30:11 ALPL402 kernel: ffff810bae0e7ea0 0000000000000046 ffff810a055c7400 ffff810c39178ed8 Mar 26 09:30:11 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8108415697a0 ffff8106553247a0 Mar 26 09:30:11 ALPL402 kernel: 0002c11f636a1ffc 0000000000007b1e ffff810841569988 0000000700000282 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:11 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: ldlm_bl_120 S ffff81000101d7a0 0 5525 1 5526 5524 (L-TLB) Mar 26 09:30:11 ALPL402 kernel: ffff8107baec9ea0 0000000000000046 ffff810a1f637000 ffff810c38c119d8 Mar 26 09:30:11 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810b8386c860 ffff8106551987a0 Mar 26 09:30:11 ALPL402 kernel: 0002c127e3cb764a 000000000000be6d ffff810b8386ca48 0000000300000282 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: ldlm_bl_121 S ffff81000100caa0 0 5526 1 5527 5525 (L-TLB) Mar 26 09:30:11 ALPL402 kernel: ffff810b332cdea0 0000000000000046 ffff810a9ae73200 ffff81027067bb98 Mar 26 09:30:11 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810b4ddb07a0 ffff810640047820 Mar 26 09:30:11 ALPL402 kernel: 0002c116b25a5d6f 000000000000b051 ffff810b4ddb0988 0000000100000286 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: ldlm_bl_122 S ffff8106550e1420 0 5527 1 5528 5526 (L-TLB) Mar 26 09:30:11 ALPL402 kernel: ffff8107f58bfea0 0000000000000046 ffff810ba93d6000 ffff810b4f95f898 Mar 26 09:30:11 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff81095addb7e0 ffff8106552227e0 Mar 26 09:30:11 ALPL402 kernel: 0002c118c666f3d0 0000000000009988 ffff81095addb9c8 0000000400000282 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: ldlm_bl_123 S ffff8106550e9aa0 0 5528 1 5531 5527 (L-TLB) Mar 26 09:30:11 ALPL402 kernel: ffff8107e0317ea0 0000000000000046 ffff810623531e00 ffff810528ed59d8 Mar 26 09:30:11 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff81095addb080 ffff81065527e820 Mar 26 09:30:11 ALPL402 kernel: 0002c11733619395 00000000000085ce ffff81095addb268 0000000500000286 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: ldlm_bl_124 S ffff8106550e1420 0 5531 1 5532 5528 (L-TLB) Mar 26 09:30:11 ALPL402 kernel: ffff810949f61ea0 0000000000000046 ffff810a62185e00 ffff8106eb2b9e98 Mar 26 09:30:11 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8108b57b10c0 ffff8106552227e0 Mar 26 09:30:11 ALPL402 kernel: 0002c120720665fc 0000000000004ec4 ffff8108b57b12a8 0000000400000286 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: ldlm_bl_125 S ffff810001004420 0 5532 1 5533 5531 (L-TLB) Mar 26 09:30:11 ALPL402 kernel: ffff810904bb1ea0 0000000000000046 ffff810b02a37e00 ffff81098f421498 Mar 26 09:30:11 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8108b57b1820 ffffffff8031db60 Mar 26 09:30:11 ALPL402 kernel: 0002c124a7f9a1d1 0000000000008788 ffff8108b57b1a08 0000000000000282 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:11 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: ldlm_bl_126 S ffff8106550fa7a0 0 5533 1 5534 5532 (L-TLB) Mar 26 09:30:11 ALPL402 kernel: ffff8106d7425ea0 0000000000000046 ffff810a539dba00 ffff8109f42ba0d8 Mar 26 09:30:11 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff810aa4dae860 ffff8106553247a0 Mar 26 09:30:11 ALPL402 kernel: 0002c121bd90032c 00000000000053a9 ffff810aa4daea48 0000000732fce6c0 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:11 ALPL402 kernel: [] generic_drop_inode+0x0/0x159 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: ldlm_bl_127 S ffff81000100caa0 0 5534 1 15736 5533 (L-TLB) Mar 26 09:30:11 ALPL402 kernel: ffff810212b43ea0 0000000000000046 ffff810b3a436e00 ffff810aa9db2e98 Mar 26 09:30:11 ALPL402 kernel: ffff8105eb380268 000000000000000a ffff8103eb025100 ffff810640047820 Mar 26 09:30:11 ALPL402 kernel: 0002c11a1fead935 0000000000009241 ffff8103eb0252e8 0000000100000286 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:lock_res_and_lock+0xba/0xd0 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x19b/0x410 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_bl_thread_main+0x0/0x410 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: ldlm_cn_35 S ffff8106550e1420 0 15736 1 15737 5534 (L-TLB) Mar 26 09:30:11 ALPL402 kernel: ffff810336685e20 0000000000000046 00000000eb2d4152 ffffffff8887b6d0 Mar 26 09:30:11 ALPL402 kernel: ffff8105ebfac450 000000000000000a ffff81061f4a5100 ffff8106552227e0 Mar 26 09:30:11 ALPL402 kernel: 0002c17d730aa62b 000000000000e71d ffff81061f4a52e8 00000004ebfac428 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] :lnet:LNetMDAttach+0x370/0x4b0 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_post_idle_rqbds+0x38/0xe0 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: ldlm_cn_36 S ffff8106550f2120 0 15737 1 8708 15736 (L-TLB) Mar 26 09:30:11 ALPL402 kernel: ffff81089794de20 0000000000000046 0000000055135c65 ffffffff8896fbe0 Mar 26 09:30:11 ALPL402 kernel: ffff810468c62c00 000000000000000a ffff8106aecc4100 ffff8106552de860 Mar 26 09:30:11 ALPL402 kernel: 0002c1613c6ecd21 0000000000007464 ffff8106aecc42e8 0000000688999872 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_cancel_handler+0x308/0x690 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: ldlm_cn_38 S ffff8106550f2120 0 8708 1 8709 15737 (L-TLB) Mar 26 09:30:11 ALPL402 kernel: ffff8101cff51e20 0000000000000046 0000000055136099 ffffffff8896fbe0 Mar 26 09:30:11 ALPL402 kernel: ffff81001f78c000 000000000000000a ffff81049e9f3040 ffff8106552de860 Mar 26 09:30:11 ALPL402 kernel: 0002c25b43982dbe 00000000000074ea ffff81049e9f3228 0000000688999872 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_cancel_handler+0x308/0x690 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: ldlm_cn_37 S ffff8106550f2120 0 8709 1 8710 8708 (L-TLB) Mar 26 09:30:11 ALPL402 kernel: ffff8102847f3e20 0000000000000046 0000000055135b62 ffffffff8896fbe0 Mar 26 09:30:11 ALPL402 kernel: ffff81008bfb2c00 000000000000000a ffff8103ffe0c080 ffff8106552de860 Mar 26 09:30:11 ALPL402 kernel: 0002c25b7f13e36a 00000000000009b9 ffff8103ffe0c268 0000000647897ec0 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:11 ALPL402 kernel: [] __mod_timer+0xff/0x10e Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:11 ALPL402 kernel: [] filp_close+0x5c/0x64 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: ldlm_cn_39 S ffff8106550f2120 0 8710 1 8711 8709 (L-TLB) Mar 26 09:30:11 ALPL402 kernel: ffff81026171be20 0000000000000046 0000000055135cbd ffffffff8896fbe0 Mar 26 09:30:11 ALPL402 kernel: ffff810016ae8800 000000000000000a ffff81057651b0c0 ffff8106552de860 Mar 26 09:30:11 ALPL402 kernel: 0002c1759f860b02 00000000000078f4 ffff81057651b2a8 0000000688999872 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_handle_cancel+0x230/0x2e0 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ldlm_cancel_handler+0x308/0x690 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:11 ALPL402 kernel: [] filp_close+0x5c/0x64 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: ldlm_cn_40 S ffff8106550f2120 0 8711 1 8710 (L-TLB) Mar 26 09:30:11 ALPL402 kernel: ffff81051a775e20 0000000000000046 00000000eb2ad8be ffffffff8887b6d0 Mar 26 09:30:11 ALPL402 kernel: ffff8105ebfac050 000000000000000a ffff8105d94737a0 ffff8106552de860 Mar 26 09:30:11 ALPL402 kernel: 0002c16177f2a6ba 00000000000007b1 ffff8105d9473988 000000061baaef40 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] :lnet:LNetMDAttach+0x370/0x4b0 Mar 26 09:30:11 ALPL402 kernel: [] __mod_timer+0xff/0x10e Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ptlrpc_wait_event+0x1f5/0x310 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ptlrpc_server_post_idle_rqbds+0x38/0xe0 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x3eb/0x10e0 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 09:30:11 ALPL402 kernel: [] :ptlrpc:ptlrpc_main+0x0/0x10e0 Mar 26 09:30:11 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: sshd S ffff81000101d7a0 0 9774 6198 9776 (NOTLB) Mar 26 09:30:11 ALPL402 kernel: ffff8100b37e5a28 0000000000000082 00000000000280d2 ffff810623805140 Mar 26 09:30:11 ALPL402 kernel: 0000000000000202 000000000000000a ffff8100aaf7b080 ffff8106551987a0 Mar 26 09:30:11 ALPL402 kernel: 0002c278b524000c 0000000000008d69 ffff8100aaf7b268 000000032c8c2000 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] schedule_timeout+0x1e/0xad Mar 26 09:30:11 ALPL402 kernel: [] tty_poll+0x5f/0x6d Mar 26 09:30:11 ALPL402 kernel: [] do_select+0x3dc/0x43c Mar 26 09:30:11 ALPL402 kernel: [] __pollwait+0x0/0xe2 Mar 26 09:30:11 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 09:30:11 ALPL402 last message repeated 3 times Mar 26 09:30:11 ALPL402 kernel: [] sk_reset_timer+0xf/0x19 Mar 26 09:30:11 ALPL402 kernel: [] __tcp_push_pending_frames+0x776/0x850 Mar 26 09:30:11 ALPL402 kernel: [] __alloc_skb+0x77/0x12e Mar 26 09:30:11 ALPL402 kernel: [] _spin_lock_bh+0x9/0x14 Mar 26 09:30:11 ALPL402 kernel: [] release_sock+0x13/0xbe Mar 26 09:30:11 ALPL402 kernel: [] tcp_sendmsg+0xa03/0xb07 Mar 26 09:30:11 ALPL402 kernel: [] do_sock_write+0xc6/0x102 Mar 26 09:30:11 ALPL402 kernel: [] core_sys_select+0x1bc/0x265 Mar 26 09:30:11 ALPL402 kernel: [] remove_wait_queue+0x1c/0x2c Mar 26 09:30:11 ALPL402 kernel: [] do_sync_write+0xc7/0x104 Mar 26 09:30:11 ALPL402 kernel: [] read_chan+0x626/0x694 Mar 26 09:30:11 ALPL402 kernel: [] autoremove_wake_function+0x0/0x2e Mar 26 09:30:11 ALPL402 kernel: [] tty_ldisc_deref+0x6a/0x7d Mar 26 09:30:11 ALPL402 kernel: [] sys_select+0xc1/0x17c Mar 26 09:30:11 ALPL402 kernel: [] tracesys+0xd5/0xdf Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:30:11 ALPL402 kernel: bash R running task 0 9776 9774 (NOTLB) Mar 26 09:30:11 ALPL402 kernel: 7379736563617274 0066657265007400 ffff8100213abcf8 0000000000000002 Mar 26 09:30:11 ALPL402 kernel: ffff81052dff80c0 0000000000000005 ffff810115eeffc0 ffffffff8009495c Mar 26 09:30:11 ALPL402 kernel: 0000003000000008 ffff8100213abe18 ffff8100213abd48 0000000000000000 Mar 26 09:30:11 ALPL402 kernel: Call Trace: Mar 26 09:30:11 ALPL402 kernel: [] printk+0x52/0xbd Mar 26 09:30:11 ALPL402 kernel: [] printk+0x52/0xbd Mar 26 09:30:11 ALPL402 kernel: [] module_text_address+0x33/0x3c Mar 26 09:30:11 ALPL402 kernel: [] kernel_text_address+0x1a/0x26 Mar 26 09:30:11 ALPL402 kernel: [] dump_trace+0x206/0x22f Mar 26 09:30:11 ALPL402 kernel: [] show_trace+0x34/0x47 Mar 26 09:30:11 ALPL402 kernel: [] _show_stack+0xdb/0xea Mar 26 09:30:11 ALPL402 kernel: [] show_state+0x48/0x86 Mar 26 09:30:11 ALPL402 kernel: [] __handle_sysrq+0x90/0x121 Mar 26 09:30:11 ALPL402 kernel: [] write_sysrq_trigger+0x2a/0x32 Mar 26 09:30:11 ALPL402 kernel: [] proc_reg_write+0x7e/0x99 Mar 26 09:30:11 ALPL402 kernel: [] vfs_write+0xce/0x174 Mar 26 09:30:11 ALPL402 kernel: [] sys_write+0x45/0x6e Mar 26 09:30:11 ALPL402 kernel: [] tracesys+0xd5/0xdf Mar 26 09:30:11 ALPL402 kernel: Mar 26 09:31:39 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 26 09:32:03 ALPL402 kernel: LustreError: 14284:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-16) req@ffff810536e7b850 x1496539379429697/t0 o8->187efe83-f4f3-6400-8b50-c74013904ce9@:0/0 lens 368/264 e 0 to 0 dl 1427333673 ref 1 fl Interpret:/0/0 rc -16/0 Mar 26 09:32:03 ALPL402 kernel: LustreError: 14284:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 6273 previous similar messages Mar 26 09:33:00 ALPL402 kernel: Lustre: 14389:0:(ldlm_lib.c:805:target_handle_connect()) LFS05-OST0057: exp ffff8105ea8d4c00 already connecting Mar 26 09:33:00 ALPL402 kernel: Lustre: 14389:0:(ldlm_lib.c:805:target_handle_connect()) Skipped 105 previous similar messages Mar 26 09:33:18 ALPL402 kernel: Lustre: 18717:0:(service.c:812:ptlrpc_at_send_early_reply()) @@@ Couldn't add any time (5/-521), not sending early reply Mar 26 09:33:18 ALPL402 kernel: req@ffff81007879fc00 x1479280819640100/t0 o6->23861136-bc57-c7c0-4a93-c349fb5ead33@:0/0 lens 512/0 e 1 to 0 dl 1427333603 ref 2 fl New:/0/0 rc 0/0 Mar 26 09:33:18 ALPL402 kernel: Lustre: 18717:0:(service.c:812:ptlrpc_at_send_early_reply()) Skipped 271 previous similar messages Mar 26 09:33:31 ALPL402 kernel: Lustre: 14393:0:(ldlm_lib.c:576:target_handle_reconnect()) LFS05-OST0057: 071c0559-7fe1-4a74-db55-0c36554c578f reconnecting Mar 26 09:33:31 ALPL402 kernel: Lustre: 14393:0:(ldlm_lib.c:576:target_handle_reconnect()) Skipped 5408 previous similar messages Mar 26 09:34:13 ALPL402 kernel: Lustre: 13604:0:(ldlm_lib.c:876:target_handle_connect()) LFS05-OST0057: refuse reconnection from 16c86467-56d4-23bc-13dd-4ed53667d576@10.3.3.11@o2ib to 0xffff810bac60e000; still busy with 8 active RPCs Mar 26 09:34:13 ALPL402 kernel: Lustre: 13604:0:(ldlm_lib.c:876:target_handle_connect()) Skipped 5288 previous similar messages Mar 26 09:35:29 ALPL402 kernel: SysRq : Emergency Sync Mar 26 09:37:25 ALPL402 syslogd 1.4.1: restart. Mar 26 09:37:25 ALPL402 kernel: klogd 1.4.1, log source = /proc/kmsg started. Mar 26 09:37:25 ALPL402 kernel: Linux version 2.6.18-348.3.1.el5_lustre.1.8.9.ddn8 (root@build07) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-54)) #1 SMP Thu Feb 12 14:53:40 JST 2015 Mar 26 09:37:25 ALPL402 kernel: Command line: ro root=/dev/md2 rhgb quiet Mar 26 09:37:25 ALPL402 kernel: BIOS-provided physical RAM map: Mar 26 09:37:25 ALPL402 kernel: BIOS-e820: 0000000000010000 - 0000000000098400 (usable) Mar 26 09:37:25 ALPL402 kernel: BIOS-e820: 0000000000098400 - 00000000000a0000 (reserved) Mar 26 09:37:25 ALPL402 kernel: BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved) Mar 26 09:37:25 ALPL402 kernel: BIOS-e820: 0000000000100000 - 00000000bf780000 (usable) Mar 26 09:37:25 ALPL402 kernel: BIOS-e820: 00000000bf78e000 - 00000000bf790000 type 9 Mar 26 09:37:25 ALPL402 kernel: BIOS-e820: 00000000bf790000 - 00000000bf79e000 (ACPI data) Mar 26 09:37:25 ALPL402 kernel: BIOS-e820: 00000000bf79e000 - 00000000bf7d0000 (ACPI NVS) Mar 26 09:37:25 ALPL402 kernel: BIOS-e820: 00000000bf7d0000 - 00000000bf7e0000 (reserved) Mar 26 09:37:25 ALPL402 kernel: BIOS-e820: 00000000bf7ec000 - 00000000c0000000 (reserved) Mar 26 09:37:25 ALPL402 kernel: BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved) Mar 26 09:37:25 ALPL402 kernel: BIOS-e820: 00000000fed20000 - 00000000fed40000 (reserved) Mar 26 09:37:25 ALPL402 kernel: BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved) Mar 26 09:37:25 ALPL402 kernel: BIOS-e820: 00000000ffc00000 - 0000000100000000 (reserved) Mar 26 09:37:25 ALPL402 kernel: BIOS-e820: 0000000100000000 - 0000000c40000000 (usable) Mar 26 09:37:25 ALPL402 kernel: DMI present. Mar 26 09:37:25 ALPL402 kernel: SRAT: PXM 0 -> APIC 0 -> Node 0 Mar 26 09:37:25 ALPL402 kernel: SRAT: PXM 0 -> APIC 2 -> Node 0 Mar 26 09:37:25 ALPL402 kernel: SRAT: PXM 0 -> APIC 18 -> Node 0 Mar 26 09:37:25 ALPL402 kernel: SRAT: PXM 0 -> APIC 20 -> Node 0 Mar 26 09:37:25 ALPL402 kernel: SRAT: PXM 1 -> APIC 32 -> Node 1 Mar 26 09:37:25 ALPL402 kernel: SRAT: PXM 1 -> APIC 34 -> Node 1 Mar 26 09:37:25 ALPL402 kernel: SRAT: PXM 1 -> APIC 50 -> Node 1 Mar 26 09:37:25 ALPL402 kernel: SRAT: PXM 1 -> APIC 52 -> Node 1 Mar 26 09:37:25 ALPL402 kernel: SRAT: Node 0 PXM 0 0-a0000 Mar 26 09:37:25 ALPL402 kernel: SRAT: Node 0 PXM 0 0-c0000000 Mar 26 09:37:25 ALPL402 kernel: SRAT: Node 0 PXM 0 0-640000000 Mar 26 09:37:25 ALPL402 kernel: SRAT: Node 1 PXM 1 640000000-c40000000 Mar 26 09:37:25 ALPL402 kernel: Bootmem setup node 0 0000000000000000-0000000640000000 Mar 26 09:37:25 ALPL402 kernel: Bootmem setup node 1 0000000640000000-0000000c40000000 Mar 26 09:37:25 ALPL402 kernel: Memory for crash kernel (0x0 to 0x0) notwithin permissible range Mar 26 09:37:25 ALPL402 kernel: disabling kdump Mar 26 09:37:25 ALPL402 kernel: ACPI: PM-Timer IO Port: 0x808 Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled) Mar 26 09:37:25 ALPL402 kernel: Processor #0 6:12 APIC version 21 Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled) Mar 26 09:37:25 ALPL402 kernel: Processor #2 6:12 APIC version 21 Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x03] lapic_id[0x12] enabled) Mar 26 09:37:25 ALPL402 kernel: Processor #18 6:12 APIC version 21 Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x04] lapic_id[0x14] enabled) Mar 26 09:37:25 ALPL402 kernel: Processor #20 6:12 APIC version 21 Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x05] lapic_id[0x20] enabled) Mar 26 09:37:25 ALPL402 kernel: Processor #32 6:12 APIC version 21 Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x06] lapic_id[0x22] enabled) Mar 26 09:37:25 ALPL402 kernel: Processor #34 6:12 APIC version 21 Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x07] lapic_id[0x32] enabled) Mar 26 09:37:25 ALPL402 kernel: Processor #50 6:12 APIC version 21 Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x08] lapic_id[0x34] enabled) Mar 26 09:37:25 ALPL402 kernel: Processor #52 6:12 APIC version 21 Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x09] lapic_id[0x88] disabled) Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x89] disabled) Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x8a] disabled) Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x8b] disabled) Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x8c] disabled) Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x8d] disabled) Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x8e] disabled) Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x10] lapic_id[0x8f] disabled) Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x11] lapic_id[0x90] disabled) Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x12] lapic_id[0x91] disabled) Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x13] lapic_id[0x92] disabled) Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x14] lapic_id[0x93] disabled) Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x15] lapic_id[0x94] disabled) Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x16] lapic_id[0x95] disabled) Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x17] lapic_id[0x96] disabled) Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC (acpi_id[0x18] lapic_id[0x97] disabled) Mar 26 09:37:25 ALPL402 kernel: ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) Mar 26 09:37:25 ALPL402 kernel: ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0]) Mar 26 09:37:25 ALPL402 kernel: IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 Mar 26 09:37:25 ALPL402 kernel: ACPI: IOAPIC (id[0x03] address[0xfec8a000] gsi_base[24]) Mar 26 09:37:25 ALPL402 kernel: IOAPIC[1]: apic_id 3, version 32, address 0xfec8a000, GSI 24-47 Mar 26 09:37:25 ALPL402 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) Mar 26 09:37:25 ALPL402 kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Mar 26 09:37:25 ALPL402 kernel: Setting APIC routing to physical flat Mar 26 09:37:25 ALPL402 kernel: ACPI: HPET id: 0x8086a301 base: 0xfed00000 Mar 26 09:37:25 ALPL402 cpuspeed: Enabling ondemand cpu frequency scaling governor Mar 26 09:37:25 ALPL402 kernel: Using ACPI (MADT) for SMP configuration information Mar 26 09:37:25 ALPL402 kernel: Nosave address range: 0000000000098000 - 0000000000099000 Mar 26 09:37:25 ALPL402 kernel: Nosave address range: 0000000000099000 - 00000000000a0000 Mar 26 09:37:25 ALPL402 kernel: Nosave address range: 00000000000a0000 - 00000000000e0000 Mar 26 09:37:25 ALPL402 kernel: Nosave address range: 00000000000e0000 - 0000000000100000 Mar 26 09:37:25 ALPL402 kernel: Nosave address range: 00000000bf780000 - 00000000bf78e000 Mar 26 09:37:25 ALPL402 kernel: Nosave address range: 00000000bf78e000 - 00000000bf790000 Mar 26 09:37:25 ALPL402 kernel: Nosave address range: 00000000bf790000 - 00000000bf79e000 Mar 26 09:37:25 ALPL402 kernel: Nosave address range: 00000000bf79e000 - 00000000bf7d0000 Mar 26 09:37:25 ALPL402 kernel: Nosave address range: 00000000bf7d0000 - 00000000bf7e0000 Mar 26 09:37:25 ALPL402 kernel: Nosave address range: 00000000bf7e0000 - 00000000bf7ec000 Mar 26 09:37:25 ALPL402 kernel: Nosave address range: 00000000bf7ec000 - 00000000c0000000 Mar 26 09:37:25 ALPL402 kernel: Nosave address range: 00000000c0000000 - 00000000e0000000 Mar 26 09:37:25 ALPL402 kernel: Nosave address range: 00000000e0000000 - 00000000f0000000 Mar 26 09:37:25 ALPL402 kernel: Nosave address range: 00000000f0000000 - 00000000fed20000 Mar 26 09:37:25 ALPL402 kernel: Nosave address range: 00000000fed20000 - 00000000fed40000 Mar 26 09:37:25 ALPL402 kernel: Nosave address range: 00000000fed40000 - 00000000fee00000 Mar 26 09:37:25 ALPL402 kernel: Nosave address range: 00000000fee00000 - 00000000fee01000 Mar 26 09:37:25 ALPL402 kernel: Nosave address range: 00000000fee01000 - 00000000ffc00000 Mar 26 09:37:25 ALPL402 kernel: Nosave address range: 00000000ffc00000 - 0000000100000000 Mar 26 09:37:25 ALPL402 kernel: Allocating PCI resources starting at c2000000 (gap: c0000000:20000000) Mar 26 09:37:25 ALPL402 kernel: SMP: Allowing 24 CPUs, 16 hotplug CPUs Mar 26 09:37:25 ALPL402 kernel: Built 2 zonelists. Total pages: 12403446 Mar 26 09:37:25 ALPL402 kernel: Kernel command line: ro root=/dev/md2 rhgb quiet Mar 26 09:37:25 ALPL402 kernel: Initializing CPU#0 Mar 26 09:37:25 ALPL402 kernel: PID hash table entries: 4096 (order: 12, 32768 bytes) Mar 26 09:37:25 ALPL402 kernel: Console: colour VGA+ 80x25 Mar 26 09:37:25 ALPL402 kernel: Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes) Mar 26 09:37:25 ALPL402 kernel: Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes) Mar 26 09:37:25 ALPL402 kernel: Checking aperture... Mar 26 09:37:25 ALPL402 kernel: ACPI: DMAR not present Mar 26 09:37:25 ALPL402 kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB) Mar 26 09:37:25 ALPL402 kernel: Placing software IO TLB between 0x707f000 - 0xb07f000 Mar 26 09:37:25 ALPL402 kernel: Memory: 49445472k/51380224k available (2629k kernel code, 876992k reserved, 1680k data, 224k init) Mar 26 09:37:25 ALPL402 kernel: Calibrating delay loop (skipped), value calculated using timer frequency.. 4800.29 BogoMIPS (lpj=2400147) Mar 26 09:37:25 ALPL402 kernel: Security Framework v1.0.0 initialized Mar 26 09:37:25 ALPL402 kernel: SELinux: Initializing. Mar 26 09:37:25 ALPL402 kernel: selinux_register_security: Registering secondary module capability Mar 26 09:37:25 ALPL402 kernel: Capability LSM initialized as secondary Mar 26 09:37:25 ALPL402 kernel: Mount-cache hash table entries: 256 Mar 26 09:37:25 ALPL402 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K Mar 26 09:37:25 ALPL402 kernel: CPU: L2 cache: 256K Mar 26 09:37:25 ALPL402 kernel: CPU: L3 cache: 12288K Mar 26 09:37:25 ALPL402 kernel: CPU 0/0 -> Node 0 Mar 26 09:37:25 ALPL402 kernel: using mwait in idle threads. Mar 26 09:37:25 ALPL402 kernel: CPU: Physical Processor ID: 0 Mar 26 09:37:25 ALPL402 kernel: CPU: Processor Core ID: 0 Mar 26 09:37:25 ALPL402 kernel: MCE: Machine Check Exception Reporting is disabled. Mar 26 09:37:25 ALPL402 kernel: SMP alternatives: switching to UP code Mar 26 09:37:25 ALPL402 kernel: ACPI: Core revision 20060707 Mar 26 09:37:25 ALPL402 kernel: Using local APIC timer interrupts. Mar 26 09:37:25 ALPL402 kernel: Detected 8.334 MHz APIC timer. Mar 26 09:37:25 ALPL402 kernel: SMP alternatives: switching to SMP code Mar 26 09:37:25 ALPL402 kernel: Booting processor 1/8 APIC 0x2 Mar 26 09:37:25 ALPL402 kernel: Initializing CPU#1 Mar 26 09:37:25 ALPL402 kernel: Calibrating delay using timer specific routine.. 4800.00 BogoMIPS (lpj=2400000) Mar 26 09:37:25 ALPL402 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K Mar 26 09:37:25 ALPL402 kernel: CPU: L2 cache: 256K Mar 26 09:37:25 ALPL402 kernel: CPU: L3 cache: 12288K Mar 26 09:37:25 ALPL402 kernel: CPU 1/2 -> Node 0 Mar 26 09:37:25 ALPL402 kernel: CPU: Physical Processor ID: 0 Mar 26 09:37:25 ALPL402 kernel: CPU: Processor Core ID: 1 Mar 26 09:37:25 ALPL402 kernel: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz stepping 02 Mar 26 09:37:25 ALPL402 kernel: SMP alternatives: switching to SMP code Mar 26 09:37:25 ALPL402 kernel: Booting processor 2/8 APIC 0x12 Mar 26 09:37:25 ALPL402 kernel: Initializing CPU#2 Mar 26 09:37:25 ALPL402 kernel: Calibrating delay using timer specific routine.. 4800.35 BogoMIPS (lpj=2400175) Mar 26 09:37:25 ALPL402 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K Mar 26 09:37:25 ALPL402 kernel: CPU: L2 cache: 256K Mar 26 09:37:25 ALPL402 kernel: CPU: L3 cache: 12288K Mar 26 09:37:25 ALPL402 kernel: CPU 2/12 -> Node 0 Mar 26 09:37:25 ALPL402 kernel: CPU: Physical Processor ID: 0 Mar 26 09:37:25 ALPL402 kernel: CPU: Processor Core ID: 9 Mar 26 09:37:25 ALPL402 kernel: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz stepping 02 Mar 26 09:37:25 ALPL402 kernel: SMP alternatives: switching to SMP code Mar 26 09:37:25 ALPL402 kernel: Booting processor 3/8 APIC 0x14 Mar 26 09:37:25 ALPL402 kernel: Initializing CPU#3 Mar 26 09:37:25 ALPL402 kernel: Calibrating delay using timer specific routine.. 4800.07 BogoMIPS (lpj=2400035) Mar 26 09:37:25 ALPL402 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K Mar 26 09:37:25 ALPL402 kernel: CPU: L2 cache: 256K Mar 26 09:37:25 ALPL402 kernel: CPU: L3 cache: 12288K Mar 26 09:37:25 ALPL402 kernel: CPU 3/14 -> Node 0 Mar 26 09:37:25 ALPL402 kernel: CPU: Physical Processor ID: 0 Mar 26 09:37:25 ALPL402 kernel: CPU: Processor Core ID: 10 Mar 26 09:37:25 ALPL402 kernel: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz stepping 02 Mar 26 09:37:25 ALPL402 kernel: SMP alternatives: switching to SMP code Mar 26 09:37:25 ALPL402 kernel: Booting processor 4/8 APIC 0x20 Mar 26 09:37:25 ALPL402 kernel: Initializing CPU#4 Mar 26 09:37:25 ALPL402 kernel: Calibrating delay using timer specific routine.. 4800.10 BogoMIPS (lpj=2400054) Mar 26 09:37:25 ALPL402 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K Mar 26 09:37:25 ALPL402 kernel: CPU: L2 cache: 256K Mar 26 09:37:25 ALPL402 kernel: CPU: L3 cache: 12288K Mar 26 09:37:25 ALPL402 kernel: CPU 4/20 -> Node 1 Mar 26 09:37:25 ALPL402 kernel: CPU: Physical Processor ID: 1 Mar 26 09:37:25 ALPL402 kernel: CPU: Processor Core ID: 0 Mar 26 09:37:25 ALPL402 kernel: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz stepping 02 Mar 26 09:37:25 ALPL402 kernel: SMP alternatives: switching to SMP code Mar 26 09:37:25 ALPL402 kernel: Booting processor 5/8 APIC 0x22 Mar 26 09:37:25 ALPL402 kernel: Initializing CPU#5 Mar 26 09:37:25 ALPL402 kernel: Calibrating delay using timer specific routine.. 4800.25 BogoMIPS (lpj=2400125) Mar 26 09:37:25 ALPL402 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K Mar 26 09:37:25 ALPL402 kernel: CPU: L2 cache: 256K Mar 26 09:37:25 ALPL402 kernel: CPU: L3 cache: 12288K Mar 26 09:37:25 ALPL402 kernel: CPU 5/22 -> Node 1 Mar 26 09:37:25 ALPL402 kernel: CPU: Physical Processor ID: 1 Mar 26 09:37:25 ALPL402 kernel: CPU: Processor Core ID: 1 Mar 26 09:37:25 ALPL402 kernel: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz stepping 02 Mar 26 09:37:25 ALPL402 kernel: SMP alternatives: switching to SMP code Mar 26 09:37:25 ALPL402 kernel: Booting processor 6/8 APIC 0x32 Mar 26 09:37:25 ALPL402 kernel: Initializing CPU#6 Mar 26 09:37:25 ALPL402 kernel: Calibrating delay using timer specific routine.. 4800.17 BogoMIPS (lpj=2400088) Mar 26 09:37:25 ALPL402 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K Mar 26 09:37:25 ALPL402 kernel: CPU: L2 cache: 256K Mar 26 09:37:25 ALPL402 kernel: CPU: L3 cache: 12288K Mar 26 09:37:25 ALPL402 kernel: CPU 6/32 -> Node 1 Mar 26 09:37:25 ALPL402 kernel: CPU: Physical Processor ID: 1 Mar 26 09:37:25 ALPL402 kernel: CPU: Processor Core ID: 9 Mar 26 09:37:25 ALPL402 kernel: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz stepping 02 Mar 26 09:37:25 ALPL402 kernel: SMP alternatives: switching to SMP code Mar 26 09:37:25 ALPL402 kernel: Booting processor 7/8 APIC 0x34 Mar 26 09:37:25 ALPL402 kernel: Initializing CPU#7 Mar 26 09:37:25 ALPL402 kernel: Calibrating delay using timer specific routine.. 4800.11 BogoMIPS (lpj=2400055) Mar 26 09:37:25 ALPL402 kernel: CPU: L1 I cache: 32K, L1 D cache: 32K Mar 26 09:37:25 ALPL402 kernel: CPU: L2 cache: 256K Mar 26 09:37:25 ALPL402 kernel: CPU: L3 cache: 12288K Mar 26 09:37:25 ALPL402 kernel: CPU 7/34 -> Node 1 Mar 26 09:37:25 ALPL402 kernel: CPU: Physical Processor ID: 1 Mar 26 09:37:25 ALPL402 kernel: CPU: Processor Core ID: 10 Mar 26 09:37:25 ALPL402 kernel: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz stepping 02 Mar 26 09:37:25 ALPL402 kernel: Brought up 8 CPUs Mar 26 09:37:25 ALPL402 kernel: NMI watchdog testing PASSED. Mar 26 09:37:25 ALPL402 kernel: time.c: Using 14.318180 MHz WALL HPET GTOD HPET/TSC timer. Mar 26 09:37:25 ALPL402 kernel: time.c: Detected 2400.147 MHz processor. Mar 26 09:37:25 ALPL402 kernel: migration_cost=25,1428 Mar 26 09:37:25 ALPL402 kernel: checking if image is initramfs... it is Mar 26 09:37:25 ALPL402 kernel: Freeing initrd memory: 2713k freed Mar 26 09:37:25 ALPL402 kernel: NET: Registered protocol family 16 Mar 26 09:37:25 ALPL402 kernel: ACPI: bus type pci registered Mar 26 09:37:25 ALPL402 kernel: PCI: Using MMCONFIG at e0000000 Mar 26 09:37:25 ALPL402 kernel: ACPI: Interpreter enabled Mar 26 09:37:25 ALPL402 kernel: ACPI: Using IOAPIC for interrupt routing Mar 26 09:37:25 ALPL402 kernel: ACPI: No dock devices found. Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Root Bridge [PCI0] (0000:00) Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:01.0: PCI bridge to [bus 01-01] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:03.0: PCI bridge to [bus 02-02] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:05.0: PCI bridge to [bus 03-03] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:07.0: PCI bridge to [bus 04-04] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:1c.0: PCI bridge to [bus 07-08] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:1c.4: PCI bridge to [bus 05-06] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:1e.0: PCI bridge to [bus 09-09] (subtractive decode) Mar 26 09:37:25 ALPL402 kernel: bus 0 -> pxm 0 -> node 0 Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 6 7 *10 11 12 14 15) Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 6 7 10 11 12 14 *15) Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 6 7 10 *11 12 14 15) Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 6 7 10 11 12 *14 15) Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 6 7 10 11 12 14 15) *0, disabled. Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 6 *7 10 11 12 14 15) Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 6 7 10 11 12 14 15) *0, disabled. Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 *6 7 10 11 12 14 15) Mar 26 09:37:25 ALPL402 kernel: Linux Plug and Play Support v0.97 (c) Adam Belay Mar 26 09:37:25 ALPL402 kernel: pnp: PnP ACPI init Mar 26 09:37:25 ALPL402 kernel: pnp: PnP ACPI: found 14 devices Mar 26 09:37:25 ALPL402 kernel: usbcore: registered new driver usbfs Mar 26 09:37:25 ALPL402 kernel: usbcore: registered new driver hub Mar 26 09:37:25 ALPL402 kernel: PCI: Using ACPI for IRQ routing Mar 26 09:37:25 ALPL402 kernel: PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a report Mar 26 09:37:25 ALPL402 kernel: NetLabel: Initializing Mar 26 09:37:25 ALPL402 kernel: NetLabel: domain hash size = 128 Mar 26 09:37:25 ALPL402 kernel: NetLabel: protocols = UNLABELED CIPSOv4 Mar 26 09:37:25 ALPL402 kernel: NetLabel: unlabeled traffic allowed by default Mar 26 09:37:25 ALPL402 kernel: hpet0: at MMIO 0xfed00000 (virtual 0xffffffffff5fe000), IRQs 2, 8, 0, 0 Mar 26 09:37:25 ALPL402 kernel: hpet0: 4 64-bit timers, 14318180 Hz Mar 26 09:37:25 ALPL402 kernel: ACPI: DMAR not present Mar 26 09:37:25 ALPL402 kernel: PCI-GART: No AMD northbridge found. Mar 26 09:37:25 ALPL402 kernel: system 00:01: iomem range 0xfed1c000-0xfed1ffff has been reserved Mar 26 09:37:25 ALPL402 kernel: system 00:06: ioport range 0xa10-0xa1f has been reserved Mar 26 09:37:25 ALPL402 kernel: system 00:07: iomem range 0x400-0x4ff has been reserved Mar 26 09:37:25 ALPL402 kernel: system 00:07: iomem range 0xfed1c000-0xfed1ffff has been reserved Mar 26 09:37:25 ALPL402 kernel: system 00:07: iomem range 0xfed20000-0xfed3ffff has been reserved Mar 26 09:37:25 ALPL402 kernel: system 00:07: iomem range 0xfed40000-0xfed8ffff has been reserved Mar 26 09:37:25 ALPL402 kernel: system 00:09: iomem range 0xfec00000-0xfec00fff has been reserved Mar 26 09:37:25 ALPL402 kernel: system 00:09: iomem range 0xfee00000-0xfee00fff has been reserved Mar 26 09:37:25 ALPL402 kernel: system 00:0c: iomem range 0xe0000000-0xefffffff has been reserved Mar 26 09:37:25 ALPL402 kernel: system 00:0d: iomem range 0xc0000-0xcffff could not be reserved Mar 26 09:37:25 ALPL402 kernel: system 00:0d: iomem range 0xe0000-0xfffff could not be reserved Mar 26 09:37:25 ALPL402 kernel: system 00:0d: iomem range 0xfed90000-0xffffffff could not be reserved Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:01.0: PCI bridge to [bus 01-01] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:01.0: bridge window [io disabled] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:01.0: bridge window [mem disabled] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:01.0: bridge window [mem pref disabled] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:03.0: PCI bridge to [bus 02-02] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:03.0: bridge window [io disabled] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:03.0: bridge window [mem disabled] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:03.0: bridge window [mem pref disabled] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:05.0: PCI bridge to [bus 03-03] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:05.0: bridge window [io disabled] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:05.0: bridge window [mem 0xfaa00000-0xfaafffff] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:05.0: bridge window [mem 0xf8000000-0xf87fffff 64bit pref] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:07.0: PCI bridge to [bus 04-04] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:07.0: bridge window [io disabled] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:07.0: bridge window [mem 0xfab00000-0xfabfffff] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:07.0: bridge window [mem 0xf8800000-0xf8ffffff 64bit pref] Mar 26 09:37:25 ALPL402 kernel: pci 0000:07:00.0: BAR 12: assigned [mem 0xfae00000-0xfae1ffff 64bit] Mar 26 09:37:25 ALPL402 kernel: pci 0000:07:00.0: BAR 12: set to [mem 0xfae00000-0xfae1ffff 64bit] (PCI address [0xfae00000-0xfae1ffff]) Mar 26 09:37:25 ALPL402 kernel: pci 0000:07:00.0: BAR 15: assigned [mem 0xfae20000-0xfae3ffff 64bit] Mar 26 09:37:25 ALPL402 kernel: pci 0000:07:00.0: BAR 15: set to [mem 0xfae20000-0xfae3ffff 64bit] (PCI address [0xfae20000-0xfae3ffff]) Mar 26 09:37:25 ALPL402 kernel: pci 0000:07:00.1: BAR 12: assigned [mem 0xfae40000-0xfae5ffff 64bit] Mar 26 09:37:25 ALPL402 kernel: pci 0000:07:00.1: BAR 12: set to [mem 0xfae40000-0xfae5ffff 64bit] (PCI address [0xfae40000-0xfae5ffff]) Mar 26 09:37:25 ALPL402 kernel: pci 0000:07:00.1: BAR 15: assigned [mem 0xfae60000-0xfae7ffff 64bit] Mar 26 09:37:25 ALPL402 kernel: pci 0000:07:00.1: BAR 15: set to [mem 0xfae60000-0xfae7ffff 64bit] (PCI address [0xfae60000-0xfae7ffff]) Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:1c.0: PCI bridge to [bus 07-08] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:1c.0: bridge window [io 0xe000-0xefff] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:1c.0: bridge window [mem 0xfae00000-0xfaffffff] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:1c.0: bridge window [mem pref disabled] Mar 26 09:37:25 ALPL402 kernel: pci 0000:05:00.0: BAR 12: assigned [mem 0xfac00000-0xfac1ffff 64bit] Mar 26 09:37:25 ALPL402 rpc.statd[4375]: Version 1.0.9 Starting Mar 26 09:37:25 ALPL402 kernel: pci 0000:05:00.0: BAR 12: set to [mem 0xfac00000-0xfac1ffff 64bit] (PCI address [0xfac00000-0xfac1ffff]) Mar 26 09:37:25 ALPL402 kernel: pci 0000:05:00.0: BAR 15: assigned [mem 0xfac20000-0xfac3ffff 64bit] Mar 26 09:37:25 ALPL402 kernel: pci 0000:05:00.0: BAR 15: set to [mem 0xfac20000-0xfac3ffff 64bit] (PCI address [0xfac20000-0xfac3ffff]) Mar 26 09:37:25 ALPL402 kernel: pci 0000:05:00.1: BAR 12: assigned [mem 0xfac40000-0xfac5ffff 64bit] Mar 26 09:37:25 ALPL402 kernel: pci 0000:05:00.1: BAR 12: set to [mem 0xfac40000-0xfac5ffff 64bit] (PCI address [0xfac40000-0xfac5ffff]) Mar 26 09:37:25 ALPL402 kernel: pci 0000:05:00.1: BAR 15: assigned [mem 0xfac60000-0xfac7ffff 64bit] Mar 26 09:37:25 ALPL402 kernel: pci 0000:05:00.1: BAR 15: set to [mem 0xfac60000-0xfac7ffff 64bit] (PCI address [0xfac60000-0xfac7ffff]) Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:1c.4: PCI bridge to [bus 05-06] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:1c.4: bridge window [io 0xd000-0xdfff] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:1c.4: bridge window [mem 0xfac00000-0xfadfffff] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:1c.4: bridge window [mem pref disabled] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:1e.0: PCI bridge to [bus 09-09] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:1e.0: bridge window [io disabled] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:1e.0: bridge window [mem 0xfb000000-0xfbefffff] Mar 26 09:37:25 ALPL402 kernel: pci 0000:00:1e.0: bridge window [mem 0xf9000000-0xf9ffffff 64bit pref] Mar 26 09:37:25 ALPL402 kernel: GSI 16 sharing vector 0xA9 and IRQ 16 Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt 0000:00:1c.0[A] -> GSI 16 (level, low) -> IRQ 169 Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt 0000:00:1c.4[A] -> GSI 16 (level, low) -> IRQ 169 Mar 26 09:37:25 ALPL402 kernel: NET: Registered protocol family 2 Mar 26 09:37:25 ALPL402 kernel: IP route cache hash table entries: 524288 (order: 10, 4194304 bytes) Mar 26 09:37:25 ALPL402 kernel: TCP established hash table entries: 262144 (order: 10, 4194304 bytes) Mar 26 09:37:25 ALPL402 kernel: TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) Mar 26 09:37:25 ALPL402 kernel: TCP: Hash tables configured (established 262144 bind 65536) Mar 26 09:37:25 ALPL402 kernel: TCP reno registered Mar 26 09:37:25 ALPL402 kernel: audit: initializing netlink socket (disabled) Mar 26 09:37:25 ALPL402 kernel: type=2000 audit(1427333772.852:1): initialized Mar 26 09:37:25 ALPL402 kernel: Total HugeTLB memory allocated, 0 Mar 26 09:37:25 ALPL402 kernel: VFS: Disk quotas dquot_6.5.1 Mar 26 09:37:25 ALPL402 kernel: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Mar 26 09:37:25 ALPL402 kernel: Initializing Cryptographic API Mar 26 09:37:25 ALPL402 kernel: alg: No test for crc32c (crc32c-generic) Mar 26 09:37:25 ALPL402 kernel: ksign: Installing public key data Mar 26 09:37:25 ALPL402 kernel: Loading keyring Mar 26 09:37:25 ALPL402 kernel: io scheduler noop registered Mar 26 09:37:25 ALPL402 kernel: io scheduler anticipatory registered Mar 26 09:37:25 ALPL402 kernel: io scheduler deadline registered (default) Mar 26 09:37:25 ALPL402 kernel: io scheduler cfq registered Mar 26 09:37:25 ALPL402 kernel: pci_hotplug: PCI Hot Plug PCI Core version: 0.5 Mar 26 09:37:25 ALPL402 kernel: ACPI (exconfig-0456): Dynamic SSDT Load - OemId [DpgPmm] OemTableId [ P001Ist] [20060707] Mar 26 09:37:25 ALPL402 kernel: Real Time Clock Driver v1.12ac Mar 26 09:37:25 ALPL402 kernel: Non-volatile memory driver v1.2 Mar 26 09:37:25 ALPL402 kernel: Linux agpgart interface v0.101 (c) Dave Jones Mar 26 09:37:25 ALPL402 kernel: Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled Mar 26 09:37:25 ALPL402 kernel: serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A Mar 26 09:37:25 ALPL402 kernel: serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A Mar 26 09:37:25 ALPL402 kernel: 00:0a: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A Mar 26 09:37:25 ALPL402 kernel: 00:0b: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A Mar 26 09:37:25 ALPL402 kernel: brd: module loaded Mar 26 09:37:25 ALPL402 kernel: Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2 Mar 26 09:37:25 ALPL402 kernel: ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx Mar 26 09:37:25 ALPL402 kernel: ide-floppy driver 0.99.newide Mar 26 09:37:25 ALPL402 kernel: usbcore: registered new driver hiddev Mar 26 09:37:25 ALPL402 kernel: usbcore: registered new driver usbhid Mar 26 09:37:25 ALPL402 kernel: drivers/usb/input/hid-core.c: v2.6:USB HID core driver Mar 26 09:37:25 ALPL402 kernel: PNP: No PS/2 controller found. Probing ports directly. Mar 26 09:37:25 ALPL402 kernel: serio: i8042 KBD port at 0x60,0x64 irq 1 Mar 26 09:37:25 ALPL402 kernel: serio: i8042 AUX port at 0x60,0x64 irq 12 Mar 26 09:37:25 ALPL402 kernel: mice: PS/2 mouse device common for all mice Mar 26 09:37:25 ALPL402 kernel: md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27 Mar 26 09:37:25 ALPL402 kernel: md: bitmap version 4.39 Mar 26 09:37:25 ALPL402 kernel: TCP bic registered Mar 26 09:37:25 ALPL402 kernel: Initializing IPsec netlink socket Mar 26 09:37:25 ALPL402 kernel: NET: Registered protocol family 1 Mar 26 09:37:25 ALPL402 kernel: NET: Registered protocol family 17 Mar 26 09:37:25 ALPL402 kernel: ACPI: (supports S0 S1 S4 S5) Mar 26 09:37:25 ALPL402 kernel: Initalizing network drop monitor service Mar 26 09:37:25 ALPL402 kernel: Freeing unused kernel memory: 224k freed Mar 26 09:37:25 ALPL402 kernel: Write protecting the kernel read-only data: 533k Mar 26 09:37:25 ALPL402 kernel: GSI 17 sharing vector 0xE9 and IRQ 17 Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt 0000:00:1a.7[C] -> GSI 18 (level, low) -> IRQ 233 Mar 26 09:37:25 ALPL402 kernel: ehci_hcd 0000:00:1a.7: EHCI Host Controller Mar 26 09:37:25 ALPL402 kernel: ehci_hcd 0000:00:1a.7: new USB bus registered, assigned bus number 1 Mar 26 09:37:25 ALPL402 kernel: ehci_hcd 0000:00:1a.7: debug port 1 Mar 26 09:37:25 ALPL402 kernel: ehci_hcd 0000:00:1a.7: irq 233, io mem 0xfa9de000 Mar 26 09:37:25 ALPL402 kernel: ehci_hcd 0000:00:1a.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004 Mar 26 09:37:25 ALPL402 kernel: usb usb1: configuration #1 chosen from 1 choice Mar 26 09:37:25 ALPL402 kernel: hub 1-0:1.0: USB hub found Mar 26 09:37:25 ALPL402 kernel: hub 1-0:1.0: 6 ports detected Mar 26 09:37:25 ALPL402 kernel: GSI 18 sharing vector 0x32 and IRQ 18 Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt 0000:00:1d.7[A] -> GSI 23 (level, low) -> IRQ 50 Mar 26 09:37:25 ALPL402 kernel: ehci_hcd 0000:00:1d.7: EHCI Host Controller Mar 26 09:37:25 ALPL402 kernel: ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 2 Mar 26 09:37:25 ALPL402 kernel: ehci_hcd 0000:00:1d.7: debug port 1 Mar 26 09:37:25 ALPL402 kernel: ehci_hcd 0000:00:1d.7: irq 50, io mem 0xfa9dc000 Mar 26 09:37:25 ALPL402 kernel: ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004 Mar 26 09:37:25 ALPL402 kernel: usb usb2: configuration #1 chosen from 1 choice Mar 26 09:37:25 ALPL402 kernel: hub 2-0:1.0: USB hub found Mar 26 09:37:25 ALPL402 kernel: hub 2-0:1.0: 6 ports detected Mar 26 09:37:25 ALPL402 kernel: USB Universal Host Controller Interface driver v3.0 Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt 0000:00:1a.0[A] -> GSI 16 (level, low) -> IRQ 169 Mar 26 09:37:25 ALPL402 kernel: uhci_hcd 0000:00:1a.0: UHCI Host Controller Mar 26 09:37:25 ALPL402 kernel: uhci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 3 Mar 26 09:37:25 ALPL402 kernel: uhci_hcd 0000:00:1a.0: irq 169, io base 0x0000cc00 Mar 26 09:37:25 ALPL402 kernel: usb usb3: configuration #1 chosen from 1 choice Mar 26 09:37:25 ALPL402 kernel: hub 3-0:1.0: USB hub found Mar 26 09:37:25 ALPL402 kernel: hub 3-0:1.0: 2 ports detected Mar 26 09:37:25 ALPL402 kernel: GSI 19 sharing vector 0x3A and IRQ 19 Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt 0000:00:1a.1[B] -> GSI 21 (level, low) -> IRQ 58 Mar 26 09:37:25 ALPL402 kernel: uhci_hcd 0000:00:1a.1: UHCI Host Controller Mar 26 09:37:25 ALPL402 kernel: uhci_hcd 0000:00:1a.1: new USB bus registered, assigned bus number 4 Mar 26 09:37:25 ALPL402 kernel: uhci_hcd 0000:00:1a.1: irq 58, io base 0x0000c880 Mar 26 09:37:25 ALPL402 kernel: usb usb4: configuration #1 chosen from 1 choice Mar 26 09:37:25 ALPL402 kernel: hub 4-0:1.0: USB hub found Mar 26 09:37:25 ALPL402 kernel: hub 4-0:1.0: 2 ports detected Mar 26 09:37:25 ALPL402 kernel: GSI 20 sharing vector 0x42 and IRQ 20 Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt 0000:00:1a.2[D] -> GSI 19 (level, low) -> IRQ 66 Mar 26 09:37:25 ALPL402 kernel: uhci_hcd 0000:00:1a.2: UHCI Host Controller Mar 26 09:37:25 ALPL402 kernel: uhci_hcd 0000:00:1a.2: new USB bus registered, assigned bus number 5 Mar 26 09:37:25 ALPL402 kernel: uhci_hcd 0000:00:1a.2: irq 66, io base 0x0000c800 Mar 26 09:37:25 ALPL402 kernel: usb usb5: configuration #1 chosen from 1 choice Mar 26 09:37:25 ALPL402 kernel: hub 5-0:1.0: USB hub found Mar 26 09:37:25 ALPL402 kernel: hub 5-0:1.0: 2 ports detected Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 23 (level, low) -> IRQ 50 Mar 26 09:37:25 ALPL402 kernel: uhci_hcd 0000:00:1d.0: UHCI Host Controller Mar 26 09:37:25 ALPL402 kernel: uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 6 Mar 26 09:37:25 ALPL402 kernel: uhci_hcd 0000:00:1d.0: irq 50, io base 0x0000c480 Mar 26 09:37:25 ALPL402 kernel: usb usb6: configuration #1 chosen from 1 choice Mar 26 09:37:25 ALPL402 kernel: hub 6-0:1.0: USB hub found Mar 26 09:37:25 ALPL402 kernel: hub 6-0:1.0: 2 ports detected Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 66 Mar 26 09:37:25 ALPL402 kernel: uhci_hcd 0000:00:1d.1: UHCI Host Controller Mar 26 09:37:25 ALPL402 kernel: uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 7 Mar 26 09:37:25 ALPL402 kernel: uhci_hcd 0000:00:1d.1: irq 66, io base 0x0000c400 Mar 26 09:37:25 ALPL402 kernel: usb usb7: configuration #1 chosen from 1 choice Mar 26 09:37:25 ALPL402 kernel: hub 7-0:1.0: USB hub found Mar 26 09:37:25 ALPL402 kernel: hub 7-0:1.0: 2 ports detected Mar 26 09:37:25 ALPL402 kernel: usb 4-1: new full speed USB device using uhci_hcd and address 2 Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 233 Mar 26 09:37:25 ALPL402 kernel: uhci_hcd 0000:00:1d.2: UHCI Host Controller Mar 26 09:37:25 ALPL402 kernel: uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 8 Mar 26 09:37:25 ALPL402 kernel: uhci_hcd 0000:00:1d.2: irq 233, io base 0x0000c080 Mar 26 09:37:25 ALPL402 kernel: usb usb8: configuration #1 chosen from 1 choice Mar 26 09:37:25 ALPL402 kernel: hub 8-0:1.0: USB hub found Mar 26 09:37:25 ALPL402 kernel: hub 8-0:1.0: 2 ports detected Mar 26 09:37:25 ALPL402 kernel: usb 4-1: configuration #1 chosen from 1 choice Mar 26 09:37:25 ALPL402 kernel: input: Winbond Electronics Corp Hermon USB hidmouse Device as /class/input/input0 Mar 26 09:37:25 ALPL402 kernel: input,hidraw0: USB HID v1.00 Mouse [Winbond Electronics Corp Hermon USB hidmouse Device] on usb-0000:00:1a.1-1 Mar 26 09:37:25 ALPL402 kernel: input: Winbond Electronics Corp Hermon USB hidmouse Device as /class/input/input1 Mar 26 09:37:25 ALPL402 kernel: input,hidraw0: USB HID v1.00 Keyboard [Winbond Electronics Corp Hermon USB hidmouse Device] on usb-0000:00:1a.1-1 Mar 26 09:37:25 ALPL402 kernel: md: raid1 personality registered for level 1 Mar 26 09:37:25 ALPL402 kernel: SCSI subsystem initialized Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt 0000:00:1f.2[B] -> GSI 19 (level, low) -> IRQ 66 Mar 26 09:37:25 ALPL402 kernel: ahci 0000:00:1f.2: AHCI 0001.0200 32 slots 6 ports 3 Gbps 0x3f impl SATA mode Mar 26 09:37:25 ALPL402 kernel: ahci 0000:00:1f.2: flags: 64bit ncq sntf stag pm led clo pio slum part ems Mar 26 09:37:25 ALPL402 kernel: scsi0 : ahci Mar 26 09:37:25 ALPL402 kernel: scsi1 : ahci Mar 26 09:37:25 ALPL402 kernel: scsi2 : ahci Mar 26 09:37:25 ALPL402 kernel: scsi3 : ahci Mar 26 09:37:25 ALPL402 kernel: scsi4 : ahci Mar 26 09:37:25 ALPL402 kernel: scsi5 : ahci Mar 26 09:37:25 ALPL402 kernel: ata1: SATA max UDMA/133 abar m2048@0xfa9da000 port 0xfa9da100 irq 74 Mar 26 09:37:25 ALPL402 kernel: ata2: SATA max UDMA/133 abar m2048@0xfa9da000 port 0xfa9da180 irq 74 Mar 26 09:37:25 ALPL402 kernel: ata3: SATA max UDMA/133 abar m2048@0xfa9da000 port 0xfa9da200 irq 74 Mar 26 09:37:25 ALPL402 kernel: ata4: SATA max UDMA/133 abar m2048@0xfa9da000 port 0xfa9da280 irq 74 Mar 26 09:37:25 ALPL402 kernel: ata5: SATA max UDMA/133 abar m2048@0xfa9da000 port 0xfa9da300 irq 74 Mar 26 09:37:25 ALPL402 kernel: ata6: SATA max UDMA/133 abar m2048@0xfa9da000 port 0xfa9da380 irq 74 Mar 26 09:37:25 ALPL402 kernel: ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300) Mar 26 09:37:25 ALPL402 kernel: ata1.00: ATA-8: ST9500530NS, SN04, max UDMA/133 Mar 26 09:37:25 ALPL402 kernel: ata1.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32) Mar 26 09:37:25 ALPL402 kernel: ata1.00: configured for UDMA/133 Mar 26 09:37:25 ALPL402 kernel: ata2: SATA link up 3.0 Gbps (SStatus 123 SControl 300) Mar 26 09:37:25 ALPL402 kernel: ata2.00: ATA-8: ST9500530NS, SN04, max UDMA/133 Mar 26 09:37:25 ALPL402 kernel: ata2.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32) Mar 26 09:37:25 ALPL402 kernel: ata2.00: configured for UDMA/133 Mar 26 09:37:25 ALPL402 kernel: ata3: SATA link down (SStatus 0 SControl 300) Mar 26 09:37:25 ALPL402 kernel: ata4: SATA link down (SStatus 0 SControl 300) Mar 26 09:37:25 ALPL402 kernel: ata5: SATA link down (SStatus 0 SControl 300) Mar 26 09:37:25 ALPL402 kernel: ata6: SATA link down (SStatus 0 SControl 300) Mar 26 09:37:25 ALPL402 kernel: Vendor: ATA Model: ST9500530NS Rev: SN04 Mar 26 09:37:25 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:37:25 ALPL402 kernel: SCSI device sda: 976773168 512-byte hdwr sectors (500108 MB) Mar 26 09:37:25 ALPL402 kernel: sda: Write Protect is off Mar 26 09:37:25 ALPL402 kernel: SCSI device sda: drive cache: write back Mar 26 09:37:25 ALPL402 kernel: SCSI device sda: 976773168 512-byte hdwr sectors (500108 MB) Mar 26 09:37:25 ALPL402 kernel: sda: Write Protect is off Mar 26 09:37:25 ALPL402 kernel: SCSI device sda: drive cache: write back Mar 26 09:37:25 ALPL402 kernel: sda: sda1 sda2 sda3 Mar 26 09:37:25 ALPL402 kernel: sd 0:0:0:0: Attached scsi disk sda Mar 26 09:37:25 ALPL402 kernel: Vendor: ATA Model: ST9500530NS Rev: SN04 Mar 26 09:37:25 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:37:25 ALPL402 kernel: SCSI device sdb: 976773168 512-byte hdwr sectors (500108 MB) Mar 26 09:37:25 ALPL402 kernel: sdb: Write Protect is off Mar 26 09:37:25 ALPL402 kernel: SCSI device sdb: drive cache: write back Mar 26 09:37:25 ALPL402 kernel: SCSI device sdb: 976773168 512-byte hdwr sectors (500108 MB) Mar 26 09:37:25 ALPL402 kernel: sdb: Write Protect is off Mar 26 09:37:25 ALPL402 kernel: SCSI device sdb: drive cache: write back Mar 26 09:37:25 ALPL402 kernel: sdb: sdb1 sdb2 sdb3 Mar 26 09:37:25 ALPL402 kernel: sd 1:0:0:0: Attached scsi disk sdb Mar 26 09:37:25 ALPL402 kernel: Initializing USB Mass Storage driver... Mar 26 09:37:25 ALPL402 kernel: usbcore: registered new driver usb-storage Mar 26 09:37:25 ALPL402 kernel: USB Mass Storage support registered. Mar 26 09:37:25 ALPL402 kernel: device-mapper: uevent: version 1.0.3 Mar 26 09:37:25 ALPL402 kernel: device-mapper: ioctl: 4.11.6-ioctl (2011-02-18) initialised: dm-devel@redhat.com Mar 26 09:37:25 ALPL402 kernel: device-mapper: dm-raid45: initialized v0.2594l Mar 26 09:37:25 ALPL402 kernel: md: Autodetecting RAID arrays. Mar 26 09:37:25 ALPL402 kernel: md: autorun ... Mar 26 09:37:25 ALPL402 kernel: md: considering sdb3 ... Mar 26 09:37:25 ALPL402 kernel: md: adding sdb3 ... Mar 26 09:37:25 ALPL402 kernel: md: sdb2 has different UUID to sdb3 Mar 26 09:37:25 ALPL402 kernel: md: sdb1 has different UUID to sdb3 Mar 26 09:37:25 ALPL402 kernel: md: adding sda3 ... Mar 26 09:37:25 ALPL402 kernel: md: sda2 has different UUID to sdb3 Mar 26 09:37:25 ALPL402 kernel: md: sda1 has different UUID to sdb3 Mar 26 09:37:25 ALPL402 kernel: md: created md2 Mar 26 09:37:25 ALPL402 kernel: md: bind Mar 26 09:37:25 ALPL402 kernel: md: bind Mar 26 09:37:25 ALPL402 kernel: md: running: Mar 26 09:37:25 ALPL402 kernel: raid1: raid set md2 active with 2 out of 2 mirrors Mar 26 09:37:25 ALPL402 kernel: md: considering sdb2 ... Mar 26 09:37:25 ALPL402 kernel: md: adding sdb2 ... Mar 26 09:37:25 ALPL402 kernel: md: sdb1 has different UUID to sdb2 Mar 26 09:37:25 ALPL402 kernel: md: adding sda2 ... Mar 26 09:37:25 ALPL402 kernel: md: sda1 has different UUID to sdb2 Mar 26 09:37:25 ALPL402 kernel: md: created md1 Mar 26 09:37:25 ALPL402 kernel: md: bind Mar 26 09:37:25 ALPL402 kernel: md: bind Mar 26 09:37:25 ALPL402 kernel: md: running: Mar 26 09:37:25 ALPL402 kernel: raid1: raid set md1 active with 2 out of 2 mirrors Mar 26 09:37:25 ALPL402 kernel: md: considering sdb1 ... Mar 26 09:37:25 ALPL402 kernel: md: adding sdb1 ... Mar 26 09:37:25 ALPL402 kernel: md: adding sda1 ... Mar 26 09:37:25 ALPL402 kernel: md: created md0 Mar 26 09:37:25 ALPL402 kernel: md: bind Mar 26 09:37:25 ALPL402 kernel: md: bind Mar 26 09:37:25 ALPL402 kernel: md: running: Mar 26 09:37:25 ALPL402 kernel: raid1: raid set md0 active with 2 out of 2 mirrors Mar 26 09:37:25 ALPL402 kernel: md: ... autorun DONE. Mar 26 09:37:25 ALPL402 kernel: md: Autodetecting RAID arrays. Mar 26 09:37:25 ALPL402 kernel: md: autorun ... Mar 26 09:37:25 ALPL402 kernel: md: ... autorun DONE. Mar 26 09:37:25 ALPL402 kernel: EXT3-fs: INFO: recovery required on readonly filesystem. Mar 26 09:37:25 ALPL402 kernel: EXT3-fs: write access will be enabled during recovery. Mar 26 09:37:25 ALPL402 kernel: kjournald starting. Commit interval 5 seconds Mar 26 09:37:25 ALPL402 kernel: EXT3-fs: recovery complete. Mar 26 09:37:25 ALPL402 kernel: EXT3-fs: mounted filesystem with ordered data mode. Mar 26 09:37:25 ALPL402 kernel: SELinux: Disabled at runtime. Mar 26 09:37:25 ALPL402 kernel: type=1404 audit(1427333809.469:2): selinux=0 auid=4294967295 ses=4294967295 Mar 26 09:37:25 ALPL402 kernel: input: PC Speaker as /class/input/input2 Mar 26 09:37:25 ALPL402 kernel: dca service started, version 1.8 Mar 26 09:37:25 ALPL402 kernel: EDAC MC: Ver: 2.0.1 Feb 12 2015 Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt 0000:00:1f.3[C] -> GSI 18 (level, low) -> IRQ 233 Mar 26 09:37:25 ALPL402 kernel: 802.1Q VLAN Support v1.8 Ben Greear Mar 26 09:37:25 ALPL402 kernel: All bugs added by David S. Miller Mar 26 09:37:25 ALPL402 kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 Mar 26 09:37:25 ALPL402 kernel: igb: Intel(R) Gigabit Ethernet Network Driver - version 4.0.1-k1-1 Mar 26 09:37:25 ALPL402 kernel: igb: Copyright (c) 2007-2012 Intel Corporation. Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt 0000:07:00.0[A] -> GSI 16 (level, low) -> IRQ 169 Mar 26 09:37:25 ALPL402 kernel: igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection Mar 26 09:37:25 ALPL402 kernel: igb 0000:07:00.0: eth0: (PCIe:2.5Gb/s:Width x4) 00:25:90:14:fb:34 Mar 26 09:37:25 ALPL402 kernel: igb 0000:07:00.0: eth0: PBA No: FFFFFF-0FF Mar 26 09:37:25 ALPL402 kernel: igb 0000:07:00.0: Using MSI-X interrupts. 4 rx queue(s), 1 tx queue(s) Mar 26 09:37:25 ALPL402 kernel: GSI 21 sharing vector 0x82 and IRQ 21 Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt 0000:07:00.1[B] -> GSI 17 (level, low) -> IRQ 130 Mar 26 09:37:25 ALPL402 kernel: sd 0:0:0:0: Attached scsi generic sg0 type 0 Mar 26 09:37:25 ALPL402 kernel: sd 1:0:0:0: Attached scsi generic sg1 type 0 Mar 26 09:37:25 ALPL402 kernel: igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection Mar 26 09:37:25 ALPL402 kernel: igb 0000:07:00.1: eth1: (PCIe:2.5Gb/s:Width x4) 00:25:90:14:fb:35 Mar 26 09:37:25 ALPL402 kernel: igb 0000:07:00.1: eth1: PBA No: FFFFFF-0FF Mar 26 09:37:25 ALPL402 kernel: igb 0000:07:00.1: Using MSI-X interrupts. 4 rx queue(s), 1 tx queue(s) Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt 0000:05:00.0[A] -> GSI 16 (level, low) -> IRQ 169 Mar 26 09:37:25 ALPL402 kernel: igb 0000:05:00.0: Intel(R) Gigabit Ethernet Network Connection Mar 26 09:37:25 ALPL402 kernel: igb 0000:05:00.0: eth2: (PCIe:2.5Gb/s:Width x2) 00:25:90:14:fb:36 Mar 26 09:37:25 ALPL402 kernel: igb 0000:05:00.0: eth2: PBA No: FFFFFF-0FF Mar 26 09:37:25 ALPL402 kernel: igb 0000:05:00.0: Using MSI-X interrupts. 4 rx queue(s), 1 tx queue(s) Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt 0000:05:00.1[B] -> GSI 17 (level, low) -> IRQ 130 Mar 26 09:37:25 ALPL402 kernel: igb 0000:05:00.1: Intel(R) Gigabit Ethernet Network Connection Mar 26 09:37:25 ALPL402 kernel: igb 0000:05:00.1: eth3: (PCIe:2.5Gb/s:Width x2) 00:25:90:14:fb:37 Mar 26 09:37:25 ALPL402 kernel: igb 0000:05:00.1: eth3: PBA No: FFFFFF-0FF Mar 26 09:37:25 ALPL402 kernel: igb 0000:05:00.1: Using MSI-X interrupts. 4 rx queue(s), 1 tx queue(s) Mar 26 09:37:25 ALPL402 kernel: mlx4_core: Mellanox ConnectX core driver v1.0-mlnx_ofed1.5.3 (November 3, 2011) Mar 26 09:37:25 ALPL402 kernel: mlx4_core: Initializing 0000:03:00.0 Mar 26 09:37:25 ALPL402 kernel: GSI 22 sharing vector 0x5B and IRQ 22 Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt 0000:03:00.0[A] -> GSI 26 (level, low) -> IRQ 91 Mar 26 09:37:25 ALPL402 kernel: mlx4_core: Initializing 0000:04:00.0 Mar 26 09:37:25 ALPL402 kernel: GSI 23 sharing vector 0x4C and IRQ 23 Mar 26 09:37:25 ALPL402 kernel: ACPI: PCI Interrupt 0000:04:00.0[A] -> GSI 30 (level, low) -> IRQ 76 Mar 26 09:37:25 ALPL402 kernel: mlx4_en: Mellanox ConnectX HCA Ethernet driver v1.5.10 (Jan 2013) Mar 26 09:37:25 ALPL402 kernel: floppy0: no floppy controllers found Mar 26 09:37:25 ALPL402 kernel: work still pending Mar 26 09:37:25 ALPL402 kernel: lp: driver loaded but no devices found Mar 26 09:37:25 ALPL402 kernel: NET: Registered protocol family 10 Mar 26 09:37:25 ALPL402 kernel: lo: Disabled Privacy Extensions Mar 26 09:37:25 ALPL402 kernel: IPv6 over IPv4 tunneling driver Mar 26 09:37:25 ALPL402 kernel: sit0: Disabled Privacy Extensions Mar 26 09:37:25 ALPL402 kernel: mtrr: type mismatch for f9000000,800000 old: write-back new: write-combining Mar 26 09:37:25 ALPL402 kernel: mtrr: type mismatch for f9000000,1000000 old: write-back new: write-combining Mar 26 09:37:25 ALPL402 kernel: mtrr: type mismatch for f9fe0000,10000 old: write-back new: write-combining Mar 26 09:37:25 ALPL402 kernel: mtrr: type mismatch for f9fc0000,20000 old: write-back new: write-combining Mar 26 09:37:25 ALPL402 kernel: mtrr: type mismatch for f9f80000,40000 old: write-back new: write-combining Mar 26 09:37:25 ALPL402 kernel: mtrr: type mismatch for f9f00000,80000 old: write-back new: write-combining Mar 26 09:37:25 ALPL402 kernel: mtrr: type mismatch for f9e00000,100000 old: write-back new: write-combining Mar 26 09:37:25 ALPL402 kernel: mtrr: type mismatch for f9c00000,200000 old: write-back new: write-combining Mar 26 09:37:25 ALPL402 kernel: mtrr: type mismatch for f9800000,400000 old: write-back new: write-combining Mar 26 09:37:25 ALPL402 kernel: mtrr: type mismatch for f9000000,800000 old: write-back new: write-combining Mar 26 09:37:25 ALPL402 kernel: mtrr: type mismatch for f9fe0000,10000 old: write-back new: write-combining Mar 26 09:37:25 ALPL402 kernel: mtrr: type mismatch for f9fc0000,20000 old: write-back new: write-combining Mar 26 09:37:25 ALPL402 kernel: mtrr: type mismatch for f9f80000,40000 old: write-back new: write-combining Mar 26 09:37:25 ALPL402 kernel: mtrr: type mismatch for f9f00000,80000 old: write-back new: write-combining Mar 26 09:37:25 ALPL402 kernel: mtrr: type mismatch for f9e00000,100000 old: write-back new: write-combining Mar 26 09:37:25 ALPL402 kernel: mtrr: type mismatch for f9c00000,200000 old: write-back new: write-combining Mar 26 09:37:25 ALPL402 kernel: mtrr: type mismatch for f9800000,400000 old: write-back new: write-combining Mar 26 09:37:25 ALPL402 kernel: mtrr: type mismatch for f9000000,800000 old: write-back new: write-combining Mar 26 09:37:25 ALPL402 kernel: ACPI: Power Button (FF) [PWRF] Mar 26 09:37:25 ALPL402 kernel: ACPI: Power Button (CM) [PWRB] Mar 26 09:37:25 ALPL402 kernel: ACPI: Mapper loaded Mar 26 09:37:25 ALPL402 kernel: dell-wmi: No known WMI GUID found Mar 26 09:37:25 ALPL402 kernel: md: Autodetecting RAID arrays. Mar 26 09:37:25 ALPL402 kernel: md: autorun ... Mar 26 09:37:25 ALPL402 kernel: md: ... autorun DONE. Mar 26 09:37:25 ALPL402 kernel: device-mapper: multipath: version 1.0.6 loaded Mar 26 09:37:25 ALPL402 kernel: device-mapper: multipath round-robin: version 1.0.0 loaded Mar 26 09:37:25 ALPL402 kernel: device-mapper: table: 253:0: multipath: error getting device Mar 26 09:37:25 ALPL402 kernel: device-mapper: ioctl: error adding target to table Mar 26 09:37:25 ALPL402 kernel: device-mapper: table: 253:0: multipath: error getting device Mar 26 09:37:25 ALPL402 kernel: device-mapper: ioctl: error adding target to table Mar 26 09:37:25 ALPL402 kernel: device-mapper: table: 253:0: multipath: error getting device Mar 26 09:37:25 ALPL402 kernel: device-mapper: ioctl: error adding target to table Mar 26 09:37:25 ALPL402 kernel: device-mapper: table: 253:0: multipath: error getting device Mar 26 09:37:25 ALPL402 kernel: device-mapper: ioctl: error adding target to table Mar 26 09:37:25 ALPL402 kernel: EXT3 FS on md2, internal journal Mar 26 09:37:25 ALPL402 kernel: kjournald starting. Commit interval 5 seconds Mar 26 09:37:25 ALPL402 kernel: EXT3 FS on md0, internal journal Mar 26 09:37:25 ALPL402 kernel: EXT3-fs: mounted filesystem with ordered data mode. Mar 26 09:37:25 ALPL402 kernel: Adding 4192888k swap on /dev/md1. Priority:-1 extents:1 across:4192888k Mar 26 09:37:25 ALPL402 kernel: IA-32 Microcode Update Driver: v1.14a Mar 26 09:37:26 ALPL402 kernel: mlx4_ib: Mellanox ConnectX InfiniBand driver v1.0-mlnx_ofed1.5.3 (November 3, 2011) Mar 26 09:37:26 ALPL402 kernel: Default coalesing params for mtu:2044 - rx_frames:88 rx_usecs:16 Mar 26 09:37:26 ALPL402 last message repeated 2 times Mar 26 09:37:26 ALPL402 kernel: ADDRCONF(NETDEV_UP): ib0: link is not ready Mar 26 09:37:26 ALPL402 kernel: ib0: enabling connected mode will cause multicast packet drops Mar 26 09:37:26 ALPL402 kernel: ib0: mtu > 2044 will cause multicast packet drops. Mar 26 09:37:26 ALPL402 kernel: ib0: mtu > 2044 will cause multicast packet drops. Mar 26 09:37:26 ALPL402 kernel: Loading iSCSI transport class v2.0-871. Mar 26 09:37:26 ALPL402 kernel: libcxgbi:libcxgbi_init_module: tag itt 0x1fff, 13 bits, age 0xf, 4 bits. Mar 26 09:37:26 ALPL402 kernel: libcxgbi:ddp_setup_host_page_size: system PAGE 4096, ddp idx 0. Mar 26 09:37:26 ALPL402 kernel: Chelsio T3 iSCSI Driver cxgb3i v2.0.0 (Jun. 2010) Mar 26 09:37:26 ALPL402 kernel: iscsi: registered transport (cxgb3i) Mar 26 09:37:26 ALPL402 kernel: cnic: Broadcom NetXtreme II CNIC Driver cnic v2.5.12 (June 29, 2012) Mar 26 09:37:26 ALPL402 kernel: Broadcom NetXtreme II iSCSI Driver bnx2i v2.7.2.2 (Jun 18, 2012) Mar 26 09:37:26 ALPL402 kernel: iscsi: registered transport (bnx2i) Mar 26 09:37:26 ALPL402 kernel: iscsi: registered transport (tcp) Mar 26 09:37:26 ALPL402 kernel: iscsi: registered transport (iser) Mar 26 09:37:26 ALPL402 kernel: iscsi: registered transport (be2iscsi) Mar 26 09:37:26 ALPL402 kernel: device-mapper: table: 253:0: multipath: error getting device Mar 26 09:37:26 ALPL402 kernel: device-mapper: ioctl: error adding target to table Mar 26 09:37:26 ALPL402 kernel: device-mapper: table: 253:0: multipath: error getting device Mar 26 09:37:26 ALPL402 kernel: device-mapper: ioctl: error adding target to table Mar 26 09:37:26 ALPL402 kernel: device-mapper: table: 253:0: multipath: error getting device Mar 26 09:37:26 ALPL402 kernel: device-mapper: ioctl: error adding target to table Mar 26 09:37:26 ALPL402 kernel: device-mapper: table: 253:0: multipath: error getting device Mar 26 09:37:26 ALPL402 kernel: device-mapper: ioctl: error adding target to table Mar 26 09:37:26 ALPL402 kernel: 8021q: adding VLAN 0 to HW filter on device eth0 Mar 26 09:37:26 ALPL402 kernel: ADDRCONF(NETDEV_UP): eth0: link is not ready Mar 26 09:37:26 ALPL402 kernel: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX Mar 26 09:37:26 ALPL402 kernel: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready Mar 26 09:37:26 ALPL402 kernel: 8021q: adding VLAN 0 to HW filter on device eth2 Mar 26 09:37:26 ALPL402 kernel: ADDRCONF(NETDEV_UP): eth2: link is not ready Mar 26 09:37:26 ALPL402 kernel: igb: eth2 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX Mar 26 09:37:26 ALPL402 kernel: ADDRCONF(NETDEV_CHANGE): eth2: link becomes ready Mar 26 09:37:26 ALPL402 kernel: cm_dreq_handler: no cm_id_priv Mar 26 09:37:26 ALPL402 kernel: cm_req_handler: no listen_cm_id_priv Mar 26 09:37:26 ALPL402 kernel: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready Mar 26 09:37:26 ALPL402 hcid[4447]: Bluetooth HCI daemon Mar 26 09:37:26 ALPL402 kernel: Bluetooth: Core ver 2.10 Mar 26 09:37:26 ALPL402 kernel: NET: Registered protocol family 31 Mar 26 09:37:26 ALPL402 kernel: Bluetooth: HCI device and connection manager initialized Mar 26 09:37:26 ALPL402 kernel: Bluetooth: HCI socket layer initialized Mar 26 09:37:26 ALPL402 hcid[4447]: Register path:/org/bluez fallback:1 Mar 26 09:37:26 ALPL402 kernel: Bluetooth: L2CAP ver 2.8 Mar 26 09:37:26 ALPL402 kernel: Bluetooth: L2CAP socket layer initialized Mar 26 09:37:26 ALPL402 sdpd[4453]: Bluetooth SDP daemon Mar 26 09:37:26 ALPL402 kernel: Bluetooth: RFCOMM socket layer initialized Mar 26 09:37:26 ALPL402 kernel: Bluetooth: RFCOMM TTY layer initialized Mar 26 09:37:26 ALPL402 kernel: Bluetooth: RFCOMM ver 1.8 Mar 26 09:37:29 ALPL402 kernel: cm_req_handler: no listen_cm_id_priv Mar 26 09:38:00 ALPL402 last message repeated 1430 times Mar 26 09:39:01 ALPL402 last message repeated 1351 times Mar 26 09:40:02 ALPL402 last message repeated 976 times Mar 26 09:41:04 ALPL402 last message repeated 656 times Mar 26 09:42:31 ALPL402 OpenSM[4685]: /var/log/opensm-mlx4_1-1.log log file opened Mar 26 09:42:31 ALPL402 OpenSM[4685]: OpenSM 3.3.13.MLNX_20130110_cd124d3 Mar 26 09:42:31 ALPL402 OpenSM[4685]: Entering DISCOVERING state Mar 26 09:42:31 ALPL402 OpenSM[4713]: /var/log/opensm-mlx4_1-2.log log file opened Mar 26 09:42:31 ALPL402 OpenSM[4713]: OpenSM 3.3.13.MLNX_20130110_cd124d3 Mar 26 09:42:31 ALPL402 OpenSM[4713]: Entering DISCOVERING state Mar 26 09:42:31 ALPL402 OpenSM[4685]: Entering MASTER state Mar 26 09:42:31 ALPL402 kernel: ib_srp: ASYNC event= 11 on device= mlx4_1 port= 1 Mar 26 09:42:31 ALPL402 kernel: ib_srp: ASYNC event= 9 on device= mlx4_1 port= 1 Mar 26 09:42:31 ALPL402 OpenSM[4713]: Entering MASTER state Mar 26 09:42:31 ALPL402 kernel: ib_srp: ASYNC event= 11 on device= mlx4_1 port= 2 Mar 26 09:42:31 ALPL402 kernel: ib_srp: ASYNC event= 9 on device= mlx4_1 port= 2 Mar 26 09:42:32 ALPL402 run_srp_daemon[4753]: starting srp_daemon: [HCA=mlx4_1] [port=1] Mar 26 09:42:33 ALPL402 run_srp_daemon[4772]: starting srp_daemon: [HCA=mlx4_1] [port=2] Mar 26 09:42:33 ALPL402 pcscd: pcscdaemon.c:507:main() pcsc-lite 1.4.4 daemon ready. Mar 26 09:42:33 ALPL402 pcscd: hotplug_libusb.c:402:HPEstablishUSBNotifications() Driver ifd-egate.bundle does not support IFD_GENERATE_HOTPLUG. Using active polling instead. Mar 26 09:42:33 ALPL402 pcscd: hotplug_libusb.c:411:HPEstablishUSBNotifications() Polling forced every 1 second(s) Mar 26 09:42:35 ALPL402 kernel: Bluetooth: HIDP (Human Interface Emulation) ver 1.1 Mar 26 09:42:35 ALPL402 hidd[4877]: Bluetooth HID daemon Mar 26 09:42:35 ALPL402 kernel: scsi6 : SRP.T10:341C0D0003C90200 Mar 26 09:42:35 ALPL402 kernel: Vendor: DDN Model: SFA 10000 Rev: 1.03 Mar 26 09:42:35 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:0: Warning! Received an indication that the LUN assignments on this target have changed. The Linux SCSI layer does not automatically remap LUN assignments. Mar 26 09:42:35 ALPL402 kernel: sdc: Unit Not Ready, sense: Mar 26 09:42:35 ALPL402 kernel: : Current: sense key: Unit Attention Mar 26 09:42:35 ALPL402 kernel: Add. Sense: Reported luns data has changed Mar 26 09:42:35 ALPL402 kernel: Mar 26 09:42:35 ALPL402 kernel: sdc : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdc: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdc: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdc: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 multipathd: sdc: add path (uevent) Mar 26 09:42:35 ALPL402 kernel: sdc : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdc: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdc: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdc: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdc: unknown partition table Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:0: Attached scsi disk sdc Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:0: Attached scsi generic sg2 type 0 Mar 26 09:42:35 ALPL402 kernel: Vendor: DDN Model: SFA 10000 Rev: 1.03 Mar 26 09:42:35 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:42:35 ALPL402 kernel: sdd : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdd: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdd: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdd: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdd : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdd: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdd: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdd: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdd: unknown partition table Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:1: Attached scsi disk sdd Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:1: Attached scsi generic sg3 type 0 Mar 26 09:42:35 ALPL402 kernel: Vendor: DDN Model: SFA 10000 Rev: 1.03 Mar 26 09:42:35 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:42:35 ALPL402 kernel: sde : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sde: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sde: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sde: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sde : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sde: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sde: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sde: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sde:<7> host7: ib_srp: new target: id_ext de374c0003c90200 ioc_guid de374c0003c90200 pkey ffff service_id de374c0003c90200 dgid fe80:0000:0000:0000:0002:c903:004c:37e0 Mar 26 09:42:35 ALPL402 kernel: unknown partition table Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:2: Attached scsi disk sde Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:2: Attached scsi generic sg4 type 0 Mar 26 09:42:35 ALPL402 kernel: Vendor: DDN Model: SFA 10000 Rev: 1.03 Mar 26 09:42:35 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:42:35 ALPL402 kernel: sdf : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdf: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdf: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdf: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdf : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdf: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdf: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdf: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdf: unknown partition table Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:3: Attached scsi disk sdf Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:3: Attached scsi generic sg5 type 0 Mar 26 09:42:35 ALPL402 kernel: Vendor: DDN Model: SFA 10000 Rev: 1.03 Mar 26 09:42:35 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:42:35 ALPL402 kernel: sdg : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdg: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdg: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdg: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdg : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdg: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdg: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdg: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdg:<6>scsi7 : SRP.T10:DE374C0003C90200 Mar 26 09:42:35 ALPL402 kernel: Vendor: DDN Model: SFA 10000 Rev: 1.03 Mar 26 09:42:35 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:0: Warning! Received an indication that the LUN assignments on this target have changed. The Linux SCSI layer does not automatically remap LUN assignments. Mar 26 09:42:35 ALPL402 kernel: sdh: Unit Not Ready, sense: Mar 26 09:42:35 ALPL402 kernel: : Current: sense key: Unit Attention Mar 26 09:42:35 ALPL402 kernel: Add. Sense: Reported luns data has changed Mar 26 09:42:35 ALPL402 kernel: Mar 26 09:42:35 ALPL402 kernel: sdh : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdh: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdh: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdh: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdh : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdh: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdh: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdh: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdh: unknown partition table Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:0: Attached scsi disk sdh Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:0: Attached scsi generic sg6 type 0 Mar 26 09:42:35 ALPL402 kernel: Vendor: DDN Model: SFA 10000 Rev: 1.03 Mar 26 09:42:35 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:42:35 ALPL402 kernel: sdi : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdi: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdi: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdi: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdi : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdi: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdi: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdi: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdi: unknown partition table Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:1: Attached scsi disk sdi Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:1: Attached scsi generic sg7 type 0 Mar 26 09:42:35 ALPL402 kernel: Vendor: DDN Model: SFA 10000 Rev: 1.03 Mar 26 09:42:35 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:42:35 ALPL402 kernel: sdj : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdj: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdj: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdj: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdj : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdj: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdj: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdj: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdj: unknown partition table Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:2: Attached scsi disk sdj Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:2: Attached scsi generic sg8 type 0 Mar 26 09:42:35 ALPL402 kernel: Vendor: DDN Model: SFA 10000 Rev: 1.03 Mar 26 09:42:35 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:42:35 ALPL402 kernel: sdk : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdk: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdk: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdk: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdk : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdk: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdk: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdk: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdk: unknown partition table Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:3: Attached scsi disk sdk Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:3: Attached scsi generic sg9 type 0 Mar 26 09:42:35 ALPL402 kernel: Vendor: DDN Model: SFA 10000 Rev: 1.03 Mar 26 09:42:35 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:42:35 ALPL402 kernel: sdl : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdl: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdl: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdl: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdl : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdl: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdl: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdl: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdl: unknown partition table Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:4: Attached scsi disk sdl Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:4: Attached scsi generic sg10 type 0 Mar 26 09:42:35 ALPL402 kernel: unknown partition table Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:4: Attached scsi disk sdg Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:4: Attached scsi generic sg11 type 0 Mar 26 09:42:35 ALPL402 kernel: Vendor: DDN Model: SFA 10000 Rev: 1.03 Mar 26 09:42:35 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:42:35 ALPL402 kernel: Vendor: DDN Model: SFA 10000 Rev: 1.03 Mar 26 09:42:35 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:42:35 ALPL402 kernel: sdm : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: sdn : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdm: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: SCSI device sdn: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdm: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: sdn: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdm: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: SCSI device sdn: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdm : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: sdn : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdm: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: SCSI device sdn: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdm: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: sdn: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdm: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdm:<5>SCSI device sdn: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdn: unknown partition table Mar 26 09:42:35 ALPL402 kernel: unknown partition table Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:5: Attached scsi disk sdm Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:5: Attached scsi disk sdn Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:5: Attached scsi generic sg12 type 0 Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:5: Attached scsi generic sg13 type 0 Mar 26 09:42:35 ALPL402 kernel: Vendor: DDN Model: SFA 10000 Rev: 1.03 Mar 26 09:42:35 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:42:35 ALPL402 kernel: sdo : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdo: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdo: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdo: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdo : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdo: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdo: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdo: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdo: unknown partition table Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:6: Attached scsi disk sdo Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:6: Attached scsi generic sg14 type 0 Mar 26 09:42:35 ALPL402 kernel: Vendor: DDN Model: SFA 10000 Rev: 1.03 Mar 26 09:42:35 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:42:35 ALPL402 kernel: sdp : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdp: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdp: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdp: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdp : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdp: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdp: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdp: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdp:<5> Vendor: DDN Model: SFA 10000 Rev: 1.03 Mar 26 09:42:35 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:42:35 ALPL402 kernel: sdq : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdq: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdq: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdq: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 multipathd: failed to find rport_id for target6:0:0 Mar 26 09:42:35 ALPL402 kernel: sdq : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdq: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 multipathd: OST00: load table [0 4412407808 multipath 0 0 1 1 round-robin 0 1 1 8:32 10] Mar 26 09:42:35 ALPL402 kernel: sdq: Write Protect is off Mar 26 09:42:35 ALPL402 multipathd: OST00: event checker started Mar 26 09:42:35 ALPL402 multipathd: sdd: add path (uevent) Mar 26 09:42:35 ALPL402 kernel: SCSI device sdq: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 multipathd: failed to find rport_id for target6:0:0 Mar 26 09:42:35 ALPL402 kernel: sdq: unknown partition table Mar 26 09:42:35 ALPL402 multipathd: OST01: load table [0 4412407808 multipath 0 0 1 1 round-robin 0 1 1 8:48 10] Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:6: Attached scsi disk sdq Mar 26 09:42:35 ALPL402 multipathd: OST01: event checker started Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:6: Attached scsi generic sg15 type 0 Mar 26 09:42:35 ALPL402 multipathd: sde: add path (uevent) Mar 26 09:42:35 ALPL402 kernel: Vendor: DDN Model: SFA 10000 Rev: 1.03 Mar 26 09:42:35 ALPL402 multipathd: failed to find rport_id for target6:0:0 Mar 26 09:42:35 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:42:35 ALPL402 multipathd: OST02: load table [0 4412407808 multipath 0 0 1 1 round-robin 0 1 1 8:64 10] Mar 26 09:42:35 ALPL402 kernel: sdr : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 multipathd: OST02: event checker started Mar 26 09:42:35 ALPL402 kernel: SCSI device sdr: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 multipathd: sdf: add path (uevent) Mar 26 09:42:35 ALPL402 kernel: sdr: Write Protect is off Mar 26 09:42:35 ALPL402 multipathd: failed to find rport_id for target6:0:0 Mar 26 09:42:35 ALPL402 multipathd: OST03: load table [0 4412407808 multipath 0 0 1 1 round-robin 0 1 1 8:80 10] Mar 26 09:42:35 ALPL402 kernel: SCSI device sdr: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 multipathd: OST03: event checker started Mar 26 09:42:35 ALPL402 kernel: sdr : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 multipathd: sdh: add path (uevent) Mar 26 09:42:35 ALPL402 kernel: SCSI device sdr: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 multipathd: failed to find rport_id for target6:0:0 Mar 26 09:42:35 ALPL402 kernel: sdr: Write Protect is off Mar 26 09:42:35 ALPL402 multipathd: OST00: load table [0 4412407808 multipath 0 0 2 1 round-robin 0 1 1 8:32 10 round-robin 0 1 1 8:112 10] Mar 26 09:42:35 ALPL402 multipathd: sdi: add path (uevent) Mar 26 09:42:35 ALPL402 kernel: SCSI device sdr: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 multipathd: failed to find rport_id for target6:0:0 Mar 26 09:42:35 ALPL402 kernel: sdr: unknown partition table Mar 26 09:42:35 ALPL402 multipathd: OST01: load table [0 4412407808 multipath 0 0 2 1 round-robin 0 1 1 8:48 10 round-robin 0 1 1 8:128 10] Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:7: Attached scsi disk sdr Mar 26 09:42:35 ALPL402 multipathd: sdj: add path (uevent) Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:7: Attached scsi generic sg16 type 0 Mar 26 09:42:35 ALPL402 multipathd: failed to find rport_id for target6:0:0 Mar 26 09:42:35 ALPL402 kernel: unknown partition table Mar 26 09:42:35 ALPL402 multipathd: OST02: load table [0 4412407808 multipath 0 0 2 1 round-robin 0 1 1 8:64 10 round-robin 0 1 1 8:144 10] Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:7: Attached scsi disk sdp Mar 26 09:42:35 ALPL402 multipathd: sdk: add path (uevent) Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:7: Attached scsi generic sg17 type 0 Mar 26 09:42:35 ALPL402 multipathd: failed to find rport_id for target6:0:0 Mar 26 09:42:35 ALPL402 kernel: Vendor: DDN Model: SFA 10000 Rev: 1.03 Mar 26 09:42:35 ALPL402 multipathd: OST03: load table [0 4412407808 multipath 0 0 2 1 round-robin 0 1 1 8:80 10 round-robin 0 1 1 8:160 10] Mar 26 09:42:35 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:42:35 ALPL402 multipathd: sdl: add path (uevent) Mar 26 09:42:35 ALPL402 kernel: Vendor: DDN Model: SFA 10000 Rev: 1.03 Mar 26 09:42:35 ALPL402 multipathd: failed to find rport_id for target7:0:0 Mar 26 09:42:35 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:42:35 ALPL402 multipathd: OST04: load table [0 4412407808 multipath 0 0 1 1 round-robin 0 1 1 8:176 10] Mar 26 09:42:35 ALPL402 kernel: sds : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 multipathd: OST04: event checker started Mar 26 09:42:35 ALPL402 kernel: sdt : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 multipathd: sdg: add path (uevent) Mar 26 09:42:35 ALPL402 kernel: SCSI device sds: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 multipathd: failed to find rport_id for target7:0:0 Mar 26 09:42:35 ALPL402 kernel: SCSI device sdt: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 multipathd: OST04: load table [0 4412407808 multipath 0 0 2 1 round-robin 0 1 1 8:96 10 round-robin 0 1 1 8:176 10] Mar 26 09:42:35 ALPL402 kernel: sds: Write Protect is off Mar 26 09:42:35 ALPL402 multipathd: sdm: add path (uevent) Mar 26 09:42:35 ALPL402 kernel: sdt: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sds: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: SCSI device sdt: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sds : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: sdt : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sds: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: SCSI device sdt: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sds: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: sdt: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sds: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sds:<5>SCSI device sdt: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdt: unknown partition table Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:8: Attached scsi disk sds Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:8: Attached scsi generic sg18 type 0 Mar 26 09:42:35 ALPL402 kernel: unknown partition table Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:8: Attached scsi disk sdt Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:8: Attached scsi generic sg19 type 0 Mar 26 09:42:35 ALPL402 kernel: Vendor: DDN Model: SFA 10000 Rev: 1.03 Mar 26 09:42:35 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:42:35 ALPL402 kernel: Vendor: DDN Model: SFA 10000 Rev: 1.03 Mar 26 09:42:35 ALPL402 kernel: Type: Direct-Access ANSI SCSI revision: 05 Mar 26 09:42:35 ALPL402 kernel: sdu : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: sdv : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdu: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: SCSI device sdv: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdu: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: sdv: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdu: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: SCSI device sdv: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdu : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: sdv : very big device. try to use READ CAPACITY(16). Mar 26 09:42:35 ALPL402 kernel: SCSI device sdu: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: SCSI device sdv: 4412407808 512-byte hdwr sectors (2259153 MB) Mar 26 09:42:35 ALPL402 kernel: sdu: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: sdv: Write Protect is off Mar 26 09:42:35 ALPL402 kernel: SCSI device sdu: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdu:<5>SCSI device sdv: drive cache: write back w/ FUA Mar 26 09:42:35 ALPL402 kernel: sdv: unknown partition table Mar 26 09:42:35 ALPL402 kernel: unknown partition table Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:9: Attached scsi disk sdu Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:9: Attached scsi disk sdv Mar 26 09:42:35 ALPL402 kernel: sd 7:0:0:9: Attached scsi generic sg20 type 0 Mar 26 09:42:35 ALPL402 kernel: sd 6:0:0:9: Attached scsi generic sg21 type 0 Mar 26 09:42:35 ALPL402 multipathd: failed to find rport_id for target7:0:0 Mar 26 09:42:35 ALPL402 multipathd: OST05: load table [0 4412407808 multipath 0 0 1 1 round-robin 0 1 1 8:192 10] Mar 26 09:42:35 ALPL402 multipathd: OST05: event checker started Mar 26 09:42:35 ALPL402 multipathd: sdn: add path (uevent) Mar 26 09:42:36 ALPL402 multipathd: failed to find rport_id for target7:0:0 Mar 26 09:42:36 ALPL402 multipathd: OST05: load table [0 4412407808 multipath 0 0 2 1 round-robin 0 1 1 8:192 10 round-robin 0 1 1 8:208 10] Mar 26 09:42:36 ALPL402 multipathd: sdo: add path (uevent) Mar 26 09:42:36 ALPL402 multipathd: failed to find rport_id for target6:0:0 Mar 26 09:42:36 ALPL402 multipathd: OST06: load table [0 4412407808 multipath 0 0 1 1 round-robin 0 1 1 8:224 10] Mar 26 09:42:36 ALPL402 multipathd: OST06: event checker started Mar 26 09:42:36 ALPL402 multipathd: sdq: add path (uevent) Mar 26 09:42:36 ALPL402 multipathd: failed to find rport_id for target6:0:0 Mar 26 09:42:36 ALPL402 multipathd: OST06: load table [0 4412407808 multipath 0 0 2 1 round-robin 0 1 1 65:0 10 round-robin 0 1 1 8:224 10] Mar 26 09:42:36 ALPL402 multipathd: sdr: add path (uevent) Mar 26 09:42:36 ALPL402 multipathd: failed to find rport_id for target7:0:0 Mar 26 09:42:36 ALPL402 multipathd: OST07: load table [0 4412407808 multipath 0 0 1 1 round-robin 0 1 1 65:16 10] Mar 26 09:42:36 ALPL402 multipathd: OST07: event checker started Mar 26 09:42:36 ALPL402 multipathd: sdp: add path (uevent) Mar 26 09:42:36 ALPL402 multipathd: failed to find rport_id for target7:0:0 Mar 26 09:42:36 ALPL402 multipathd: OST07: load table [0 4412407808 multipath 0 0 2 1 round-robin 0 1 1 65:16 10 round-robin 0 1 1 8:240 10] Mar 26 09:42:36 ALPL402 multipathd: sds: add path (uevent) Mar 26 09:42:36 ALPL402 multipathd: failed to find rport_id for target7:0:0 Mar 26 09:42:36 ALPL402 multipathd: OST08: load table [0 4412407808 multipath 0 0 1 1 round-robin 0 1 1 65:32 10] Mar 26 09:42:36 ALPL402 multipathd: OST08: event checker started Mar 26 09:42:36 ALPL402 multipathd: sdt: add path (uevent) Mar 26 09:42:36 ALPL402 multipathd: failed to find rport_id for target7:0:0 Mar 26 09:42:36 ALPL402 multipathd: OST08: load table [0 4412407808 multipath 0 0 2 1 round-robin 0 1 1 65:32 10 round-robin 0 1 1 65:48 10] Mar 26 09:42:36 ALPL402 multipathd: sdu: add path (uevent) Mar 26 09:42:36 ALPL402 multipathd: failed to find rport_id for target7:0:0 Mar 26 09:42:36 ALPL402 multipathd: OST09: load table [0 4412407808 multipath 0 0 1 1 round-robin 0 1 1 65:64 10] Mar 26 09:42:36 ALPL402 multipathd: OST09: event checker started Mar 26 09:42:36 ALPL402 multipathd: sdv: add path (uevent) Mar 26 09:42:36 ALPL402 multipathd: failed to find rport_id for target7:0:0 Mar 26 09:42:36 ALPL402 multipathd: OST09: load table [0 4412407808 multipath 0 0 2 1 round-robin 0 1 1 65:64 10 round-robin 0 1 1 65:80 10] Mar 26 09:42:36 ALPL402 multipathd: dm-0: add map (uevent) Mar 26 09:42:36 ALPL402 multipathd: dm-0: devmap already registered Mar 26 09:42:36 ALPL402 multipathd: dm-1: add map (uevent) Mar 26 09:42:36 ALPL402 multipathd: dm-1: devmap already registered Mar 26 09:42:36 ALPL402 multipathd: dm-2: add map (uevent) Mar 26 09:42:36 ALPL402 multipathd: dm-2: devmap already registered Mar 26 09:42:36 ALPL402 multipathd: dm-3: add map (uevent) Mar 26 09:42:36 ALPL402 multipathd: dm-3: devmap already registered Mar 26 09:42:36 ALPL402 multipathd: dm-0: add map (uevent) Mar 26 09:42:36 ALPL402 multipathd: dm-0: devmap already registered Mar 26 09:42:36 ALPL402 multipathd: dm-1: add map (uevent) Mar 26 09:42:36 ALPL402 multipathd: dm-1: devmap already registered Mar 26 09:42:36 ALPL402 multipathd: dm-2: add map (uevent) Mar 26 09:42:36 ALPL402 multipathd: dm-2: devmap already registered Mar 26 09:42:36 ALPL402 multipathd: dm-3: add map (uevent) Mar 26 09:42:36 ALPL402 multipathd: dm-3: devmap already registered Mar 26 09:42:36 ALPL402 multipathd: dm-4: add map (uevent) Mar 26 09:42:36 ALPL402 multipathd: dm-4: devmap already registered Mar 26 09:42:36 ALPL402 multipathd: dm-4: add map (uevent) Mar 26 09:42:36 ALPL402 multipathd: dm-4: devmap already registered Mar 26 09:42:36 ALPL402 multipathd: dm-5: add map (uevent) Mar 26 09:42:36 ALPL402 multipathd: dm-5: devmap already registered Mar 26 09:42:36 ALPL402 multipathd: dm-5: add map (uevent) Mar 26 09:42:36 ALPL402 multipathd: dm-5: devmap already registered Mar 26 09:42:36 ALPL402 multipathd: dm-6: add map (uevent) Mar 26 09:42:36 ALPL402 multipathd: dm-6: devmap already registered Mar 26 09:42:36 ALPL402 multipathd: dm-6: add map (uevent) Mar 26 09:42:36 ALPL402 multipathd: dm-6: devmap already registered Mar 26 09:42:36 ALPL402 multipathd: dm-7: add map (uevent) Mar 26 09:42:36 ALPL402 multipathd: dm-7: devmap already registered Mar 26 09:42:36 ALPL402 multipathd: dm-7: add map (uevent) Mar 26 09:42:36 ALPL402 multipathd: dm-7: devmap already registered Mar 26 09:42:36 ALPL402 multipathd: dm-8: add map (uevent) Mar 26 09:42:36 ALPL402 multipathd: dm-8: devmap already registered Mar 26 09:42:36 ALPL402 multipathd: dm-8: add map (uevent) Mar 26 09:42:36 ALPL402 multipathd: dm-8: devmap already registered Mar 26 09:42:36 ALPL402 multipathd: dm-9: add map (uevent) Mar 26 09:42:36 ALPL402 multipathd: dm-9: devmap already registered Mar 26 09:42:36 ALPL402 multipathd: dm-9: add map (uevent) Mar 26 09:42:36 ALPL402 multipathd: dm-9: devmap already registered Mar 26 09:42:39 ALPL402 automount[6074]: lookup_read_master: lookup(nisplus): couldn't locate nis+ table auto.master Mar 26 09:42:39 ALPL402 hpiod: 1.6.7 accepting connections at 2208... Mar 26 09:42:40 ALPL402 xinetd[6224]: xinetd Version 2.3.14 started with libwrap loadavg labeled-networking options compiled in. Mar 26 09:42:40 ALPL402 xinetd[6224]: Started working: 0 available services Mar 26 09:42:40 ALPL402 ntpd[6235]: ntpd 4.2.2p1@1.1570-o Fri Nov 18 13:21:21 UTC 2011 (1) Mar 26 09:42:40 ALPL402 ntpd[6248]: precision = 1.000 usec Mar 26 09:42:40 ALPL402 ntpd[6248]: Listening on interface wildcard, 0.0.0.0#123 Disabled Mar 26 09:42:40 ALPL402 ntpd[6248]: Listening on interface wildcard, ::#123 Disabled Mar 26 09:42:40 ALPL402 ntpd[6248]: Listening on interface lo, ::1#123 Enabled Mar 26 09:42:40 ALPL402 ntpd[6248]: Listening on interface ib0, fe80::225:90ff:ff07:1419#123 Enabled Mar 26 09:42:40 ALPL402 ntpd[6248]: Listening on interface eth2, fe80::225:90ff:fe14:fb36#123 Enabled Mar 26 09:42:40 ALPL402 ntpd[6248]: Listening on interface eth0, fe80::225:90ff:fe14:fb34#123 Enabled Mar 26 09:42:40 ALPL402 ntpd[6248]: Listening on interface lo, 127.0.0.1#123 Enabled Mar 26 09:42:40 ALPL402 ntpd[6248]: Listening on interface eth0, 10.2.4.69#123 Enabled Mar 26 09:42:40 ALPL402 ntpd[6248]: Listening on interface eth2, 192.168.4.69#123 Enabled Mar 26 09:42:40 ALPL402 ntpd[6248]: Listening on interface ib0, 10.3.4.69#123 Enabled Mar 26 09:42:40 ALPL402 ntpd[6248]: kernel time sync status 0040 Mar 26 09:42:41 ALPL402 ntpd[6248]: frequency initialized 95.879 PPM from /var/lib/ntp/drift Mar 26 09:42:41 ALPL402 gpm[6360]: *** info [startup.c(95)]: Mar 26 09:42:41 ALPL402 gpm[6360]: Started gpm successfully. Entered daemon mode. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: Found user 'avahi' (UID 70) and group 'avahi' (GID 70). Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: Successfully dropped root privileges. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: avahi-daemon 0.6.16 starting up. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: WARNING: No NSS support for mDNS detected, consider installing nss-mdns! Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: Successfully called chroot(). Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: Successfully dropped remaining capabilities. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: No service found in /etc/avahi/services. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: New relevant interface ib0.IPv6 for mDNS. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: Joining mDNS multicast group on interface ib0.IPv6 with address fe80::225:90ff:ff07:1419. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: New relevant interface ib0.IPv4 for mDNS. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: Joining mDNS multicast group on interface ib0.IPv4 with address 10.3.4.69. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: New relevant interface eth2.IPv6 for mDNS. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: Joining mDNS multicast group on interface eth2.IPv6 with address fe80::225:90ff:fe14:fb36. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: New relevant interface eth2.IPv4 for mDNS. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: Joining mDNS multicast group on interface eth2.IPv4 with address 192.168.4.69. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: New relevant interface eth0.IPv6 for mDNS. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: Joining mDNS multicast group on interface eth0.IPv6 with address fe80::225:90ff:fe14:fb34. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: New relevant interface eth0.IPv4 for mDNS. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: Joining mDNS multicast group on interface eth0.IPv4 with address 10.2.4.69. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: Network interface enumeration completed. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: Registering new address record for fe80::225:90ff:ff07:1419 on ib0. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: Registering new address record for 10.3.4.69 on ib0. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: Registering new address record for fe80::225:90ff:fe14:fb36 on eth2. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: Registering new address record for 192.168.4.69 on eth2. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: Registering new address record for fe80::225:90ff:fe14:fb34 on eth0. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: Registering new address record for 10.2.4.69 on eth0. Mar 26 09:42:41 ALPL402 avahi-daemon[6471]: Registering HINFO record with values 'X86_64'/'LINUX'. Mar 26 09:42:42 ALPL402 smartd[6683]: smartd version 5.38 [x86_64-redhat-linux-gnu] Copyright (C) 2002-8 Bruce Allen Mar 26 09:42:42 ALPL402 smartd[6683]: Home page is http://smartmontools.sourceforge.net/ Mar 26 09:42:42 ALPL402 smartd[6683]: Opened configuration file /etc/smartd.conf Mar 26 09:42:42 ALPL402 smartd[6683]: Configuration file /etc/smartd.conf was parsed, found DEVICESCAN, scanning devices Mar 26 09:42:42 ALPL402 smartd[6683]: Problem creating device name scan list Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sda, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device /dev/sda: using '-d sat' for ATA disk behind SAT layer. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sda, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sda, not found in smartd database. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sda, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdb, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device /dev/sdb: using '-d sat' for ATA disk behind SAT layer. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdb, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdb, not found in smartd database. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdb, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdc, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdc, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdd, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdd, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sde, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sde, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdf, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdf, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdg, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdg, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdh, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdh, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdi, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdi, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdj, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdj, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdk, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdk, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdl, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdl, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdm, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdm, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdn, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdn, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdo, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdo, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdp, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdp, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdq, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdq, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdr, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdr, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sds, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sds, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdt, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdt, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdu, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdu, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdv, opened Mar 26 09:42:42 ALPL402 smartd[6683]: Device: /dev/sdv, is SMART capable. Adding to "monitor" list. Mar 26 09:42:42 ALPL402 smartd[6683]: Monitoring 0 ATA and 22 SCSI devices Mar 26 09:42:42 ALPL402 avahi-daemon[6471]: Server startup complete. Host name is ALPL402.local. Local service cookie is 581988288. Mar 26 09:42:42 ALPL402 smartd[6724]: smartd has fork()ed into background mode. New PID=6724. Mar 26 09:42:44 ALPL402 kernel: mtrr: type mismatch for f9000000,800000 old: write-back new: write-combining Mar 26 09:42:44 ALPL402 pcscd: winscard.c:304:SCardConnect() Reader E-Gate 0 0 Not Found Mar 26 09:42:44 ALPL402 kernel: mtrr: type mismatch for f9000000,1000000 old: write-back new: write-combining Mar 26 09:42:44 ALPL402 pcscd: winscard.c:304:SCardConnect() Reader E-Gate 0 0 Not Found Mar 26 09:42:44 ALPL402 last message repeated 2 times Mar 26 09:42:45 ALPL402 kernel: mtrr: type mismatch for f9fe0000,10000 old: write-back new: write-combining Mar 26 09:42:45 ALPL402 kernel: mtrr: type mismatch for f9fc0000,20000 old: write-back new: write-combining Mar 26 09:42:45 ALPL402 kernel: mtrr: type mismatch for f9f80000,40000 old: write-back new: write-combining Mar 26 09:42:45 ALPL402 kernel: mtrr: type mismatch for f9f00000,80000 old: write-back new: write-combining Mar 26 09:42:45 ALPL402 kernel: mtrr: type mismatch for f9e00000,100000 old: write-back new: write-combining Mar 26 09:42:45 ALPL402 kernel: mtrr: type mismatch for f9c00000,200000 old: write-back new: write-combining Mar 26 09:42:45 ALPL402 kernel: mtrr: type mismatch for f9800000,400000 old: write-back new: write-combining Mar 26 09:42:45 ALPL402 kernel: mtrr: type mismatch for f9000000,800000 old: write-back new: write-combining Mar 26 09:42:46 ALPL402 kernel: mtrr: type mismatch for f9fe0000,10000 old: write-back new: write-combining Mar 26 09:42:46 ALPL402 kernel: mtrr: type mismatch for f9fc0000,20000 old: write-back new: write-combining Mar 26 09:42:46 ALPL402 kernel: mtrr: type mismatch for f9f80000,40000 old: write-back new: write-combining Mar 26 09:42:46 ALPL402 kernel: mtrr: type mismatch for f9f00000,80000 old: write-back new: write-combining Mar 26 09:42:46 ALPL402 kernel: mtrr: type mismatch for f9e00000,100000 old: write-back new: write-combining Mar 26 09:42:46 ALPL402 kernel: mtrr: type mismatch for f9c00000,200000 old: write-back new: write-combining Mar 26 09:42:46 ALPL402 kernel: mtrr: type mismatch for f9800000,400000 old: write-back new: write-combining Mar 26 09:42:46 ALPL402 kernel: mtrr: type mismatch for f9000000,800000 old: write-back new: write-combining Mar 26 09:42:47 ALPL402 kernel: cm_dreq_handler: no cm_id_priv Mar 26 09:45:57 ALPL402 ntpd[6248]: synchronized to LOCAL(0), stratum 10 Mar 26 09:45:57 ALPL402 ntpd[6248]: kernel time sync enabled 0001 Mar 26 09:46:16 ALPL402 kernel: cm_dreq_handler: no cm_id_priv Mar 26 09:52:32 ALPL402 kernel: cm_req_handler: no listen_cm_id_priv Mar 26 09:53:14 ALPL402 last message repeated 18 times Mar 26 09:58:02 ALPL402 last message repeated 9 times Mar 26 09:58:23 ALPL402 last message repeated 584 times Mar 26 09:58:23 ALPL402 kernel: Lustre: Build Version: jenkins--PRISTINE-2.6.18-348.3.1.el5_lustre.1.8.9.ddn8 Mar 26 09:58:24 ALPL402 kernel: cm_req_handler: no listen_cm_id_priv Mar 26 09:58:24 ALPL402 last message repeated 5 times Mar 26 09:58:24 ALPL402 kernel: Lustre: Listener bound to ib0:10.3.4.69:987:mlx4_0 Mar 26 09:58:24 ALPL402 kernel: LustreError: 3351:0:(o2iblnd_cb.c:2168:kiblnd_passive_connect()) Can't accept 10.3.8.59@o2ib on NA (ib0:0:10.3.4.69): bad dst nid 10.3.4.69@o2ib Mar 26 09:58:24 ALPL402 kernel: Lustre: Added LNI 10.3.4.69@o2ib [8/64/0/180] Mar 26 09:58:24 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:24 ALPL402 last message repeated 13 times Mar 26 09:58:24 ALPL402 kernel: Lustre: Lustre Client File System; http://www.lustre.org/ Mar 26 09:58:24 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:24 ALPL402 last message repeated 13 times Mar 26 09:58:24 ALPL402 kernel: init dynlocks cache Mar 26 09:58:24 ALPL402 kernel: ldiskfs created from ext4-2.6-rhel5 Mar 26 09:58:24 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:24 ALPL402 last message repeated 4 times Mar 26 09:58:24 ALPL402 kernel: LDISKFS-fs (dm-5): mounted filesystem with ordered data mode Mar 26 09:58:24 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:24 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:24 ALPL402 multipathd: dm-5: umount map (uevent) Mar 26 09:58:24 ALPL402 kernel: JBD: barrier-based sync failed on dm-5-8 - disabling barriers Mar 26 09:58:24 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:24 ALPL402 last message repeated 2 times Mar 26 09:58:24 ALPL402 kernel: LDISKFS-fs (dm-5): mounted filesystem with ordered data mode Mar 26 09:58:24 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:24 ALPL402 last message repeated 8 times Mar 26 09:58:24 ALPL402 kernel: Lustre: MGC10.3.5.72@o2ib: Reactivating import Mar 26 09:58:24 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:25 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:25 ALPL402 kernel: LustreError: 137-5: UUID 'LFS05-OST0059_UUID' is not available for connect (no target) Mar 26 09:58:25 ALPL402 kernel: LustreError: 8771:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-19) req@ffff810606aca400 x1496543088982704/t0 o8->@:0/0 lens 368/0 e 0 to 0 dl 1427335205 ref 1 fl Interpret:/0/0 rc -19/0 Mar 26 09:58:25 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:25 ALPL402 kernel: LustreError: 137-5: UUID 'LFS05-OST0058_UUID' is not available for connect (no target) Mar 26 09:58:25 ALPL402 kernel: LustreError: 8772:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-19) req@ffff810606acac00 x1496550317669821/t0 o8->@:0/0 lens 368/0 e 0 to 0 dl 1427335205 ref 1 fl Interpret:/0/0 rc -19/0 Mar 26 09:58:25 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:25 ALPL402 last message repeated 22 times Mar 26 09:58:25 ALPL402 kernel: LustreError: 137-5: UUID 'LFS05-OST0059_UUID' is not available for connect (no target) Mar 26 09:58:25 ALPL402 kernel: LustreError: Skipped 43 previous similar messages Mar 26 09:58:25 ALPL402 kernel: LustreError: 8804:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-19) req@ffff8106040c8c00 x1492484819684540/t0 o8->@:0/0 lens 368/0 e 0 to 0 dl 1427335205 ref 1 fl Interpret:/0/0 rc -19/0 Mar 26 09:58:25 ALPL402 kernel: LustreError: 8804:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 43 previous similar messages Mar 26 09:58:25 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:26 ALPL402 last message repeated 39 times Mar 26 09:58:26 ALPL402 kernel: LustreError: 137-5: UUID 'LFS05-OST0056_UUID' is not available for connect (no target) Mar 26 09:58:26 ALPL402 kernel: LustreError: Skipped 75 previous similar messages Mar 26 09:58:26 ALPL402 kernel: LustreError: 8857:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-19) req@ffff8106036bb000 x1496665234126465/t0 o8->@:0/0 lens 368/0 e 0 to 0 dl 1427335206 ref 1 fl Interpret:/0/0 rc -19/0 Mar 26 09:58:26 ALPL402 kernel: LustreError: 8857:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 75 previous similar messages Mar 26 09:58:26 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:28 ALPL402 last message repeated 66 times Mar 26 09:58:28 ALPL402 kernel: LustreError: 137-5: UUID 'LFS05-OST0058_UUID' is not available for connect (no target) Mar 26 09:58:28 ALPL402 kernel: LustreError: Skipped 176 previous similar messages Mar 26 09:58:28 ALPL402 kernel: LustreError: 8855:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-19) req@ffff810602425800 x1496665135583757/t0 o8->@:0/0 lens 368/0 e 0 to 0 dl 1427335208 ref 1 fl Interpret:/0/0 rc -19/0 Mar 26 09:58:28 ALPL402 kernel: LustreError: 8855:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 176 previous similar messages Mar 26 09:58:28 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:32 ALPL402 last message repeated 104 times Mar 26 09:58:32 ALPL402 kernel: LustreError: 137-5: UUID 'LFS05-OST0058_UUID' is not available for connect (no target) Mar 26 09:58:32 ALPL402 kernel: LustreError: Skipped 392 previous similar messages Mar 26 09:58:32 ALPL402 kernel: LustreError: 8898:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-19) req@ffff810601c3e800 x1496527588824280/t0 o8->@:0/0 lens 368/0 e 0 to 0 dl 1427335212 ref 1 fl Interpret:/0/0 rc -19/0 Mar 26 09:58:32 ALPL402 kernel: LustreError: 8898:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 392 previous similar messages Mar 26 09:58:32 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:37 ALPL402 last message repeated 132 times Mar 26 09:58:37 ALPL402 kernel: JBD: barrier-based sync failed on dm-5-8 - disabling barriers Mar 26 09:58:37 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:37 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:37 ALPL402 kernel: Lustre: Filtering OBD driver; http://wiki.whamcloud.com/ Mar 26 09:58:37 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:37 ALPL402 last message repeated 2 times Mar 26 09:58:37 ALPL402 kernel: Lustre: 9062:0:(filter.c:1003:filter_init_server_data()) RECOVERY: service LFS05-OST0055, 548 recoverable clients, 0 delayed clients, last_rcvd 55834584613 Mar 26 09:58:37 ALPL402 kernel: Lustre: LFS05-OST0055: Now serving LFS05-OST0055 on /dev/mpath/OST05 with recovery enabled Mar 26 09:58:37 ALPL402 kernel: Lustre: LFS05-OST0055: Will be in recovery for at least 5:00, or until 548 clients reconnect Mar 26 09:58:37 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:37 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:37 ALPL402 kernel: Lustre: 8895:0:(ldlm_lib.c:1817:target_queue_last_replay_reply()) LFS05-OST0055: 547 recoverable clients remain Mar 26 09:58:38 ALPL402 kernel: Lustre: 8784:0:(ldlm_lib.c:1817:target_queue_last_replay_reply()) LFS05-OST0055: 546 recoverable clients remain Mar 26 09:58:38 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:38 ALPL402 last message repeated 4 times Mar 26 09:58:38 ALPL402 kernel: LDISKFS-fs (dm-6): mounted filesystem with ordered data mode Mar 26 09:58:38 ALPL402 multipathd: dm-6: umount map (uevent) Mar 26 09:58:38 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:38 ALPL402 kernel: JBD: barrier-based sync failed on dm-6-8 - disabling barriers Mar 26 09:58:38 ALPL402 kernel: LDISKFS-fs (dm-6): mounted filesystem with ordered data mode Mar 26 09:58:38 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:38 ALPL402 last message repeated 10 times Mar 26 09:58:38 ALPL402 kernel: Lustre: 8850:0:(ldlm_lib.c:1817:target_queue_last_replay_reply()) LFS05-OST0055: 536 recoverable clients remain Mar 26 09:58:38 ALPL402 kernel: Lustre: 8850:0:(ldlm_lib.c:1817:target_queue_last_replay_reply()) Skipped 9 previous similar messages Mar 26 09:58:38 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:41 ALPL402 last message repeated 69 times Mar 26 09:58:41 ALPL402 kernel: LustreError: 137-5: UUID 'LFS05-OST0059_UUID' is not available for connect (no target) Mar 26 09:58:41 ALPL402 kernel: LustreError: Skipped 689 previous similar messages Mar 26 09:58:41 ALPL402 kernel: LustreError: 9535:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-19) req@ffff8105fa958800 x1496539171887183/t0 o8->@:0/0 lens 368/0 e 0 to 0 dl 1427335268 ref 1 fl Interpret:/0/0 rc -19/0 Mar 26 09:58:41 ALPL402 kernel: LustreError: 9535:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 689 previous similar messages Mar 26 09:58:41 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:41 ALPL402 last message repeated 8 times Mar 26 09:58:41 ALPL402 kernel: Lustre: 9217:0:(ldlm_lib.c:1817:target_queue_last_replay_reply()) LFS05-OST0055: 535 recoverable clients remain Mar 26 09:58:41 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:44 ALPL402 last message repeated 19 times Mar 26 09:58:44 ALPL402 kernel: Lustre: 9427:0:(ldlm_lib.c:1817:target_queue_last_replay_reply()) LFS05-OST0055: 477 recoverable clients remain Mar 26 09:58:44 ALPL402 kernel: Lustre: 9427:0:(ldlm_lib.c:1817:target_queue_last_replay_reply()) Skipped 57 previous similar messages Mar 26 09:58:44 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 09:58:45 ALPL402 last message repeated 5 times Mar 26 09:58:49 ALPL402 kernel: Lustre: 9355:0:(ldlm_lib.c:1817:target_queue_last_replay_reply()) LFS05-OST0055: 424 recoverable clients remain Mar 26 09:58:49 ALPL402 kernel: Lustre: 9355:0:(ldlm_lib.c:1817:target_queue_last_replay_reply()) Skipped 52 previous similar messages Mar 26 09:58:57 ALPL402 kernel: Lustre: 9594:0:(ldlm_lib.c:1817:target_queue_last_replay_reply()) LFS05-OST0055: 318 recoverable clients remain Mar 26 09:58:57 ALPL402 kernel: Lustre: 9594:0:(ldlm_lib.c:1817:target_queue_last_replay_reply()) Skipped 105 previous similar messages Mar 26 09:58:58 ALPL402 kernel: JBD: barrier-based sync failed on dm-6-8 - disabling barriers Mar 26 09:58:58 ALPL402 kernel: Lustre: 9655:0:(filter.c:1003:filter_init_server_data()) RECOVERY: service LFS05-OST0056, 548 recoverable clients, 0 delayed clients, last_rcvd 55834588413 Mar 26 09:58:58 ALPL402 kernel: Lustre: LFS05-OST0056: Now serving LFS05-OST0056 on /dev/mpath/OST06 with recovery enabled Mar 26 09:58:58 ALPL402 kernel: Lustre: LFS05-OST0056: Will be in recovery for at least 7:30, or until 548 clients reconnect Mar 26 09:58:59 ALPL402 kernel: LDISKFS-fs (dm-7): mounted filesystem with ordered data mode Mar 26 09:58:59 ALPL402 multipathd: dm-7: umount map (uevent) Mar 26 09:58:59 ALPL402 kernel: JBD: barrier-based sync failed on dm-7-8 - disabling barriers Mar 26 09:58:59 ALPL402 kernel: LDISKFS-fs (dm-7): mounted filesystem with ordered data mode Mar 26 09:58:59 ALPL402 kernel: JBD: barrier-based sync failed on dm-7-8 - disabling barriers Mar 26 09:58:59 ALPL402 kernel: LDISKFS-fs (dm-8): mounted filesystem with ordered data mode Mar 26 09:58:59 ALPL402 multipathd: dm-8: umount map (uevent) Mar 26 09:58:59 ALPL402 kernel: JBD: barrier-based sync failed on dm-8-8 - disabling barriers Mar 26 09:58:59 ALPL402 kernel: LDISKFS-fs (dm-8): mounted filesystem with ordered data mode Mar 26 09:59:00 ALPL402 kernel: LustreError: 137-5: UUID 'LFS05-OST0058_UUID' is not available for connect (no target) Mar 26 09:59:00 ALPL402 kernel: LustreError: Skipped 1698 previous similar messages Mar 26 09:59:00 ALPL402 kernel: LustreError: 9530:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-19) req@ffff810c2dc5f800 x1496514107029154/t0 o8->@:0/0 lens 368/0 e 0 to 0 dl 1427335285 ref 1 fl Interpret:/0/0 rc -19/0 Mar 26 09:59:00 ALPL402 kernel: LustreError: 9530:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 1698 previous similar messages Mar 26 09:59:03 ALPL402 kernel: Lustre: 9977:0:(filter.c:1003:filter_init_server_data()) RECOVERY: service LFS05-OST0058, 548 recoverable clients, 0 delayed clients, last_rcvd 55834586106 Mar 26 09:59:03 ALPL402 kernel: Lustre: 9977:0:(filter.c:1003:filter_init_server_data()) Skipped 1 previous similar message Mar 26 09:59:03 ALPL402 kernel: JBD: barrier-based sync failed on dm-8-8 - disabling barriers Mar 26 09:59:03 ALPL402 kernel: Lustre: LFS05-OST0058: Now serving LFS05-OST0058 on /dev/mpath/OST08 with recovery enabled Mar 26 09:59:03 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 26 09:59:03 ALPL402 kernel: Lustre: LFS05-OST0058: Will be in recovery for at least 7:30, or until 548 clients reconnect Mar 26 09:59:03 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 26 09:59:03 ALPL402 kernel: LDISKFS-fs (dm-9): mounted filesystem with ordered data mode Mar 26 09:59:03 ALPL402 multipathd: dm-9: umount map (uevent) Mar 26 09:59:03 ALPL402 kernel: JBD: barrier-based sync failed on dm-9-8 - disabling barriers Mar 26 09:59:03 ALPL402 kernel: LDISKFS-fs (dm-9): mounted filesystem with ordered data mode Mar 26 09:59:06 ALPL402 kernel: Lustre: 10115:0:(filter.c:1003:filter_init_server_data()) RECOVERY: service LFS05-OST0059, 548 recoverable clients, 0 delayed clients, last_rcvd 60129555593 Mar 26 09:59:06 ALPL402 kernel: JBD: barrier-based sync failed on dm-9-8 - disabling barriers Mar 26 09:59:06 ALPL402 kernel: Lustre: LFS05-OST0059: Now serving LFS05-OST0059 on /dev/mpath/OST09 with recovery enabled Mar 26 09:59:06 ALPL402 kernel: Lustre: LFS05-OST0059: Will be in recovery for at least 7:30, or until 548 clients reconnect Mar 26 09:59:13 ALPL402 kernel: Lustre: 9574:0:(ldlm_lib.c:1817:target_queue_last_replay_reply()) LFS05-OST0055: 232 recoverable clients remain Mar 26 09:59:13 ALPL402 kernel: Lustre: 9574:0:(ldlm_lib.c:1817:target_queue_last_replay_reply()) Skipped 85 previous similar messages Mar 26 09:59:34 ALPL402 kernel: Lustre: 8852:0:(ldlm_lib.c:576:target_handle_reconnect()) LFS05-OST0055: 8984164d-b00e-6364-e3f0-8643c1b31924 reconnecting Mar 26 09:59:34 ALPL402 kernel: Lustre: 9583:0:(ldlm_lib.c:576:target_handle_reconnect()) LFS05-OST0056: 30dc8756-266b-ac57-4c2e-23e5e56c33f4 reconnecting Mar 26 09:59:34 ALPL402 kernel: Lustre: 9583:0:(ldlm_lib.c:576:target_handle_reconnect()) Skipped 2 previous similar messages Mar 26 09:59:36 ALPL402 kernel: Lustre: 9304:0:(ldlm_lib.c:576:target_handle_reconnect()) LFS05-OST0057: de29fdf2-ebf1-0e28-797d-c8eb4183facf reconnecting Mar 26 09:59:36 ALPL402 kernel: Lustre: 9304:0:(ldlm_lib.c:576:target_handle_reconnect()) Skipped 1652 previous similar messages Mar 26 09:59:38 ALPL402 kernel: Lustre: 9534:0:(ldlm_lib.c:576:target_handle_reconnect()) LFS05-OST0057: de396942-5212-db8e-fb36-635fb1be6c72 reconnecting Mar 26 09:59:42 ALPL402 kernel: Lustre: 9505:0:(ldlm_lib.c:576:target_handle_reconnect()) LFS05-OST0059: 460108d8-24d5-5d81-4cea-dba4a6f4c3b6 reconnecting Mar 26 09:59:42 ALPL402 kernel: Lustre: 9505:0:(ldlm_lib.c:576:target_handle_reconnect()) Skipped 3 previous similar messages Mar 26 09:59:46 ALPL402 kernel: Lustre: 9596:0:(ldlm_lib.c:576:target_handle_reconnect()) LFS05-OST0056: 7d534484-993f-859e-8a77-1fef8cefaabd reconnecting Mar 26 09:59:46 ALPL402 kernel: Lustre: 9596:0:(ldlm_lib.c:576:target_handle_reconnect()) Skipped 8 previous similar messages Mar 26 09:59:49 ALPL402 kernel: Lustre: 9386:0:(ldlm_lib.c:1817:target_queue_last_replay_reply()) LFS05-OST0057: 290 recoverable clients remain Mar 26 09:59:49 ALPL402 kernel: Lustre: 9386:0:(ldlm_lib.c:1817:target_queue_last_replay_reply()) Skipped 901 previous similar messages Mar 26 09:59:55 ALPL402 kernel: Lustre: 9345:0:(ldlm_lib.c:576:target_handle_reconnect()) LFS05-OST0057: bbecce1b-46d2-fce6-bd2f-5c6e58454694 reconnecting Mar 26 09:59:55 ALPL402 kernel: Lustre: 9345:0:(ldlm_lib.c:576:target_handle_reconnect()) Skipped 21 previous similar messages Mar 26 10:00:12 ALPL402 kernel: Lustre: 8874:0:(ldlm_lib.c:576:target_handle_reconnect()) LFS05-OST0057: 1411a38a-890a-52f5-be5e-7ac1aa9573d2 reconnecting Mar 26 10:00:12 ALPL402 kernel: Lustre: 8874:0:(ldlm_lib.c:576:target_handle_reconnect()) Skipped 28 previous similar messages Mar 26 10:00:44 ALPL402 kernel: Lustre: 8795:0:(ldlm_lib.c:576:target_handle_reconnect()) LFS05-OST0056: 6ef563fe-6f5a-4128-39eb-6fe7c30026c1 reconnecting Mar 26 10:00:44 ALPL402 kernel: Lustre: 8795:0:(ldlm_lib.c:576:target_handle_reconnect()) Skipped 3134 previous similar messages Mar 26 10:00:56 ALPL402 kernel: Lustre: 9325:0:(ldlm_lib.c:1817:target_queue_last_replay_reply()) LFS05-OST0059: 244 recoverable clients remain Mar 26 10:00:56 ALPL402 kernel: Lustre: 9325:0:(ldlm_lib.c:1817:target_queue_last_replay_reply()) Skipped 520 previous similar messages Mar 26 10:01:49 ALPL402 kernel: Lustre: 9437:0:(ldlm_lib.c:576:target_handle_reconnect()) LFS05-OST0058: 2744d862-37d9-c361-d117-ec53a78dfc28 reconnecting Mar 26 10:01:49 ALPL402 kernel: Lustre: 9287:0:(ldlm_lib.c:576:target_handle_reconnect()) LFS05-OST0058: 2f229197-8f7c-d7f7-53a3-25d4a2131cce reconnecting Mar 26 10:01:49 ALPL402 kernel: Lustre: 9287:0:(ldlm_lib.c:576:target_handle_reconnect()) Skipped 1923 previous similar messages Mar 26 10:01:50 ALPL402 kernel: Lustre: LFS05-OST0055: Recovery period over after 3:13, of 548 clients 548 recovered and 0 were evicted. Mar 26 10:01:50 ALPL402 kernel: Lustre: LFS05-OST0055: sending delayed replies to recovered clients Mar 26 10:01:51 ALPL402 kernel: Lustre: LFS05-OST0055: received MDS connection from 10.3.5.72@o2ib Mar 26 10:01:51 ALPL402 kernel: Lustre: 8788:0:(filter.c:3123:filter_destroy_precreated()) LFS05-OST0055: deleting orphan objects from 401717201 to 401720691, orphan objids won't be reused any more. Mar 26 10:02:24 ALPL402 kernel: Lustre: LFS05-OST0055: slow journal start 33s due to heavy IO load Mar 26 10:02:24 ALPL402 kernel: Lustre: LFS05-OST0055: slow brw_start 33s due to heavy IO load Mar 26 10:02:24 ALPL402 kernel: Lustre: LFS05-OST0055: slow journal start 33s due to heavy IO load Mar 26 10:02:24 ALPL402 kernel: Lustre: Skipped 2 previous similar messages Mar 26 10:02:24 ALPL402 kernel: Lustre: Skipped 2 previous similar messages Mar 26 10:02:24 ALPL402 kernel: Lustre: LFS05-OST0055: slow journal start 33s due to heavy IO load Mar 26 10:02:24 ALPL402 kernel: Lustre: LFS05-OST0055: slow commitrw commit 33s due to heavy IO load Mar 26 10:02:24 ALPL402 kernel: Lustre: LFS05-OST0055: slow i_mutex 33s due to heavy IO load Mar 26 10:02:24 ALPL402 kernel: Lustre: LFS05-OST0055: slow quota init 33s due to heavy IO load Mar 26 10:02:24 ALPL402 kernel: Lustre: LFS05-OST0055: slow direct_io 33s due to heavy IO load Mar 26 10:04:16 ALPL402 kernel: Lustre: LFS05-OST0055: haven't heard from client 00e04480-a2d7-9b3b-5761-0fa7320a1b81 (at 10.3.9.21@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 10:04:21 ALPL402 kernel: LustreError: 0:0:(ldlm_lockd.c:315:waiting_locks_callback()) ### lock callback timer expired after 150s: evicting client at 10.3.7.58@o2ib ns: filter-LFS05-OST0055_UUID lock: ffff8105f7535000/0xa5443999bf419e9a lrc: 3/0,0 mode: PW/PW res: 400993237/0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) flags: 0x20 remote: 0xb19e507faa234b0e expref: 4804 pid: 9515 timeout 4296356556 Mar 26 10:04:29 ALPL402 kernel: LustreError: 9425:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-107) req@ffff8105d478f800 x1495124888747898/t0 o101->@:0/0 lens 296/0 e 0 to 0 dl 1427335564 ref 1 fl Interpret:/0/0 rc -107/0 Mar 26 10:04:29 ALPL402 kernel: LustreError: 9425:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 4 previous similar messages Mar 26 10:05:40 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 10:05:40 ALPL402 kernel: LustreError: 9600:0:(ldlm_lib.c:946:target_handle_connect()) LFS05-OST0056: denying connection for new client 10.3.3.54@o2ib (0a6951da-e82e-beca-585a-30a4747d0811): 2 clients in recovery for 49s Mar 26 10:05:40 ALPL402 kernel: LustreError: 9600:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-16) req@ffff8105e5734800 x1496669789094059/t0 o8->@:0/0 lens 368/264 e 0 to 0 dl 1427335690 ref 1 fl Interpret:/0/0 rc -16/0 Mar 26 10:05:47 ALPL402 kernel: LustreError: 9490:0:(ldlm_lib.c:946:target_handle_connect()) LFS05-OST0056: denying connection for new client 10.3.3.54@o2ib (0a6951da-e82e-beca-585a-30a4747d0811): 2 clients in recovery for 42s Mar 26 10:05:47 ALPL402 kernel: LustreError: 9490:0:(ldlm_lib.c:946:target_handle_connect()) Skipped 3 previous similar messages Mar 26 10:05:56 ALPL402 kernel: LustreError: 8883:0:(ldlm_lib.c:946:target_handle_connect()) LFS05-OST0056: denying connection for new client 10.3.3.54@o2ib (0a6951da-e82e-beca-585a-30a4747d0811): 2 clients in recovery for 33s Mar 26 10:05:56 ALPL402 kernel: LustreError: 8883:0:(ldlm_lib.c:946:target_handle_connect()) Skipped 3 previous similar messages Mar 26 10:06:03 ALPL402 kernel: LustreError: 9311:0:(ldlm_lib.c:946:target_handle_connect()) LFS05-OST0056: denying connection for new client 10.3.9.21@o2ib (14ec0bb3-8b3a-a6a0-aba5-065cc5e46975): 2 clients in recovery for 26s Mar 26 10:06:03 ALPL402 kernel: LustreError: 9311:0:(ldlm_lib.c:946:target_handle_connect()) Skipped 3 previous similar messages Mar 26 10:06:11 ALPL402 kernel: LustreError: 9584:0:(ldlm_lib.c:946:target_handle_connect()) LFS05-OST0056: denying connection for new client 10.3.9.21@o2ib (14ec0bb3-8b3a-a6a0-aba5-065cc5e46975): 2 clients in recovery for 18s Mar 26 10:06:11 ALPL402 kernel: LustreError: 9584:0:(ldlm_lib.c:946:target_handle_connect()) Skipped 3 previous similar messages Mar 26 10:06:20 ALPL402 kernel: LustreError: 9459:0:(ldlm_lib.c:946:target_handle_connect()) LFS05-OST0056: denying connection for new client 10.3.9.21@o2ib (14ec0bb3-8b3a-a6a0-aba5-065cc5e46975): 2 clients in recovery for 9s Mar 26 10:06:20 ALPL402 kernel: LustreError: 9482:0:(ldlm_lib.c:946:target_handle_connect()) LFS05-OST0057: denying connection for new client 10.3.9.21@o2ib (14ec0bb3-8b3a-a6a0-aba5-065cc5e46975): 1 clients in recovery for 9s Mar 26 10:06:20 ALPL402 kernel: LustreError: 9482:0:(ldlm_lib.c:946:target_handle_connect()) Skipped 7 previous similar messages Mar 26 10:06:52 ALPL402 kernel: LustreError: 0:0:(ldlm_lockd.c:315:waiting_locks_callback()) ### lock callback timer expired after 301s: evicting client at 10.3.7.35@o2ib ns: filter-LFS05-OST0055_UUID lock: ffff8105706c1c00/0xa5443999bfb69bf0 lrc: 3/0,0 mode: PW/PW res: 400993237/0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) flags: 0x20 remote: 0x936352ba787443a2 expref: 4802 pid: 9575 timeout 4296507010 Mar 26 10:07:11 ALPL402 kernel: LustreError: 9415:0:(ldlm_lib.c:946:target_handle_connect()) LFS05-OST0056: denying connection for new client 10.3.9.21@o2ib (14ec0bb3-8b3a-a6a0-aba5-065cc5e46975): 2 clients in recovery for 408s Mar 26 10:07:11 ALPL402 kernel: LustreError: 9415:0:(ldlm_lib.c:946:target_handle_connect()) Skipped 10 previous similar messages Mar 26 10:07:48 ALPL402 kernel: LustreError: 8806:0:(ldlm_lib.c:946:target_handle_connect()) LFS05-OST0056: denying connection for new client 10.3.9.21@o2ib (14ec0bb3-8b3a-a6a0-aba5-065cc5e46975): 2 clients in recovery for 371s Mar 26 10:07:48 ALPL402 kernel: LustreError: 8806:0:(ldlm_lib.c:946:target_handle_connect()) Skipped 7 previous similar messages Mar 26 10:07:50 ALPL402 kernel: LustreError: 9582:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-16) req@ffff8105d684fc00 x1496669789094835/t0 o8->@:0/0 lens 368/264 e 0 to 0 dl 1427335820 ref 1 fl Interpret:/0/0 rc -16/0 Mar 26 10:07:50 ALPL402 kernel: LustreError: 9582:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 48 previous similar messages Mar 26 10:08:54 ALPL402 kernel: LustreError: 8890:0:(ldlm_lib.c:946:target_handle_connect()) LFS05-OST0056: denying connection for new client 10.3.3.54@o2ib (0a6951da-e82e-beca-585a-30a4747d0811): 2 clients in recovery for 305s Mar 26 10:08:54 ALPL402 kernel: LustreError: 8890:0:(ldlm_lib.c:946:target_handle_connect()) Skipped 23 previous similar messages Mar 26 10:09:23 ALPL402 kernel: LustreError: 0:0:(ldlm_lockd.c:315:waiting_locks_callback()) ### lock callback timer expired after 371s: evicting client at 10.3.7.28@o2ib ns: filter-LFS05-OST0055_UUID lock: ffff81056425c600/0xa5443999bfb71ba2 lrc: 3/0,0 mode: PW/PW res: 400993237/0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) flags: 0x20 remote: 0x6348504964566322 expref: 4805 pid: 9523 timeout 4296658004 Mar 26 10:11:06 ALPL402 kernel: LustreError: 8861:0:(ldlm_lib.c:946:target_handle_connect()) LFS05-OST0057: denying connection for new client 10.3.3.54@o2ib (0a6951da-e82e-beca-585a-30a4747d0811): 1 clients in recovery for 174s Mar 26 10:11:06 ALPL402 kernel: LustreError: 9344:0:(ldlm_lib.c:946:target_handle_connect()) LFS05-OST0056: denying connection for new client 10.3.3.54@o2ib (0a6951da-e82e-beca-585a-30a4747d0811): 2 clients in recovery for 173s Mar 26 10:11:06 ALPL402 kernel: LustreError: 9344:0:(ldlm_lib.c:946:target_handle_connect()) Skipped 83 previous similar messages Mar 26 10:11:54 ALPL402 kernel: LustreError: 0:0:(ldlm_lockd.c:315:waiting_locks_callback()) ### lock callback timer expired after 421s: evicting client at 10.3.7.34@o2ib ns: filter-LFS05-OST0055_UUID lock: ffff810561654600/0xa5443999bfb72614 lrc: 3/0,0 mode: PW/PW res: 400993237/0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) flags: 0x20 remote: 0xeaf65fde644a0b33 expref: 4801 pid: 8867 timeout 4296809004 Mar 26 10:12:07 ALPL402 kernel: LustreError: 9298:0:(ldlm_lib.c:1921:target_send_reply_msg()) @@@ processing error (-16) req@ffff8105dda53000 x1496669815312808/t0 o8->@:0/0 lens 368/264 e 0 to 0 dl 1427336077 ref 1 fl Interpret:/0/0 rc -16/0 Mar 26 10:12:07 ALPL402 kernel: LustreError: 9298:0:(ldlm_lib.c:1921:target_send_reply_msg()) Skipped 142 previous similar messages Mar 26 10:14:00 ALPL402 kernel: Lustre: LFS05-OST0056: Recovery period over after 15:01, of 548 clients 546 recovered and 2 were evicted. Mar 26 10:14:00 ALPL402 kernel: Lustre: LFS05-OST0056: sending delayed replies to recovered clients Mar 26 10:14:00 ALPL402 kernel: Lustre: LFS05-OST0056: received MDS connection from 10.3.5.72@o2ib Mar 26 10:14:00 ALPL402 kernel: Lustre: 8804:0:(filter.c:3123:filter_destroy_precreated()) LFS05-OST0056: deleting orphan objects from 414042961 to 414051004, orphan objids won't be reused any more. Mar 26 10:14:00 ALPL402 kernel: Lustre: LFS05-OST0057: Recovery period over after 15:00, of 548 clients 547 recovered and 1 was evicted. Mar 26 10:14:00 ALPL402 kernel: Lustre: LFS05-OST0057: sending delayed replies to recovered clients Mar 26 10:14:00 ALPL402 kernel: Lustre: LFS05-OST0057: received MDS connection from 10.3.5.72@o2ib Mar 26 10:14:00 ALPL402 kernel: Lustre: 9476:0:(filter.c:3123:filter_destroy_precreated()) LFS05-OST0057: deleting orphan objects from 385710821 to 385725368, orphan objids won't be reused any more. Mar 26 10:14:06 ALPL402 kernel: Lustre: LFS05-OST0058: Recovery period over after 15:00, of 548 clients 545 recovered and 1 was evicted. Mar 26 10:14:06 ALPL402 kernel: Lustre: LFS05-OST0058: sending delayed replies to recovered clients Mar 26 10:14:06 ALPL402 kernel: Lustre: LFS05-OST0058: received MDS connection from 10.3.5.72@o2ib Mar 26 10:14:06 ALPL402 kernel: Lustre: 9466:0:(filter.c:3123:filter_destroy_precreated()) LFS05-OST0058: deleting orphan objects from 404486810 to 404493694, orphan objids won't be reused any more. Mar 26 10:14:10 ALPL402 kernel: Lustre: LFS05-OST0059: Recovery period over after 15:00, of 548 clients 546 recovered and 2 were evicted. Mar 26 10:14:10 ALPL402 kernel: Lustre: LFS05-OST0059: sending delayed replies to recovered clients Mar 26 10:14:10 ALPL402 kernel: Lustre: LFS05-OST0059: received MDS connection from 10.3.5.72@o2ib Mar 26 10:14:10 ALPL402 kernel: Lustre: 9305:0:(filter.c:3123:filter_destroy_precreated()) LFS05-OST0059: deleting orphan objects from 388188418 to 388194634, orphan objids won't be reused any more. Mar 26 10:14:21 ALPL402 kernel: Lustre: 9553:0:(ldlm_lib.c:805:target_handle_connect()) LFS05-OST0056: exp ffff8105db624c00 already connecting Mar 26 10:14:25 ALPL402 kernel: LustreError: 0:0:(ldlm_lockd.c:315:waiting_locks_callback()) ### lock callback timer expired after 471s: evicting client at 10.3.7.44@o2ib ns: filter-LFS05-OST0055_UUID lock: ffff8105f96c0000/0xa5443999bfb72f59 lrc: 3/0,0 mode: PW/PW res: 400993237/0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) flags: 0x20 remote: 0x3ee0a469612e719 expref: 4805 pid: 9258 timeout 4296960015 Mar 26 10:14:30 ALPL402 kernel: Lustre: 8800:0:(ldlm_lib.c:576:target_handle_reconnect()) LFS05-OST0056: 14ec0bb3-8b3a-a6a0-aba5-065cc5e46975 reconnecting Mar 26 10:14:30 ALPL402 kernel: Lustre: 8800:0:(ldlm_lib.c:576:target_handle_reconnect()) Skipped 81 previous similar messages Mar 26 10:14:30 ALPL402 kernel: Lustre: 9569:0:(ldlm_lib.c:805:target_handle_connect()) LFS05-OST0057: exp ffff810bb0725600 already connecting Mar 26 10:14:31 ALPL402 kernel: Lustre: 9461:0:(ldlm_lib.c:805:target_handle_connect()) LFS05-OST0057: exp ffff8105e8043400 already connecting Mar 26 10:14:45 ALPL402 kernel: Lustre: 8846:0:(ldlm_lib.c:805:target_handle_connect()) LFS05-OST0059: exp ffff8105d85f6e00 already connecting Mar 26 10:14:50 ALPL402 kernel: Lustre: 9563:0:(ldlm_lib.c:805:target_handle_connect()) LFS05-OST0057: exp ffff810bb0725600 already connecting Mar 26 10:14:51 ALPL402 kernel: Lustre: LFS05-OST0057: slow i_mutex 51s due to heavy IO load Mar 26 10:14:51 ALPL402 kernel: Lustre: LFS05-OST0057: slow journal start 33s due to heavy IO load Mar 26 10:14:51 ALPL402 kernel: Lustre: LFS05-OST0057: slow journal start 33s due to heavy IO load Mar 26 10:14:51 ALPL402 kernel: Lustre: LFS05-OST0057: slow brw_start 33s due to heavy IO load Mar 26 10:14:51 ALPL402 kernel: Lustre: Skipped 27 previous similar messages Mar 26 10:14:51 ALPL402 kernel: Lustre: Skipped 26 previous similar messages Mar 26 10:14:51 ALPL402 kernel: Lustre: LFS05-OST0057: slow journal start 51s due to heavy IO load Mar 26 10:14:51 ALPL402 kernel: Lustre: LFS05-OST0057: slow journal start 51s due to heavy IO load Mar 26 10:14:51 ALPL402 kernel: Lustre: LFS05-OST0057: slow brw_start 51s due to heavy IO load Mar 26 10:14:51 ALPL402 kernel: Lustre: Skipped 12 previous similar messages Mar 26 10:14:51 ALPL402 kernel: Lustre: Skipped 3 previous similar messages Mar 26 10:14:51 ALPL402 kernel: Lustre: LFS05-OST0057: slow direct_io 51s due to heavy IO load Mar 26 10:14:51 ALPL402 kernel: Lustre: LFS05-OST0057: slow i_mutex 40s due to heavy IO load Mar 26 10:14:51 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 26 10:14:51 ALPL402 kernel: Lustre: LFS05-OST0057: slow direct_io 51s due to heavy IO load Mar 26 10:14:51 ALPL402 kernel: Lustre: Skipped 39 previous similar messages Mar 26 10:14:51 ALPL402 kernel: Lustre: LFS05-OST0057: slow i_mutex 51s due to heavy IO load Mar 26 10:14:51 ALPL402 kernel: Lustre: LFS05-OST0057: slow parent lock 51s due to heavy IO load Mar 26 10:14:51 ALPL402 kernel: Lustre: LFS05-OST0057: slow preprw_write setup 51s due to heavy IO load Mar 26 10:14:51 ALPL402 kernel: Lustre: LFS05-OST0057: slow parent lock 51s due to heavy IO load Mar 26 10:14:51 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 26 10:14:51 ALPL402 kernel: Lustre: LFS05-OST0057: slow parent lock 40s due to heavy IO load Mar 26 10:14:51 ALPL402 kernel: Lustre: LFS05-OST0057: slow preprw_write setup 51s due to heavy IO load Mar 26 10:14:51 ALPL402 kernel: Lustre: LFS05-OST0057: slow preprw_write setup 33s due to heavy IO load Mar 26 10:14:52 ALPL402 kernel: Lustre: LFS05-OST0058: slow i_mutex 46s due to heavy IO load Mar 26 10:14:52 ALPL402 kernel: Lustre: LFS05-OST0058: slow direct_io 46s due to heavy IO load Mar 26 10:14:54 ALPL402 kernel: Lustre: LFS05-OST0059: slow journal start 30s due to heavy IO load Mar 26 10:14:54 ALPL402 kernel: Lustre: LFS05-OST0059: slow journal start 36s due to heavy IO load Mar 26 10:14:54 ALPL402 kernel: Lustre: Skipped 5 previous similar messages Mar 26 10:14:54 ALPL402 kernel: Lustre: Skipped 11 previous similar messages Mar 26 10:14:54 ALPL402 kernel: Lustre: LFS05-OST0059: slow brw_start 36s due to heavy IO load Mar 26 10:14:54 ALPL402 kernel: Lustre: LFS05-OST0059: slow brw_start 36s due to heavy IO load Mar 26 10:14:54 ALPL402 kernel: Lustre: Skipped 12 previous similar messages Mar 26 10:14:54 ALPL402 kernel: Lustre: LFS05-OST0059: slow direct_io 36s due to heavy IO load Mar 26 10:14:54 ALPL402 kernel: Lustre: LFS05-OST0059: slow journal start 36s due to heavy IO load Mar 26 10:14:54 ALPL402 kernel: Lustre: LFS05-OST0059: slow commitrw commit 36s due to heavy IO load Mar 26 10:14:54 ALPL402 kernel: Lustre: LFS05-OST0059: slow journal start 30s due to heavy IO load Mar 26 10:14:54 ALPL402 kernel: Lustre: LFS05-OST0059: slow parent lock 35s due to heavy IO load Mar 26 10:14:54 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 26 10:14:54 ALPL402 kernel: Lustre: LFS05-OST0059: slow i_mutex 43s due to heavy IO load Mar 26 10:14:54 ALPL402 kernel: Lustre: LFS05-OST0059: slow preprw_write setup 36s due to heavy IO load Mar 26 10:14:54 ALPL402 kernel: LustreError: 14414:0:(filter.c:1557:filter_destroy_internal()) destroying objid 388188221 ino 2424045 nlink 0 count 2 Mar 26 10:14:54 ALPL402 kernel: LustreError: 14414:0:(filter.c:1563:filter_destroy_internal()) error unlinking objid 388188221: rc -2 Mar 26 10:15:52 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 00e04480-a2d7-9b3b-5761-0fa7320a1b81 (at 10.3.9.21@o2ib) in 978 seconds. I think it's dead, and I am evicting it. Mar 26 10:15:52 ALPL402 kernel: Lustre: Skipped 1 previous similar message Mar 26 10:15:58 ALPL402 kernel: Lustre: LFS05-OST0058: haven't heard from client 00e04480-a2d7-9b3b-5761-0fa7320a1b81 (at 10.3.9.21@o2ib) in 984 seconds. I think it's dead, and I am evicting it. Mar 26 10:16:13 ALPL402 kernel: INFO: task ll_log_process:14184 blocked for more than 120 seconds. Mar 26 10:16:13 ALPL402 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Mar 26 10:16:13 ALPL402 kernel: ll_log_proces D 0000000000003769 0 14184 1 14185 13521 (L-TLB) Mar 26 10:16:13 ALPL402 kernel: ffff8105491d3d80 0000000000000046 0000376900000286 0000000000003769 Mar 26 10:16:13 ALPL402 kernel: 00000000000001f7 0000000000000009 ffff81054ad727e0 ffff810619ce5040 Mar 26 10:16:13 ALPL402 kernel: 00000218e1b75276 000000000000557b ffff81054ad729c8 00000001491a2a68 Mar 26 10:16:13 ALPL402 kernel: Call Trace: Mar 26 10:16:13 ALPL402 kernel: [] kernel_thread+0x81/0xeb Mar 26 10:16:13 ALPL402 kernel: [] wait_for_completion+0x79/0xa2 Mar 26 10:16:13 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 10:16:13 ALPL402 kernel: [] :obdclass:llog_process+0x488/0x620 Mar 26 10:16:13 ALPL402 kernel: [] :obdfilter:filter_recov_log_mds_ost_cb+0x0/0xfa0 Mar 26 10:16:13 ALPL402 kernel: [] :obdfilter:filter_recov_log_mds_ost_cb+0x0/0xfa0 Mar 26 10:16:13 ALPL402 kernel: [] :obdclass:llog_cat_process+0x1ee/0x280 Mar 26 10:16:13 ALPL402 kernel: [] :obdfilter:filter_recov_log_mds_ost_cb+0x0/0xfa0 Mar 26 10:16:13 ALPL402 kernel: [] :obdclass:llog_init_handle+0x3c7/0x860 Mar 26 10:16:13 ALPL402 kernel: [] :obdfilter:filter_recov_log_mds_ost_cb+0x0/0xfa0 Mar 26 10:16:13 ALPL402 kernel: [] :obdclass:llog_cat_process_thread+0x474/0x7c0 Mar 26 10:16:13 ALPL402 kernel: [] :obdfilter:filter_recov_log_mds_ost_cb+0x0/0xfa0 Mar 26 10:16:13 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 10:16:13 ALPL402 kernel: [] :obdfilter:filter_recov_log_mds_ost_cb+0x0/0xfa0 Mar 26 10:16:13 ALPL402 kernel: [] :obdclass:llog_cat_process_thread+0x0/0x7c0 Mar 26 10:16:13 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 10:16:13 ALPL402 kernel: Mar 26 10:16:13 ALPL402 kernel: INFO: task llog_process_th:14185 blocked for more than 120 seconds. Mar 26 10:16:13 ALPL402 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Mar 26 10:16:13 ALPL402 kernel: llog_process_ D 000000000000376b 0 14185 1 14187 14184 (L-TLB) Mar 26 10:16:13 ALPL402 kernel: ffff8105491d9d70 0000000000000046 0000376bca46b000 000000000000376b Mar 26 10:16:13 ALPL402 kernel: 0000000000000246 0000000000000008 ffff810619ce5040 ffff8105fb5b6080 Mar 26 10:16:13 ALPL402 kernel: 00000218e1cb3f7e 00000000000045c1 ffff810619ce5228 00000001491a29e8 Mar 26 10:16:13 ALPL402 kernel: Call Trace: Mar 26 10:16:13 ALPL402 kernel: [] kernel_thread+0x81/0xeb Mar 26 10:16:13 ALPL402 kernel: [] wait_for_completion+0x79/0xa2 Mar 26 10:16:13 ALPL402 kernel: [] default_wake_function+0x0/0xe Mar 26 10:16:13 ALPL402 kernel: [] :obdclass:llog_process+0x488/0x620 Mar 26 10:16:13 ALPL402 kernel: [] :ptlrpc:llog_client_next_block+0x5a6/0x650 Mar 26 10:16:13 ALPL402 kernel: [] :obdclass:llog_cat_process_cb+0x2a5/0x330 Mar 26 10:16:13 ALPL402 kernel: [] :obdclass:llog_process_thread+0x881/0xc30 Mar 26 10:16:13 ALPL402 kernel: [] child_rip+0xa/0x11 Mar 26 10:16:13 ALPL402 kernel: [] :obdclass:llog_process_thread+0x0/0xc30 Mar 26 10:16:13 ALPL402 kernel: [] child_rip+0x0/0x11 Mar 26 10:16:13 ALPL402 kernel: Mar 26 10:16:30 ALPL402 kernel: LustreError: 0:0:(ldlm_lockd.c:315:waiting_locks_callback()) ### lock callback timer expired after 150s: evicting client at 10.3.7.42@o2ib ns: filter-LFS05-OST0056_UUID lock: ffff810a52403400/0xa5443999bf781d8c lrc: 3/0,0 mode: PW/PW res: 409678050/0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) flags: 0x20 remote: 0xb5f486e4e5cf6020 expref: 4802 pid: 9220 timeout 4297085418 Mar 26 10:16:30 ALPL402 kernel: LustreError: 14187:0:(filter.c:1557:filter_destroy_internal()) destroying objid 414019828 ino 136287112 nlink 0 count 2 Mar 26 10:16:30 ALPL402 kernel: LustreError: 14187:0:(filter.c:1563:filter_destroy_internal()) error unlinking objid 414019828: rc -2 Mar 26 10:16:40 ALPL402 kernel: LustreError: 0:0:(ldlm_lockd.c:315:waiting_locks_callback()) ### lock callback timer expired after 150s: evicting client at 10.3.7.34@o2ib ns: filter-LFS05-OST0059_UUID lock: ffff810a59eec400/0xa5443999bf7689df lrc: 3/0,0 mode: PW/PW res: 385586217/0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) flags: 0x20 remote: 0xeaf65fde6426dec4 expref: 4802 pid: 8842 timeout 4297095922 Mar 26 10:16:40 ALPL402 kernel: LustreError: 0:0:(ldlm_lockd.c:315:waiting_locks_callback()) Skipped 15 previous similar messages Mar 26 10:42:45 ALPL402 : error getting update info: Cannot find a valid baseurl for repo: base Mar 26 10:45:10 ALPL402 kernel: Lustre: LFS05-OST0057: haven't heard from client 460108d8-24d5-5d81-4cea-dba4a6f4c3b6 (at 10.3.2.16@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 10:45:46 ALPL402 kernel: ib_send_cm_mra: cm_id_priv->id.state: 0x6 Mar 26 10:46:49 ALPL402 last message repeated 2 times Mar 26 10:54:33 ALPL402 kernel: Lustre: LFS05-OST0059: haven't heard from client aa3dd8b7-33bc-86b2-094a-0b54208f7152 (at 10.3.2.18@o2ib) in 335 seconds. I think it's dead, and I am evicting it. Mar 26 10:54:33 ALPL402 kernel: Lustre: Skipped 14 previous similar messages