[LU-12983] OBD_IOC_LLOG_PRINT failed: No such file or directory

• Status: Resolved
• Project: Lustre
• Type: Bug
• Priority: Major
• Reporter: Mahmoud Hanafi
• Assignee: Peter Jones
• Resolution: Incomplete
• Severity: 3

Description

Trying to print out params log we get error

 # lctl --device MGS  llog_print param 
OBD_IOC_LLOG_PRINT failed: No such file or directory

I dumped the params file via debugfs. It looks fine. It does have 216 records.

Here is strace out

ioctl(3, _IOC(_IOC_READ|_IOC_WRITE, 0x66, 0x7f, 0x08), 0x7fffffffc9d0) = 0
ioctl(3, _IOC(_IOC_READ|_IOC_WRITE, 0x66, 0xc0, 0x08), 0x7fffffffc9d0) = -1 ENOENT (No such file or directory)
write(2, "OBD_IOC_LLOG_PRINT failed: No su"..., 53OBD_IOC_LLOG_PRINT failed: No such file or directory
) = 53
rt_sigaction(SIGINT, {0x40a140, ~[RTMIN RT_1], SA_RESTORER|SA_RESTART, 0x2aaaaaf0b5f0}, NULL, 8) = 0
exit_group(1)                           = ?

Comments

[Oleg Drokin]

hm, I suspect this might be because MGS is not up or something like that?

can you please enable -1 debug log (lctl set_param_debug=-1) repeat the llog_print lctl command and thel do "lctl dk >/tmp/log"

if this is a working system that you are using you might want to capture "lctl get_param debug" output first and then restore it by repeating lctl set_param debug= with that output afterwards.

[Oleg Drokin]

also please do "lctl dl" and attach the output as well.

[Mahmoud Hanafi]

Got the debug output requested.
debug.tgz

[Andreas Dilger]

Did you try "lctl --device MGS llog_print params" (note the 's' at the end)?  That is the name of the parameter file, not "param".

[Andreas Dilger]

Note, if this is documented incorrectly somewhere, please let us know so that the documentation can be fixed. 

[Andreas Dilger]

PS: what Lustre version is in use here? The "Affects Version:" field is blank. I'm seeing similar issues with an older 2.10, but I believe this is fixed in 2.12.

[Andreas Dilger]

PPS: as a temporary workaround, you can use the following commands to dump this log:

debugfs -c -R "dump CONFIGS/params /tmp/debug" /dev/<mgt_device>
llog_reader /tmp/debug

Where the <mgt_device> is the block device where the MGT info is stored (may be MDT device, or standalone MGT device).

[Mahmoud Hanafi]

This filesystem was just upgraded to l2.12.2 and we started to see this issue. FYI the filesystem was created with l2.4. The command was working in l2.10.8. 

The missing "s" was a cut and past issue.

# lctl --device MGS llog_print params
OBD_IOC_LLOG_PRINT failed: Inappropriate ioctl for device

 

[Mahmoud Hanafi]

We can close this for now