Details
-
Bug
-
Resolution: Fixed
-
Major
-
Lustre 2.7.0
-
3
-
17384
Description
# echo XXX > f0 # lfs hsm_archive f0 # lfs hsm_state f0 f0: (0x00000009) exists archived, archive_id:1 # lfs hsm_release f0 # lfs hsm_state f0 f0: (0x0000000d) released exists archived, archive_id:1 # tar --xattr -cf /tmp/f0.tar f0 tar: f0: file changed as we read it # rm f0 # tar --xattr -xf /tmp/f0.tar f0 tar: f0: Cannot write: No data available tar: Exiting with failure status due to previous errors # echo $? 2 # ls f0 # cat f0 cat: f0: No data available
It does not matter if --xattr is used during extraction.
# rm f0 # tar -xf /tmp/f0.tar f0 tar: f0: Cannot write: No data available tar: Exiting with failure status due to previous errors # ls f0 # cat f0 cat: f0: No data available
Extraction is creating the file and giving it a trusted.lov xattr which has a released pattern. From strace:
mknod("f0", 0600) = 0
setxattr("f0", "trusted.hsm", "\x00\x00\x00\x00\x0d\x00\x00\x00\x01\x00\x00\x00\x00\x00\x0
0\x00\x15\x00\x00\x00\x01\x00\x00\x00", 24, 0) = 0
setxattr("f0", "trusted.link", "\xdf\xf1\xea\x11\x01\x00\x00\x00,\x00\x00\x00\x00\x00\x00\
x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x14\x00\x00\x00\x02\x00\x00\x00\x07\x00\x00\x00\x0
1\x00\x00\x00\x00f0", 44, 0) = 0
setxattr("f0", "trusted.lov", "\xd0\x0b\xd1\x0b\x01\x00\x00\x80\x0f\x00\x00\x00\x00\x00\x0
0\x00\x00\x04\x00\x00\x02\x00\x00\x00\x00\x00\x10\x00\x00\x00\x00\x00", 32, 0) = 0
setxattr("f0", "trusted.lma", "\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\x00\x00\x02\x00\x0
0\x00\x0f\x00\x00\x00\x00\x00\x00\x00", 24, 0) = 0
open("f0", O_WRONLY|O_CREAT, 0600) = 4
write(4, "XXX\n", 4) = -1 ENODATA (No data available)
# lfs getstripe f0 f0 lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: 80000001 lmm_layout_gen: 0 lmm_stripe_offset: 0 # getfattr -d -m- f0 # file: f0 trusted.link=0s3/HqEQEAAAAsAAAAAAAAAAAAAAAAAAAAABQAAAACAAAABwAAAAEAAAAAZjA= trusted.lma=0sAAAAAAAAAAAABAAAAgAAABcAAAAAAAAA trusted.lov=0s0AvRCwEAAIAXAAAAAAAAAAAEAAACAAAAAAAQAAAAAAA=
The same archive works fine when extracting to an ext4 filesystem.
# cd /tmp # tar -xf /tmp/f0.tar f0 # cat f0 XXX
Attachments
Activity
Oleg Drokin (oleg.drokin@intel.com) merged in patch http://review.whamcloud.com/16060/
Subject: LU-6214 llite: tar restore fails for HSM released files.
Project: fs/lustre-release
Branch: master
Current Patch Set:
Commit: b567f5066b7ca2d15d4f492ec205651c9a63ef98
Aditya Pandit (panditadityashreesh@yahoo.com) uploaded a new patch: http://review.whamcloud.com/16060
Subject: LU-6214 llite: HSM released files archive.
Project: fs/lustre-release
Branch: master
Current Patch Set: 1
Commit: a2af454aeb1d501647be4de127ebaf945de7e721
Being able to backip and restore the stripe parameters with tar is a feature that users asked for. I think the right solution here is to just mask out the "RELEASED" flag from the "lov" xattr when it is set. That avoids the current problem of the new file being marked released when it is being restored, but keeps the ability to backup and restore the file layout. It also makes sense to ignore the HSM xattr as the existing patch 14086 does, but it needs updating as mentioned in the comments there. Also, patches should be submitted to master first.
I looked more closely at the bug and the flow. flow goes like this
tar -> listxattr -> getxattr. Then while restoring using tar, it has all the xattrs with incorrect parameters where it calls create -> setxattr. Here it tries to set the stripe information. I think ideally tar should not be allowed to manipulate the internal structures of lustre because it is not fully aware of lustre.
lustre manipulates the stripe information in ll_setxattr and also exposes attributes in listxattr, getxattr and setxattr.
How about we separate extended attributes manipulated by lustre and those that use getxattr/setxattr? Put the implementation of manipulation of setxattr/getxattr as ioctls. lhsmtool_posix would call the ioctl for manipulating the attributes.
We can completely filter out the lustre specific attributes in getxattr and setxattr, so that applications like tar would not manipulate lustre specific attributes at all. It would be a normal read,write,getxattr and setxattr operation for tar or any other application that manipulate the xattr. Such applications would only handle the attributes which they have set and not the xattrs of lustre.
Aditya Pandit (aditya.pandit@clogeny.com) uploaded a new patch: http://review.whamcloud.com/14086
Subject: LU-6214: ignore hsm special xattr for now
Project: fs/lustre-release
Branch: b2_5
Current Patch Set: 1
Commit: 290f638056fc17613b2028b521933eb1f5c86259
Landed for 2.8