[LU-1540] e2fsck remove too many symlinks

• Type: Bug
• Resolution: Fixed
• Priority: Major
• Fix Version/s: Lustre 2.3.0, Lustre 2.4.0, Lustre 2.1.3
• Affects Version/s: Lustre 2.2.0, Lustre 2.3.0, Lustre 2.1.1, Lustre 2.1.2, Lustre 2.1.3
• Severity: 3
• Assignee: Zhenyu Xu
• Reporter: Alexandre Louvet (Inactive)

Description

Each time we run fsck on a MDS, we lose thousand of symlinks (which is a kind of corruption).
To figure out a little what was wrong with those inodes, I did a small instrumentation of e2fsck_pass1_check_symlink and started to print various information about the inode (modification are attached).

Here is what I got :

[root@gaia14 ~]# ./e2fsck -n -f -v -d /dev/mapper/vg_mdt_work1-mdt_work1 | grep -B2 -A1 "at pass1.c:246"
e2fsck 1.41.90.wc4 (01-Sep-2011)
blocks != 0 && fs->blocksize = 4096, buf = %/home/cont001/segura/BIN/ELSA/CHAINE_V2/MODULES_PYTHON/GENERIQUES/Block.py_oldaux.py%
len = 84, inode->i_size = 78
at pass1.c:246 : offending inode 16819164 found !
e2fsck_pass1:1416: increase inode 16819164 badness 0 to 1

note the content of buf (result of io_channel_read_blk64), and specially the latest characters 'aux.py' (% was in the printf format).

Looking at this inode using debugfs return

debugfs: stat <16819164>
Inode: 16819164 Type: symlink Mode: 0777 Flag
Generation: 1029089099 Version: 0x0000004e:1a78c70
User: 11876 Group: 1850 Size: 78
File ACL: 0 Directory ACL: 0
Links: 1 Blockcount: 8
Fragment: Address: 0 Number: 0 Size: 0
 ctime: 0x4fd1a998:00000000 -- Fri Jun 8 09:28:24 20
 atime: 0x4fd1a998:00000000 -- Fri Jun 8 09:28:24 20
 mtime: 0x4fd1a998:00000000 -- Fri Jun 8 09:28:24 20
crtime: 0x4fd1a998:e6373924 -- Fri Jun 8 09:28:24 20
Size of extra inode fields: 28
Extended attributes stored in inode body:
  lma = "00 00 00 00 00 00 00 00 56 fa 1b 0d 02 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
  link = "df f1 ea 11 01 00 00 00 36 00 00 00 00 00 0
 5c 00 00 00 00 42 6c 6f 63 6b 2e 70 79 5f 6f 6c 64 "
BLOCKS:
(0):17832933
TOTAL: 1

debugfs: cat <16819164>
/home/cont001/segura/BIN/ELSA/CHAINE_V2/MODULES_PYTHON/GENERIQUES/Block.py_old

The string is the same except that it doesn't display the 'aux.py', and the targeted file is what was expected.

Accessing the filesystem through mount doesn't display any issue. Accessing the symlink works and the content is valid (the expected link has a length of inode->i_size).
The buffer retrieved in e2fsck looks wrong and the end of the string (starting inode->i_size) always contain garbage.

So who is wrong ? Is it correct for e2fsprog to guess that a symlink is always terminated by a '\0', giving strnlen a chance to return the right length ? Or is ldiskfs wrong in not enforcing the '\0' at inode->i_size position ? ... or something else ...

Issue Links

• is related to: LU-1774 fsck -fD corrupts filesystem
• is related to: LU-16060 e2fsck reported "symlink missing NUL terminator" errors
• is related to: LU-1366 getting "dirdata length set incorrectly" running e2fsck
• Trackbacks: Changelog 2.1 Changes from version 2.1.2 to version 2.1.3 Server support for kernels: 2.6.18308.13.1.el5 (RHEL5) 2.6.32279.2.1.el6 (RHEL6) Client support for unpatched kernels: 2.6.18308.13.1.el5 (RHEL5) 2.6.32279.2.1....

Comments

[Diego Moreno (Inactive)]

That's great, we'll try the patch.

Thanks guys,

[Zhenyu Xu]

b2_1 port of ldiskfs patch tracking at http://review.whamcloud.com/3765

patch description

LU-1540 osd: add NUL terminator for long symlink

Add NUL terminator for long symlink to ldiskfs inode on-disk data.

Signed-off-by: Bobi Jam <[e-mail]>

[Diego Moreno (Inactive)]

Could it be possible to have the ldiskfs patch (LU-1540 osd: add NUL terminator for long symlink) ported to b2_1?

Thanks,

Diego

[Peter Jones]

Fix landed for 2.3

[Andreas Dilger]

The e2fsck part of this change is included into the e2fsprogs-1.42.3.wc3 release.

[Peter Jones]

http://review.whamcloud.com/#change,3560

[Peter Jones]

Bobijam

I spoke with Andreas about this issue and he thinks that it makes sense for you to talk directly with Alex Z about ways of approaching this problem and that we should aim to get this fixed for 2.3

Thanks

Peter

[Build Master (Inactive)]

Integrated in e2fsprogs-master » i686,el5 #226
LU-1540 e2fsck: add missing symlink NUL terminator (Revision 311939a654b4085aef9559f21e91d7205150950f)

Result = SUCCESS
Andreas Dilger : 311939a654b4085aef9559f21e91d7205150950f
Files :

• tests/f_badsymlinks/expect.2
• e2fsck/e2fsck.h
• e2fsck/pass2.c
• e2fsck/pass1.c
• e2fsck/problem.c
• tests/f_badsymlinks/expect.1
• e2fsck/problem.h

[Build Master (Inactive)]

Integrated in e2fsprogs-master » x86_64,el5 #226
LU-1540 e2fsck: add missing symlink NUL terminator (Revision 311939a654b4085aef9559f21e91d7205150950f)

Result = SUCCESS
Andreas Dilger : 311939a654b4085aef9559f21e91d7205150950f
Files :

• e2fsck/pass2.c
• tests/f_badsymlinks/expect.2
• e2fsck/pass1.c
• tests/f_badsymlinks/expect.1
• e2fsck/e2fsck.h
• e2fsck/problem.h
• e2fsck/problem.c

[Build Master (Inactive)]

Integrated in e2fsprogs-master » i686,el6 #226
LU-1540 e2fsck: add missing symlink NUL terminator (Revision 311939a654b4085aef9559f21e91d7205150950f)

Result = SUCCESS
Andreas Dilger : 311939a654b4085aef9559f21e91d7205150950f
Files :

• e2fsck/problem.c
• tests/f_badsymlinks/expect.1
• e2fsck/problem.h
• e2fsck/pass1.c
• tests/f_badsymlinks/expect.2
• e2fsck/pass2.c
• e2fsck/e2fsck.h