Uploaded image for project: 'Lustre'
  1. Lustre
  2. LU-13676

script to show unique backtraces from crash utility

Details

    • Improvement
    • Resolution: Fixed
    • Minor
    • Lustre 2.14.0
    • None
    • None
    • 9223372036854775807

    Description

      it's not funny to list dozen pages of traces just to find few ones with something important

      Attachments

        Issue Links

          Activity

            [LU-13676] script to show unique backtraces from crash utility

            Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/40956/
            Subject: LU-13676 tools: find unique stacks from sysrq-t
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 3a88442dfffc451b0c598a95d49896e6ba271304

            gerrit Gerrit Updater added a comment - Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/40956/ Subject: LU-13676 tools: find unique stacks from sysrq-t Project: fs/lustre-release Branch: master Current Patch Set: Commit: 3a88442dfffc451b0c598a95d49896e6ba271304

            Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40956
            Subject: LU-13676 tools: find unique stacks from sysrq-t
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 6cc6f897fe2c845d7b398b926ca619c2e9f9ba89

            gerrit Gerrit Updater added a comment - Andreas Dilger (adilger@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/40956 Subject: LU-13676 tools: find unique stacks from sysrq-t Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 6cc6f897fe2c845d7b398b926ca619c2e9f9ba89
            pjones Peter Jones added a comment -

            Landed for 2.14

            pjones Peter Jones added a comment - Landed for 2.14

            Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/38936/
            Subject: LU-13676 tools: awk script to find unique backtraces
            Project: fs/lustre-release
            Branch: master
            Current Patch Set:
            Commit: 8a06f30e6048ebcd57e665c3b7de6c7eb7f6718e

            gerrit Gerrit Updater added a comment - Oleg Drokin (green@whamcloud.com) merged in patch https://review.whamcloud.com/38936/ Subject: LU-13676 tools: awk script to find unique backtraces Project: fs/lustre-release Branch: master Current Patch Set: Commit: 8a06f30e6048ebcd57e665c3b7de6c7eb7f6718e
            jhammond John Hammond added a comment -

            I also find it useful to dedup tasks with the same stack trace. The stack1 script attached does this on a running system:

            $ sudo ./stack1
            1 systemd
            363 systemd-journal
            377 systemd-udevd
            530 systemd-timesyn
            534 systemd-resolve
            594 dbus-daemon
            615 systemd-logind
            1807 firefox
            1866 Privileged Cont
            1886 firefox
            1887 firefox
            1918 WebExtensions
            1962 Web Content
            1990 Web Content
            2036 systemd
            2065 dbus-daemon
            2071 Xorg
            2078 Xorg
            2204 dbus-daemon
            2839 Web Content
            3372 skypeforlinux
            3375 skypeforlinux
            3502 skypeforlinux
            3523 skypeforlinux
            3526 skypeforlinux
            3528 skypeforlinux
            3550 skypeforlinux
            3556 skypeforlinux
            3558 skypeforlinux
            3560 skypeforlinux
            3562 skypeforlinux
            3578 skypeforlinux
            3586 skypeforlinux
            3610 skypeforlinux
            7883 cupsd
            11819 Web Content
            11998 Web Content
            12091 Web Content
            12207 Web Content
            12284 Web Content
            [<0>] ep_poll+0x3d0/0x420
            [<0>] do_epoll_wait+0xb8/0xd0
            [<0>] __x64_sys_epoll_wait+0x1e/0x30
            [<0>] do_syscall_64+0x5a/0x130
            [<0>] entry_SYSCALL_64_after_hwframe+0x44/0xa9
            
            2 kthreadd
            [<0>] kthreadd+0x2cb/0x2e0
            [<0>] ret_from_fork+0x35/0x40
            ...
            
            jhammond John Hammond added a comment - I also find it useful to dedup tasks with the same stack trace. The stack1 script attached does this on a running system: $ sudo ./stack1 1 systemd 363 systemd-journal 377 systemd-udevd 530 systemd-timesyn 534 systemd-resolve 594 dbus-daemon 615 systemd-logind 1807 firefox 1866 Privileged Cont 1886 firefox 1887 firefox 1918 WebExtensions 1962 Web Content 1990 Web Content 2036 systemd 2065 dbus-daemon 2071 Xorg 2078 Xorg 2204 dbus-daemon 2839 Web Content 3372 skypeforlinux 3375 skypeforlinux 3502 skypeforlinux 3523 skypeforlinux 3526 skypeforlinux 3528 skypeforlinux 3550 skypeforlinux 3556 skypeforlinux 3558 skypeforlinux 3560 skypeforlinux 3562 skypeforlinux 3578 skypeforlinux 3586 skypeforlinux 3610 skypeforlinux 7883 cupsd 11819 Web Content 11998 Web Content 12091 Web Content 12207 Web Content 12284 Web Content [<0>] ep_poll+0x3d0/0x420 [<0>] do_epoll_wait+0xb8/0xd0 [<0>] __x64_sys_epoll_wait+0x1e/0x30 [<0>] do_syscall_64+0x5a/0x130 [<0>] entry_SYSCALL_64_after_hwframe+0x44/0xa9 2 kthreadd [<0>] kthreadd+0x2cb/0x2e0 [<0>] ret_from_fork+0x35/0x40 ...

            Alex Zhuravlev (bzzz@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/38936
            Subject: LU-13676 tools: awk script to find unique backtraces
            Project: fs/lustre-release
            Branch: master
            Current Patch Set: 1
            Commit: 920a4c86605f401a314343c5cf6079ed44ba5424

            gerrit Gerrit Updater added a comment - Alex Zhuravlev (bzzz@whamcloud.com) uploaded a new patch: https://review.whamcloud.com/38936 Subject: LU-13676 tools: awk script to find unique backtraces Project: fs/lustre-release Branch: master Current Patch Set: 1 Commit: 920a4c86605f401a314343c5cf6079ed44ba5424

            People

              bzzz Alex Zhuravlev
              bzzz Alex Zhuravlev
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: