From mboxrd@z Thu Jan 1 00:00:00 1970 From: Michael Clark Subject: Lockup with Linux dpt_i20 driver Date: Wed, 07 Apr 2004 10:28:06 +0800 Sender: linux-scsi-owner@vger.kernel.org Message-ID: <40736736.4000307@metaparadigm.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Return-path: Received: from gort.metaparadigm.com ([203.117.131.12]:17353 "EHLO gort.metaparadigm.com") by vger.kernel.org with ESMTP id S263457AbUDGC2L (ORCPT ); Tue, 6 Apr 2004 22:28:11 -0400 List-Id: linux-scsi@vger.kernel.org To: deanna_bonds@adaptec.com, mark_salyzyn@adaptec.com Cc: linux-scsi , Chua Kian Teck Hi Deanna, Mark, My customer is having some trouble with 'livelocks' using the dpt_i20 driver with an AIC-7902 firmware 1.62 (it is the latest firmware I can find on Adaptec site - it shipped with this) setup with a single 3 disk RAID-5. The problem livelock happens on every kernel we have tried from Redhat 2.4.20-20.7smp, 2.4.19-aa and 2.4.23-aa (which has same driver as in mainline I believe). SMP and highmem disabled (have tried with and without). The problem is a classical IO freeze livelock and more recently we have been getting task traces from SysReq-T on the serial port. It only happens on the Samba servers which have pretty busy IO. This is the most interesting part of the trace (the rest follows): Proc; scsi_eh_0 >>EIP; dff94000 <===== Trace; c01d3c8e Trace; c01d322b Trace; c01cc000 Trace; c01cc79c Trace; c01ccfa7 Trace; c01055c6 Trace; c01cce60 Relevent parts of dmesg: Adaptec I2O RAID controller 0 irq=10 BAR0 e0842000 - size= 100000 BAR1 e0943000 - size= 1000000 dpti: If you have a lot of devices this could take a few minutes. dpti0: Reading the hardware resource table. TID 008 Vendor: ADAPTEC Device: AIC-7902 Rev: 00000001 TID 009 Vendor: ADAPTEC Device: AIC-7902 Rev: 00000001 TID 516 Vendor: SDR G Device: GEM318P Rev: 1 0 TID 517 Vendor: HP C Device: C7438A Rev: V303 TID 521 Vendor: ADAPTEC R Device: RAID-5 Rev: 3B05D scsi0 : Vendor: Adaptec Model: 2010S FW:3B05 Vendor: ADAPTEC Model: RAID-5 Rev: 3B05 Type: Direct-Access ANSI SCSI revision: 02 Vendor: SDR Model: GEM318P Rev: 1 Type: Processor ANSI SCSI revision: 02 Vendor: HP Model: C7438A Rev: V303 Type: Sequential-Access ANSI SCSI revision: 03 Attached scsi disk sda at scsi0, channel 0, id 0, lun 0 SCSI device sda: 143372288 512-byte hdwr sectors (73407 MB) Partition check: sda: sda1 sda2 sda3 Attached scsi generic sg1 at scsi0, channel 0, id 8, lun 0, type 3 Here is the ksymoops of SysReq-T captured while the machine is livelocked (pingable but all processes blocked on VM IO). ksymoops 2.4.4 on i686 2.4.23aa2. Options used -V (default) -k /proc/ksyms (default) -l /proc/modules (default) -o /lib/modules/2.4.23aa2/ (default) -m /boot/System.map-2.4.23aa2 (default) Warning: You did not tell me where to find symbol information. I will assume that the log matches the kernel and modules that are running right now and I'll use the default options above for symbol resolution. If the current kernel and/or modules do not match the log, you can get more accurate output by telling me the kernel version and where to find map, modules, ksyms etc. ksymoops -h explains the options. init S C159C000 4140 1 0 26978 (NOTLB) Using defaults from ksymoops -t elf32-i386 -a i386 Call Trace: [] (20) [] (24) [] (28) [] (32) [] (112) [] (60) keventd S DFFEC000 6132 2 1 3 (L-TLB) Call Trace: [] (88) [] (20) [] (08) [] (08) [] (04) ksoftirqd_CPU S DFFE6000 6488 3 1 4 2 (L-TLB) Call Trace: [] (08) [] (12) [] (08) [] (04) kswapd S DFFE4000 5232 4 1 5 3 (L-TLB) Call Trace: [] (12) [] (36) [] (12) [] (04) [] (08) [] (04) bdflush S DFFE2000 5124 5 1 6 4 (L-TLB) Call Trace: [] (44) [] (12) [] (04) [] (08) [] (04) kupdated D DFFE0000 4936 6 1 9 5 (L-TLB) Call Trace: [] (24) [] (20) [] (16) [] (12) [] (12) [] (148) [] (24) [] (20) [] (08) [] (08) [] (04) scsi_eh_0 S DFF94000 6336 9 1 10 6 (L-TLB) Call Trace: [] (84) [] (72) [] (12) [] (48) [] (48) [] (08) [] (04) kjournald D C2340000 4768 10 1 124 9 (L-TLB) Call Trace: [] (12) [] (48) [] (252) [] (08) [] (72) [] (24) [] (24) [] (08) [] (04) mdrecoveryd S C2BCC000 2640 124 1 131 10 (L-TLB) Call Trace: [] (32) [] (52) [] (08) [] (04) kjournald D C2468000 120 131 1 133 124 (L-TLB) Call Trace: [] (12) [] (48) [] (52) [] (200) [] (08) [] (72) [] (24) [] (24) [] (08) [] (04) loop0 S C2A4A000 0 133 1 134 131 (L-TLB) Call Trace: [] (52) [] (12) [] (08) [] (40) [] (08) [] (04) loop1 S C2B72000 0 134 1 135 133 (L-TLB) Call Trace: [] (52) [] (12) [] (08) [] (40) [] (08) [] (04) loop2 S C2AF2000 0 135 1 521 134 (L-TLB) Call Trace: [] (52) [] (12) [] (08) [] (40) [] (08) [] (04) syslogd D C2F70000 0 521 1 526 135 (NOTLB) Call Trace: [] (44) [] (12) [] (32) [] (12) [] (24) [] (16) [] (16) [] (40) [] (60) klogd S C2FAC000 0 526 1 614 521 (NOTLB) Call Trace: [] (20) [] (24) [] (76) [] (64) [] (28) [] (32) [] (24) [] (68) [] (20) [] (20) [] (28) [] (60) apcupsd S C2E66000 0 614 1 1053 724 526 (NOTLB) Call Trace: [] (20) [] (24) [] (28) [] (32) [] (16) [] (44) [] (52) [] (60) named S C33B8000 0 724 1 725 749 614 (NOTLB) Call Trace: [] (32) [] (60) named S C3312000 5336 725 724 729 (NOTLB) Call Trace: [] (20) [] (24) [] (32) [] (48) [] (32) [] (60) named S C3310000 4556 727 725 728 (NOTLB) Call Trace: [] (32) [] (60) named S C3392000 2640 728 725 729 727 (NOTLB) Call Trace: [] (20) [] (24) [] (24) [] (40) [] (60) named S C2C0A000 4940 729 725 728 (NOTLB) Call Trace: [] (20) [] (24) [] (28) [] (32) [] (60) [] (52) [] (60) sshd S C30D0000 2640 749 1 20326 783 724 (NOTLB) Call Trace: [] (12) [] (32) [] (28) [] (32) [] (112) [] (60) lpd S C37D4000 5444 783 1 802 749 (NOTLB) Call Trace: [] (12) [] (32) [] (28) [] (32) [] (16) [] (44) [] (52) [] (60) ntpd S C378A000 2640 802 1 820 783 (NOTLB) Call Trace: [] (20) [] (24) [] (28) [] (32) [] (24) [] (24) [] (64) [] (60) gpm S C371A000 5304 820 1 839 802 (NOTLB) Call Trace: [] (20) [] (24) [] (28) [] (32) [] (16) [] (96) [] (60) crond S C36EA000 5616 839 1 20333 887 820 (NOTLB) Call Trace: [] (20) [] (24) [] (20) [] (44) [] (60) atd S C3682000 5444 887 1 912 839 (NOTLB) Call Trace: [] (20) [] (24) [] (20) [] (44) [] (60) cupsd D C3600000 5120 912 1 971 887 (NOTLB) Call Trace: [] (60) [] (28) [] (04) [] (36) [] (32) [] (24) [] (08) [] (32) [] (44) [] (52) [] (40) [] (56) [] (60) cyrus-master S C3408000 2640 971 1 20316 975 912 (NOTLB) Call Trace: [] (20) [] (24) [] (28) [] (32) [] (112) [] (60) postfix-maste S C3468000 0 975 1 20325 1015 971 (NOTLB) Call Trace: [] (20) [] (24) [] (76) [] (64) [] (28) [] (56) [] (76) [] (36) [] (60) [] (12) [] (20) [] (28) [] (56) [] (60) qmgr D C3982000 0 1008 975 5659 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (104) [] (36) [] (12) [] (20) [] (08) [] (68) [] (60) sulogin D C3E46000 16 1015 1 1017 975 (NOTLB) Call Trace: [] (64) [] (32) [] (16) [] (48) [] (28) [] (44) [] (40) [] (20) [] (12) [] (36) [] (16) [] (36) [] (16) [] (48) [] (116) [] (28) [] (12) [] (24) [] (20) [] (12) [] (108) [] (12) [] (68) [] (328) [] (20) [] (28) [] (60) mingetty S C39C6000 0 1017 1 1018 1015 (NOTLB) Call Trace: [] (44) [] (104) [] (20) [] (28) [] (20) [] (20) [] (28) [] (60) mingetty S C3E2E000 0 1018 1 1019 1017 (NOTLB) Call Trace: [] (44) [] (104) [] (20) [] (28) [] (20) [] (20) [] (28) [] (60) mingetty S C3E34000 0 1019 1 1020 1018 (NOTLB) Call Trace: [] (44) [] (104) [] (20) [] (28) [] (20) [] (20) [] (28) [] (60) mingetty S C3E4A000 0 1020 1 1021 1019 (NOTLB) Call Trace: [] (44) [] (104) [] (20) [] (28) [] (20) [] (20) [] (28) [] (60) mingetty S C3E02000 32 1021 1 1026 1020 (NOTLB) Call Trace: [] (44) [] (104) [] (20) [] (28) [] (20) [] (20) [] (28) [] (60) saslauthd S C2A3C000 0 1026 1 1032 1033 1021 (NOTLB) Call Trace: [] (60) [] (20) [] (28) [] (32) [] (60) [] (64) [] (28) [] (36) [] (60) saslauthd S C3D04000 4580 1029 1026 1030 (NOTLB) Call Trace: [] (60) [] (20) [] (28) [] (32) [] (60) [] (64) [] (28) [] (36) [] (60) saslauthd S C3CFE000 4484 1030 1026 1031 1029 (NOTLB) Call Trace: [] (60) [] (20) [] (28) [] (32) [] (60) [] (64) [] (28) [] (36) [] (60) saslauthd S C3CFA000 4620 1031 1026 1032 1030 (NOTLB) Call Trace: [] (44) [] (84) [] (36) [] (36) [] (32) [] (64) [] (72) [] (32) [] (20) [] (60) saslauthd S C3CF2000 4572 1032 1026 1031 (NOTLB) Call Trace: [] (60) [] (20) [] (28) [] (32) [] (60) [] (64) [] (28) [] (36) [] (60) nmbd D C480C000 4216 1033 1 1034 1036 1026 (NOTLB) Call Trace: [] (60) [] (48) [] (80) [] (32) [] (28) [] (24) [] (20) [] (28) [] (44) [] (28) [] (56) [] (24) [] (60) nmbd S C4FFE000 6288 1034 1033 (NOTLB) Call Trace: [] (64) [] (20) [] (32) [] (68) [] (60) smbd D C4EDE000 5100 1036 1 20307 1037 1033 (NOTLB) Call Trace: [] (44) [] (20) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) clamd S C4E48000 5444 1037 1 1038 1040 1036 (NOTLB) Call Trace: [] (44) [] (84) [] (36) [] (36) [] (104) [] (12) [] (52) [] (52) [] (60) clamd S C4E1E000 5208 1038 1037 1039 (NOTLB) Call Trace: [] (20) [] (24) [] (32) [] (48) [] (32) [] (60) clamd S C39C0000 4676 1039 1038 (NOTLB) Call Trace: [] (20) [] (24) [] (76) [] (32) [] (08) [] (24) [] (28) [] (28) [] (28) [] (88) [] (12) [] (20) [] (84) [] (28) [] (56) [] (60) slapd S C4C96000 4916 1040 1 1041 1046 1037 (NOTLB) Call Trace: [] (32) [] (60) slapd S C53AA000 5484 1041 1040 2114 (NOTLB) Call Trace: [] (20) [] (24) [] (32) [] (48) [] (32) [] (60) slapd S C53A8000 2640 1042 1041 1044 (NOTLB) Call Trace: [] (32) [] (60) slapd S C4DBA000 0 1044 1041 1045 1042 (NOTLB) Call Trace: [] (32) [] (60) slapd S C5D86000 2640 1045 1041 1069 1044 (NOTLB) Call Trace: [] (32) [] (60) idled S C63FA000 5072 1046 1 1050 1040 (NOTLB) Call Trace: [] (20) [] (24) [] (28) [] (32) [] (32) [] (60) [] (20) [] (60) amavisd S C6988000 2640 1050 1 9721 26978 1046 (NOTLB) Call Trace: [] (20) [] (24) [] (28) [] (32) [] (56) [] (56) [] (60) apcupsd S C6DF6000 5432 1053 614 1054 (NOTLB) Call Trace: [] (20) [] (24) [] (32) [] (48) [] (32) [] (60) apcupsd S C6DF2000 5936 1054 1053 (NOTLB) Call Trace: [] (44) [] (84) [] (28) [] (32) [] (44) [] (28) [] (28) [] (24) [] (44) [] (52) [] (60) slapd S C71CA000 4820 1069 1041 1086 1045 (NOTLB) Call Trace: [] (32) [] (60) slapd S C76BA000 4844 1086 1041 1098 1069 (NOTLB) Call Trace: [] (20) [] (24) [] (76) [] (64) [] (24) [] (60) [] (80) [] (72) [] (16) [] (36) [] (28) [] (56) [] (60) slapd S C7686000 2640 1098 1041 1116 1086 (NOTLB) Call Trace: [] (32) [] (60) slapd S C761E000 4752 1116 1041 1134 1098 (NOTLB) Call Trace: [] (32) [] (60) slapd S C75D0000 4776 1134 1041 1146 1116 (NOTLB) Call Trace: [] (32) [] (60) slapd S C758E000 2640 1146 1041 1163 1134 (NOTLB) Call Trace: [] (32) [] (60) slapd S C758A000 2640 1163 1041 1175 1146 (NOTLB) Call Trace: [] (32) [] (60) slapd S C756C000 0 1175 1041 1193 1163 (NOTLB) Call Trace: [] (32) [] (60) slapd S C70FA000 4752 1193 1041 1200 1175 (NOTLB) Call Trace: [] (32) [] (60) slapd S C757E000 144 1200 1041 1215 1193 (NOTLB) Call Trace: [] (32) [] (60) slapd S C70EC000 0 1215 1041 1227 1200 (NOTLB) Call Trace: [] (32) [] (60) slapd S C70E2000 0 1227 1041 1234 1215 (NOTLB) Call Trace: [] (32) [] (60) slapd S C753C000 2640 1234 1041 1246 1227 (NOTLB) Call Trace: [] (32) [] (60) slapd S C7532000 4772 1246 1041 1254 1234 (NOTLB) Call Trace: [] (32) [] (60) slapd S C752A000 4900 1254 1041 1261 1246 (NOTLB) Call Trace: [] (32) [] (60) slapd S C7526000 2640 1261 1041 1273 1254 (NOTLB) Call Trace: [] (32) [] (60) slapd S C751C000 4752 1273 1041 1283 1261 (NOTLB) Call Trace: [] (32) [] (60) slapd S C7516000 2640 1283 1041 1288 1273 (NOTLB) Call Trace: [] (32) [] (60) slapd S C7514000 2640 1288 1041 1305 1283 (NOTLB) Call Trace: [] (32) [] (60) slapd S C7506000 2640 1305 1041 1310 1288 (NOTLB) Call Trace: [] (32) [] (60) slapd S C7504000 2640 1310 1041 1320 1305 (NOTLB) Call Trace: [] (32) [] (60) slapd S C74F8000 4820 1320 1041 1328 1310 (NOTLB) Call Trace: [] (32) [] (60) slapd S C74F2000 4876 1328 1041 1913 1320 (NOTLB) Call Trace: [] (32) [] (60) slapd S C7B66000 2640 1913 1041 1920 1328 (NOTLB) Call Trace: [] (32) [] (60) slapd S C7A38000 4876 1920 1041 1925 1913 (NOTLB) Call Trace: [] (32) [] (60) slapd S C79C8000 4772 1925 1041 1930 1920 (NOTLB) Call Trace: [] (32) [] (60) slapd S C79E4000 0 1930 1041 1937 1925 (NOTLB) Call Trace: [] (32) [] (60) slapd S C79F2000 144 1937 1041 1942 1930 (NOTLB) Call Trace: [] (32) [] (60) slapd S C79DC000 0 1942 1041 1949 1937 (NOTLB) Call Trace: [] (32) [] (60) slapd S C79EA000 144 1949 1041 1954 1942 (NOTLB) Call Trace: [] (32) [] (60) slapd S C79D6000 0 1954 1041 1961 1949 (NOTLB) Call Trace: [] (32) [] (60) slapd S C7A04000 144 1961 1041 1966 1954 (NOTLB) Call Trace: [] (32) [] (60) slapd S C79AE000 4808 1966 1041 1973 1961 (NOTLB) Call Trace: [] (32) [] (60) slapd S C79FC000 144 1973 1041 1978 1966 (NOTLB) Call Trace: [] (32) [] (60) slapd S C79FA000 144 1978 1041 1985 1973 (NOTLB) Call Trace: [] (32) [] (60) slapd S C79EC000 1168 1985 1041 1990 1978 (NOTLB) Call Trace: [] (32) [] (60) slapd S C79F4000 144 1990 1041 1997 1985 (NOTLB) Call Trace: [] (32) [] (60) slapd S C79B6000 144 1997 1041 2002 1990 (NOTLB) Call Trace: [] (32) [] (60) slapd S C79B4000 144 2002 1041 2012 1997 (NOTLB) Call Trace: [] (32) [] (60) slapd S C7B36000 144 2012 1041 2017 2002 (NOTLB) Call Trace: [] (32) [] (60) slapd S C7992000 144 2017 1041 2024 2012 (NOTLB) Call Trace: [] (32) [] (60) slapd S C7B28000 144 2024 1041 2029 2017 (NOTLB) Call Trace: [] (32) [] (60) slapd S C798E000 2640 2029 1041 2050 2024 (NOTLB) Call Trace: [] (32) [] (60) slapd S C79C0000 0 2050 1041 2067 2029 (NOTLB) Call Trace: [] (32) [] (60) slapd S C7B2C000 144 2067 1041 2088 2050 (NOTLB) Call Trace: [] (32) [] (60) slapd S C7AFE000 0 2088 1041 2109 2067 (NOTLB) Call Trace: [] (32) [] (60) slapd S C7988000 2640 2109 1041 2114 2088 (NOTLB) Call Trace: [] (32) [] (60) slapd S C7B00000 0 2114 1041 2109 (NOTLB) Call Trace: [] (32) [] (60) mingetty D C39EA000 0 26978 1 1050 (NOTLB) Call Trace: [] (48) [] (60) [] (16) [] (52) [] (68) [] (60) smbd D CDCEA000 0 30569 1036 17553 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) smbd D D874E000 0 17553 1036 17554 30569 (NOTLB) Call Trace: [] (64) [] (32) [] (20) [] (44) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) smbd D D80EC000 0 17554 1036 18377 17553 (NOTLB) Call Trace: [] (64) [] (32) [] (16) [] (20) [] (28) [] (28) [] (44) [] (12) [] (28) [] (20) [] (12) [] (60) [] (16) [] (52) [] (40) [] (28) [] (60) imapd S D517E000 0 18371 971 19261 (NOTLB) Call Trace: [] (20) [] (24) [] (28) [] (32) [] (60) [] (52) [] (60) smbd D D4F6A000 32 18377 1036 18379 17554 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) smbd D D2F8E000 0 18379 1036 18386 18377 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) smbd D C7C4E000 0 18386 1036 19203 18379 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) smbd D DBB8A000 0 19203 1036 19204 18386 (NOTLB) Call Trace: [] (64) [] (32) [] (16) [] (20) [] (28) [] (28) [] (44) [] (12) [] (28) [] (20) [] (12) [] (60) [] (16) [] (52) [] (68) [] (60) smbd D DF91A000 16 19204 1036 19211 19203 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) smbd D D8E10000 0 19211 1036 19266 19204 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) imapd D C63B8000 0 19261 971 19264 18371 (NOTLB) Call Trace: [] (24) [] (20) [] (16) [] (48) [] (60) imapd D D5A88000 0 19264 971 20987 19261 (NOTLB) Call Trace: [] (44) [] (16) [] (12) [] (40) [] (24) [] (24) [] (20) [] (48) [] (20) [] (28) [] (52) [] (24) [] (56) [] (24) [] (60) smbd D C713A000 0 19266 1036 19277 19211 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) smbd D D06E2000 0 19277 1036 20099 19266 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) smbd D DEDF4000 0 20099 1036 20103 19277 (NOTLB) Call Trace: [] (08) [] (52) [] (40) [] (28) [] (32) [] (60) [] (24) [] (24) [] (20) [] (48) [] (20) [] (28) [] (48) [] (28) [] (56) [] (24) [] (60) smbd D CE6E4000 0 20103 1036 20104 20099 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) smbd D D5DA4000 0 20104 1036 20116 20103 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) smbd D C68A2000 0 20116 1036 20986 20104 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) smbd D D42F2000 8 20986 1036 21817 20116 (NOTLB) Call Trace: [] (44) [] (16) [] (52) [] (24) [] (24) [] (20) [] (24) [] (24) [] (20) [] (28) [] (48) [] (28) [] (56) [] (24) [] (60) imapd D CD57C000 4 20987 971 23479 19264 (NOTLB) Call Trace: [] (24) [] (20) [] (16) [] (48) [] (60) smbd D CCB8A000 0 21817 1036 25143 20986 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) imapd D CE4E0000 0 23479 971 2584 20987 (NOTLB) Call Trace: [] (24) [] (20) [] (16) [] (48) [] (60) [] (20) [] (16) [] (20) [] (40) [] (60) smbd D D823E000 12 838 1036 25269 25143 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) imapd D D6D36000 4 2584 971 20227 23479 (NOTLB) Call Trace: [] (44) [] (12) [] (32) [] (12) [] (24) [] (20) [] (12) [] (40) [] (60) smbd D D7266000 0 25269 1036 15183 838 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) smbd D CC8D6000 0 15183 1036 15185 25269 (NOTLB) Call Trace: [] (64) [] (32) [] (20) [] (44) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) smbd D D2390000 0 15185 1036 16020 15183 (NOTLB) Call Trace: [] (64) [] (32) [] (20) [] (44) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) smbd D C9C24000 0 16020 1036 18522 15185 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) pickup D DB7C2000 0 5659 975 20324 1008 (NOTLB) Call Trace: [] (04) [] (56) [] (28) [] (40) [] (32) [] (44) [] (20) [] (28) [] (44) [] (40) [] (20) [] (12) [] (52) [] (52) [] (36) [] (12) [] (20) [] (08) [] (68) [] (60) amavisd S C3B78000 4072 6496 1050 9721 (NOTLB) Call Trace: [] (20) [] (24) [] (28) [] (32) [] (112) [] (60) amavisd S DC754000 4 9721 1050 6496 (NOTLB) Call Trace: [] (80) [] (28) [] (48) [] (28) [] (60) smbd D D223C000 0 12940 1036 17812 27637 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) sshd S C3490000 0 17753 749 17754 20257 (NOTLB) Call Trace: [] (20) [] (24) [] (28) [] (32) [] (60) [] (52) [] (60) bash S C296A000 0 17754 17753 20318 (NOTLB) Call Trace: [] (84) [] (60) smbd D DE4C6000 0 17812 1036 20307 12940 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) imapd S D6DA4000 0 17814 971 20300 2313 (NOTLB) Call Trace: [] (20) [] (24) [] (28) [] (32) [] (60) [] (52) [] (60) sshd S DB582000 0 20257 749 20258 20319 17753 (NOTLB) Call Trace: [] (20) [] (24) [] (28) [] (32) [] (16) [] (96) [ 20257 20314 (NOTLB) Call Trace: [] (84) [] (60) imapd D D8BB6000 564 20300 971 20316 17814 (NOTLB) Call Trace: [] (24) [] (20) [] (16) [] (48) [] (60) smbd D D954C000 144 20307 1036 17812 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (24) [] (44) [] (20) [] (16) [] (20) [] (40) [] (60) smbstatus D D16F4000 0 20314 20258 (NOTLB) Call Trace: [] (64) [] (32) [] (24) [] (40) [] (28) [] (44) [] (20) [] (20) [] (20) [] (12) [] (60) [] (16) [] (52) [] (20) [] (28) [] (20) [] (60) cyrus-master D CF4C2000 144 20316 971 20300 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (36) [] (16) [] (36) [] (16) [] (48) [] (116) [] (28) [] (36) [] (20) [] (12) [] (108) [] (12) [] (68) [] (328) [] (20) [] (28) [] (60) bash D DC376000 0 20317 17754 20318 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (16) [] (24) [] (20) [] (12) [] (40) [] (20) [] (16) [] (12) [] (40) [] (36) [] (28) [] (324) [] (20) [] (28) [] (60) bash D D66B0000 0 20318 17754 20317 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (40) [] (20) [] (12) [] (40) [] (20) [] (16) [] (12) [] (40) [] (36) [] (28) [] (324) [] (20) [] (28) [] (60) sshd D CBFC6000 0 20319 749 20326 20257 (NOTLB) Call Trace: [] (64) [] (32) [] (64) [] (28) [] (44) [] (12) [] (28) [] (20) [] (12) [] (60) [] (16) [] (52) [] (68) [] (60) crond D DA1F4000 0 20320 839 20321 20322 (NOTLB) Call Trace: [] (80) [] (56) [] (20) [] (60) crond D DCE5C000 28 20321 20320 (NOTLB) Call Trace: [] (64) [] (32) [] (64) Warning (Oops_read): Code line not seen, dumping what data is available Proc; init >>EIP; c159c000 <_end+12a3c8c/2893c8c> <===== Trace; c011dad3 Trace; c011da30 Trace; c0145f80 Trace; c0145c00 <__pollwait+0/c0> Trace; c014640a Trace; c0106f03 Proc; keventd >>EIP; dffec000 <===== Trace; c0121dcd Trace; c0105000 <_stext+0/0> Trace; c0105000 <_stext+0/0> Trace; c01055c6 Trace; c0121cb0 Proc; ksoftirqd_CPU >>EIP; dffe6000 <===== Trace; c0105000 <_stext+0/0> Trace; c0119ffe Trace; c01055c6 Trace; c0119f90 Proc; kswapd >>EIP; dffe4000 <===== Trace; c012fe58 Trace; c0106eb6 Trace; c0110018 Trace; c0105000 <_stext+0/0> Trace; c01055c6 Trace; c012fdc0 Proc; bdflush >>EIP; dffe2000 <===== Trace; c0112dfd Trace; c013ba2a Trace; c0105000 <_stext+0/0> Trace; c01055c6 Trace; c013b980 Proc; kupdated >>EIP; dffe0000 <===== Trace; c0105c7d <__down+5d/b0> Trace; c014abc3 Trace; c0105dd0 <__down_failed+8/c> Trace; c013d130 <.text.lock.super+19/59> Trace; c013b84e Trace; c013bb58 Trace; c0106eb6 Trace; c0105000 <_stext+0/0> Trace; c0105000 <_stext+0/0> Trace; c01055c6 Trace; c013ba30 Proc; scsi_eh_0 >>EIP; dff94000 <===== Trace; c01d3c8e Trace; c01d322b Trace; c01cc000 Trace; c01cc79c Trace; c01ccfa7 Trace; c01055c6 Trace; c01cce60 Proc; kjournald >>EIP; c2340000 <_end+2047c8c/2893c8c> <===== Trace; c01384f8 <__wait_on_buffer+78/a0> Trace; c019b5f3 <__submit_bh+53/f0> Trace; c016c7e5 Trace; c0112b7e Trace; c0112b8a Trace; c016ebb6 Trace; c016ea80 Trace; c01055c6 Trace; c016eaa0 Proc; mdrecoveryd >>EIP; c2bcc000 <===== Trace; c2bd4296 Trace; c0106eb6 Trace; c01055c6 Trace; c2bd41c0 Proc; kjournald >>EIP; c2468000 <_end+216fc8c/2893c8c> <===== Trace; c01384f8 <__wait_on_buffer+78/a0> Trace; c019b5f3 <__submit_bh+53/f0> Trace; c016c7e5 Trace; c01a655c Trace; c0112b7e Trace; c0112b8a Trace; c016ebb6 Trace; c016ea80 Trace; c01055c6 Trace; c016eaa0 Proc; loop0 >>EIP; c2a4a000 <_end+2751c8c/2893c8c> <===== Trace; c0105d2d <__down_interruptible+5d/c0> Trace; c0105ddb <__down_failed_interruptible+7/c> Trace; c2a7d932 <_end+27855be/2893c8c> Trace; c2a7c9b0 <_end+278463c/2893c8c> Trace; c01055c6 Trace; c2a7c9b0 <_end+278463c/2893c8c> Proc; loop1 >>EIP; c2b72000 <_end+2879c8c/2893c8c> <===== Trace; c0105d2d <__down_interruptible+5d/c0> Trace; c0105ddb <__down_failed_interruptible+7/c> Trace; c2a7d932 <_end+27855be/2893c8c> Trace; c2a7c9b0 <_end+278463c/2893c8c> Trace; c01055c6 Trace; c2a7c9b0 <_end+278463c/2893c8c> Proc; loop2 >>EIP; c2af2000 <_end+27f9c8c/2893c8c> <===== Trace; c0105d2d <__down_interruptible+5d/c0> Trace; c0105ddb <__down_failed_interruptible+7/c> Trace; c2a7d932 <_end+27855be/2893c8c> Trace; c2a7c9b0 <_end+278463c/2893c8c> Trace; c01055c6 Trace; c2a7c9b0 <_end+278463c/2893c8c> Proc; syslogd >>EIP; c2f70000 <===== Trace; c0112ecd Trace; c016f01a Trace; c016b46d Trace; c016b4aa Trace; c0169ac1 Trace; c0160d2f Trace; c01e90f4 Trace; c0138a61 Trace; c0106f03 Proc; klogd >>EIP; c2fac000 <===== Trace; c011da54 Trace; c01ea99c Trace; c0227798 Trace; c02280ab Trace; c01e7b9f Trace; c0111656 Trace; c0112b8a Trace; c01e7db7 Trace; c01376a6 Trace; c013719d Trace; c0119432 Trace; c0106f03 Proc; apcupsd >>EIP; c2e66000 <===== Trace; c011dad3 Trace; c011da30 Trace; c0145f80 Trace; c0145c00 <__pollwait+0/c0> Trace; c014640a Trace; c0183485 Trace; c01376f2 Trace; c0106f03 Proc; named >>EIP; c33b8000 <===== Trace; c010605b Trace; c0106f03 Proc; named >>EIP; c3312000 <===== Trace; c011dad3 Trace; c011da30 Trace; c014675d Trace; c014695e Trace; c0145c00 <__pollwait+0/c0> Trace; c0106f03 Proc; named >>EIP; c3310000 <===== Trace; c010605b Trace; c0106f03 Proc; named >>EIP; c3392000 <===== Trace; c011dad3 Trace; c011da30 Trace; c011dbe8 Trace; c0119533 Trace; c0106f03 Proc; named >>EIP; c2c0a000 <===== Trace; c011da54 Trace; c01e7fbf Trace; c0145f80 Trace; c0145c00 <__pollwait+0/c0> Trace; c014640a Trace; c0137602 Trace; c0106f03 Proc; sshd >>EIP; c30d0000 <===== Trace; c011da54 Trace; c0140723 Trace; c0145f80 Trace; c0145c00 <__pollwait+0/c0> Trace; c014640a Trace; c0106f03 Proc; lpd >>EIP; c37d4000 <===== Trace; c011da54 Trace; c0140723 Trace; c0145f80 Trace; c0145c00 <__pollwait+0/c0> Trace; c014640a Trace; c011f5d9 Trace; c0137602 Trace; c0106f03 Proc; ntpd >>EIP; c378a000 <===== Trace; c011da54 Trace; c01e7fbf Trace; c0145f80 Trace; c0145c00 <__pollwait+0/c0> Trace; c014640a Trace; c01062b5 Trace; c01063ae Trace; c0106f03 Proc; gpm >>EIP; c371a000 <===== Trace; c011dad3 Trace; c011da30 Trace; c0145f80 Trace; c0145c00 <__pollwait+0/c0> Trace; c014640a Trace; c011f5d9 Trace; c0106f03 Proc; crond >>EIP; c36ea000 <===== Trace; c011dad3 Trace; c011da30 Trace; c011dbe8 Trace; c011ec2a Trace; c0106f03 Proc; atd >>EIP; c3682000 <===== Trace; c011dad3 Trace; c011da30 Trace; c011dbe8 Trace; c011ec2a Trace; c0106f03 Proc; cupsd >>EIP; c3600000 <===== Trace; c01384f8 <__wait_on_buffer+78/a0> Trace; c016a73c Trace; c0164db6 Trace; c0164e11 Trace; c016aba0 Trace; c01669bd Trace; c0165104 Trace; c0165115 Trace; c0165217 Trace; c016705d Trace; c0142ec2 Trace; c0142f98 Trace; c0106f03 Proc; cyrus-master >>EIP; c3408000 <===== Trace; c011dad3 Trace; c011da30 Trace; c0145f80 Trace; c0145c00 <__pollwait+0/c0> Trace; c014640a Trace; c0106f03 Proc; postfix-maste >>EIP; c3468000 <===== Trace; c011da54 Trace; c01ea99c Trace; c0227798 Trace; c02280ab Trace; c01e7b9f Trace; c0130814 <__alloc_pages+74/2e0> Trace; c01e8950 Trace; c0106b1d Trace; c0106dc1 Trace; c014062d Trace; c0119101 Trace; c01e898d Trace; c01e90b1 Trace; c0106f03 Proc; qmgr >>EIP; c3982000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c0160b88 Trace; c013ea9f Trace; c0145190 Trace; c0145730 Trace; c014587a Trace; c0145730 Trace; c0106f03 Proc; sulogin >>EIP; c3e46000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01246a3 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c012827c Trace; c0128140 Trace; c0141c9b Trace; c013f206 Trace; c0157f0e Trace; c016b475 Trace; c01652c3 Trace; c01242dc Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c0127eef <__do_generic_file_read+49f/4b0> Trace; c0157c30 Trace; c013fa41 Trace; c013fccc Trace; c0140e2e Trace; c0105a20 Trace; c0106f03 Proc; mingetty >>EIP; c39c6000 <===== Trace; c011da54 Trace; c01855f9 Trace; c01819fc Trace; c012639f Trace; c01375b6 Trace; c013719d Trace; c01263e9 Trace; c0106f03 Proc; mingetty >>EIP; c3e2e000 <===== Trace; c011da54 Trace; c01855f9 Trace; c01819fc Trace; c012639f Trace; c01375b6 Trace; c013719d Trace; c01263e9 Trace; c0106f03 Proc; mingetty >>EIP; c3e34000 <===== Trace; c011da54 Trace; c01855f9 Trace; c01819fc Trace; c012639f Trace; c01375b6 Trace; c013719d Trace; c01263e9 Trace; c0106f03 Proc; mingetty >>EIP; c3e4a000 <===== Trace; c011da54 Trace; c01855f9 Trace; c01819fc Trace; c012639f Trace; c01375b6 Trace; c013719d Trace; c01263e9 Trace; c0106f03 Proc; mingetty >>EIP; c3e02000 <===== Trace; c011da54 Trace; c01855f9 Trace; c01819fc Trace; c012639f Trace; c01375b6 Trace; c013719d Trace; c01263e9 Trace; c0106f03 Proc; saslauthd >>EIP; c2a3c000 <_end+2743c8c/2893c8c> <===== Trace; c0147640 Trace; c01e7ec3 Trace; c014769c Trace; c0147b39 Trace; c014a56d Trace; c01488cc Trace; c01448f8 Trace; c0144a71 Trace; c0106f03 Proc; saslauthd >>EIP; c3d04000 <===== Trace; c0147640 Trace; c01e7ec3 Trace; c014769c Trace; c0147b39 Trace; c014a56d Trace; c01488cc Trace; c01448f8 Trace; c0144a71 Trace; c0106f03 Proc; saslauthd >>EIP; c3cfe000 <===== Trace; c0147640 Trace; c01e7ec3 Trace; c014769c Trace; c0147b39 Trace; c014a56d Trace; c01488cc Trace; c01448f8 Trace; c0144a71 Trace; c0106f03 Proc; saslauthd >>EIP; c3cfa000 <===== Trace; c011da54 Trace; c01ec736 Trace; c01ec840 Trace; c0227bee Trace; c01e8673 Trace; c014a56d Trace; c014892f Trace; c01e9050 Trace; c0144a7d Trace; c0106f03 Proc; saslauthd >>EIP; c3cf2000 <===== Trace; c0147640 Trace; c01e7ec3 Trace; c014769c Trace; c0147b39 Trace; c014a56d Trace; c01488cc Trace; c01448f8 Trace; c0144a71 Trace; c0106f03 Proc; nmbd >>EIP; c480c000 <===== Trace; c01384f8 <__wait_on_buffer+78/a0> Trace; c019b7a6 Trace; c0165918 Trace; c0165b70 Trace; c0141af9 Trace; c0165b99 Trace; c0141050 Trace; c0141e2a Trace; c01420c7 Trace; c01465ee Trace; c0136da6 Trace; c01370e4 Trace; c0106f03 Proc; nmbd >>EIP; c4ffe000 <===== Trace; c01401db Trace; c011f2d0 Trace; c01402c4 Trace; c01375b6 Trace; c0106f03 Proc; smbd >>EIP; c4ede000 <===== Trace; c016a981 Trace; c01a6482 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; clamd >>EIP; c4e48000 <===== Trace; c011da54 Trace; c01ec736 Trace; c01ec840 Trace; c0227bee Trace; c01e8673 Trace; c014be17 Trace; c014062d Trace; c01e9050 Trace; c0106f03 Proc; clamd >>EIP; c4e1e000 <===== Trace; c011dad3 Trace; c011da30 Trace; c014675d Trace; c014695e Trace; c0145c00 <__pollwait+0/c0> Trace; c0106f03 Proc; clamd >>EIP; c39c0000 <===== Trace; c011da54 Trace; c01ea99c Trace; c0227798 Trace; c02280ab Trace; c0165104 Trace; c0165115 Trace; c01e7b9f Trace; c016b475 Trace; c01652c3 Trace; c01e8950 Trace; c0165b70 Trace; c0141050 Trace; c013ea9f Trace; c01e898d Trace; c01e90b1 Trace; c0106f03 Proc; slapd >>EIP; c4c96000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c53aa000 <===== Trace; c011dad3 Trace; c011da30 Trace; c014675d Trace; c014695e Trace; c0145c00 <__pollwait+0/c0> Trace; c0106f03 Proc; slapd >>EIP; c53a8000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c4dba000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c5d86000 <===== Trace; c010605b Trace; c0106f03 Proc; idled >>EIP; c63fa000 <===== Trace; c011dad3 Trace; c011da30 Trace; c0145f80 Trace; c0145c00 <__pollwait+0/c0> Trace; c014640a Trace; c0136da6 Trace; c0137106 Trace; c0106f03 Proc; amavisd >>EIP; c6988000 <===== Trace; c011dad3 Trace; c011da30 Trace; c0145f80 Trace; c0145c00 <__pollwait+0/c0> Trace; c014640a Trace; c0119b9b Trace; c0106f03 Proc; apcupsd >>EIP; c6df6000 <===== Trace; c011dad3 Trace; c011da30 Trace; c014675d Trace; c014695e Trace; c0145c00 <__pollwait+0/c0> Trace; c0106f03 Proc; apcupsd >>EIP; c6df2000 <===== Trace; c011da54 Trace; c02065cd Trace; c0206715 Trace; c021ee4a Trace; c01e8673 Trace; c01e7900 Trace; c022702c Trace; c011f2d0 Trace; c011f5c3 Trace; c01e9050 Trace; c0106f03 Proc; slapd >>EIP; c71ca000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c76ba000 <===== Trace; c011da54 Trace; c01ea99c Trace; c0227798 Trace; c02280ab Trace; c01e7b9f Trace; c0165115 Trace; c01e8950 Trace; c0106dc1 Trace; c01e7db7 Trace; c011f2d0 Trace; c01e898d Trace; c01e90b1 Trace; c0106f03 Proc; slapd >>EIP; c7686000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c761e000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c75d0000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c758e000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c758a000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c756c000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c70fa000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c757e000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c70ec000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c70e2000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c753c000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c7532000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c752a000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c7526000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c751c000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c7516000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c7514000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c7506000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c7504000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c74f8000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c74f2000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c7b66000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c7a38000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c79c8000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c79e4000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c79f2000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c79dc000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c79ea000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c79d6000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c7a04000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c79ae000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c79fc000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c79fa000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c79ec000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c79f4000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c79b6000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c79b4000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c7b36000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c7992000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c7b28000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c798e000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c79c0000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c7b2c000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c7afe000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c7988000 <===== Trace; c010605b Trace; c0106f03 Proc; slapd >>EIP; c7b00000 <===== Trace; c010605b Trace; c0106f03 Proc; mingetty >>EIP; c39ea000 <===== Trace; c012748c <___wait_on_page+ac/d0> Trace; c0127d88 <__do_generic_file_read+338/4b0> Trace; c012827c Trace; c0128140 Trace; c01375b6 Trace; c0106f03 Proc; smbd >>EIP; cdcea000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; smbd >>EIP; d874e000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c0141050 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; smbd >>EIP; d80ec000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01eab6b Trace; c02057b5 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c01281ab Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c0127eef <__do_generic_file_read+49f/4b0> Trace; c012827c Trace; c0128140 Trace; c01375b6 Trace; c0137509 Trace; c0106f03 Proc; imapd >>EIP; d517e000 <===== Trace; c011dad3 Trace; c011da30 Trace; c0145f80 Trace; c0145c00 <__pollwait+0/c0> Trace; c014640a Trace; c01376f2 Trace; c0106f03 Proc; smbd >>EIP; d4f6a000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; smbd >>EIP; d2f8e000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; smbd >>EIP; c7c4e000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; smbd >>EIP; dbb8a000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01eab6b Trace; c02057b5 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c01281ab Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c0127eef <__do_generic_file_read+49f/4b0> Trace; c012827c Trace; c0128140 Trace; c01375b6 Trace; c0106f03 Proc; smbd >>EIP; df91a000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; smbd >>EIP; d8e10000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; imapd >>EIP; c63b8000 <===== Trace; c0105c7d <__down+5d/b0> Trace; c0140e2e Trace; c0105dd0 <__down_failed+8/c> Trace; c014434e <.text.lock.namei+ff/221> Trace; c0106f03 Proc; imapd >>EIP; d5a88000 <===== Trace; c0105c7d <__down+5d/b0> Trace; c0105dd0 <__down_failed+8/c> Trace; c0161e47 <.text.lock.ialloc+19/32> Trace; c0128a09 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c016a1ab Trace; c016a2bd Trace; c0166276 Trace; c0141fa8 Trace; c0141e02 Trace; c014212f Trace; c0141050 Trace; c0136da6 Trace; c01370e4 Trace; c0106f03 Proc; smbd >>EIP; c713a000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; smbd >>EIP; d06e2000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; smbd >>EIP; dedf4000 <===== Trace; c01384f8 <__wait_on_buffer+78/a0> Trace; c0139308 Trace; c016a73c Trace; c016bb89 <__journal_file_buffer+d9/1e0> Trace; c016aba0 Trace; c0161887 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c016a1ab Trace; c016a2bd Trace; c0166276 Trace; c0141fa8 Trace; c0141e02 Trace; c014212f Trace; c0145190 Trace; c0136da6 Trace; c01370e4 Trace; c0106f03 Proc; smbd >>EIP; ce6e4000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; smbd >>EIP; d5da4000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; smbd >>EIP; c68a2000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; smbd >>EIP; d42f2000 <===== Trace; c0105c7d <__down+5d/b0> Trace; c0105dd0 <__down_failed+8/c> Trace; c0161e47 <.text.lock.ialloc+19/32> Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c016a1ab Trace; c016a2bd Trace; c0166276 Trace; c0120cde Trace; c0141fa8 Trace; c0141e02 Trace; c014212f Trace; c0145190 Trace; c0136da6 Trace; c01370e4 Trace; c0106f03 Proc; imapd >>EIP; cd57c000 <===== Trace; c0105c7d <__down+5d/b0> Trace; c0140e2e Trace; c0105dd0 <__down_failed+8/c> Trace; c014434e <.text.lock.namei+ff/221> Trace; c0106f03 Proc; smbd >>EIP; ccb8a000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; imapd >>EIP; ce4e0000 <===== Trace; c0105c7d <__down+5d/b0> Trace; c0140e2e Trace; c0105dd0 <__down_failed+8/c> Trace; c014434e <.text.lock.namei+ff/221> Trace; c0106f03 Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; smbd >>EIP; d823e000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; imapd >>EIP; d6d36000 <===== Trace; c0112ecd Trace; c016f01a Trace; c016b46d Trace; c016b4aa Trace; c0169ac1 Trace; c0160d2f Trace; c01376f2 Trace; c0138a61 Trace; c0106f03 Proc; smbd >>EIP; d7266000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; smbd >>EIP; cc8d6000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c0141050 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; smbd >>EIP; d2390000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c0141050 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; smbd >>EIP; c9c24000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; pickup >>EIP; db7c2000 <===== Trace; c01384f8 <__wait_on_buffer+78/a0> Trace; c016297c Trace; c016a73c Trace; c0139588 Trace; c016aba0 Trace; c0165171 Trace; c0160801 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c0160b88 Trace; c016b475 Trace; c013ea9f Trace; c0145190 Trace; c0145730 Trace; c014587a Trace; c0145730 Trace; c0106f03 Proc; amavisd >>EIP; c3b78000 <===== Trace; c011da54 Trace; c01e7fbf Trace; c0145f80 Trace; c0145c00 <__pollwait+0/c0> Trace; c014640a Trace; c0106f03 Proc; amavisd >>EIP; dc754000 <===== Trace; c0147640 Trace; c014769c Trace; c01479fb Trace; c014862d Trace; c0106f03 Proc; smbd >>EIP; d223c000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; sshd >>EIP; c3490000 <===== Trace; c011da54 Trace; c01e7fbf Trace; c0145f80 Trace; c0145c00 <__pollwait+0/c0> Trace; c014640a Trace; c01376f2 Trace; c0106f03 Proc; bash >>EIP; c296a000 <_end+2671c8c/2893c8c> <===== Trace; c0118f81 Trace; c0106f03 Proc; smbd >>EIP; de4c6000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; imapd >>EIP; d6da4000 <===== Trace; c011dad3 Trace; c011da30 Trace; c0145f80 Trace; c0145c00 <__pollwait+0/c0> Trace; c014640a Trace; c01376f2 Trace; c0106f03 Proc; sshd >>EIP; db582000 <===== Trace; c011da54 Trace; c01e7fbf Trace; c0145f80 Trace; c0145c00 <__pollwait+0/c0> Trace; c014640a Trace; c0183485 Trace; c0106f03 Proc; [] >>EIP; 00000032 Before first symbol <===== Trace; c0118f81 Trace; c0106f03 Proc; imapd >>EIP; d8bb6000 <===== Trace; c0105c7d <__down+5d/b0> Trace; c0140e2e Trace; c0105dd0 <__down_failed+8/c> Trace; c014434e <.text.lock.namei+ff/221> Trace; c0106f03 Proc; smbd >>EIP; d954c000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c0125fba Trace; c0140e2e Trace; c0141c9b Trace; c0141ee4 <__user_walk+24/40> Trace; c013ead4 Trace; c0106f03 Proc; smbstatus >>EIP; d16f4000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c016a05f Trace; c0165208 Trace; c01652b8 Trace; c0146d40 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c0127eef <__do_generic_file_read+49f/4b0> Trace; c012827c Trace; c0128140 Trace; c01375b6 Trace; c0140e2e Trace; c0137106 Trace; c0106f03 Proc; cyrus-master >>EIP; cf4c2000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c01419c1 Trace; c012827c Trace; c0128140 Trace; c0141c9b Trace; c013f206 Trace; c0157f0e Trace; c016b475 Trace; c01652c3 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c0127eef <__do_generic_file_read+49f/4b0> Trace; c0157c30 Trace; c013fa41 Trace; c013fccc Trace; c0140e2e Trace; c0105a20 Trace; c0106f03 Proc; bash >>EIP; dc376000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c01242dc Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c0127eef <__do_generic_file_read+49f/4b0> Trace; c0141a0e Trace; c012827c Trace; c0128140 Trace; c0136e8f Trace; c013f2ec Trace; c013f7f4 Trace; c013fc59 Trace; c0140e2e Trace; c0105a20 Trace; c0106f03 Proc; bash >>EIP; d66b0000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c0127eef <__do_generic_file_read+49f/4b0> Trace; c0141a0e Trace; c012827c Trace; c0128140 Trace; c0136e8f Trace; c013f2ec Trace; c013f7f4 Trace; c013fc59 Trace; c0140e2e Trace; c0105a20 Trace; c0106f03 Proc; sshd >>EIP; cbfc6000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 Trace; c01700d7 <__jbd_kmalloc+27/80> Trace; c0165208 Trace; c01652b8 Trace; c01281ab Trace; c014a6ce <__mark_inode_dirty+2e/90> Trace; c014bdd4 Trace; c0127eef <__do_generic_file_read+49f/4b0> Trace; c012827c Trace; c0128140 Trace; c01375b6 Trace; c0106f03 Proc; crond >>EIP; da1f4000 <===== Trace; c0112d8c Trace; c01150d3 Trace; c01059e8 Trace; c0106f03 Proc; crond >>EIP; dce5c000 <===== Trace; c016a981 Trace; c016aba0 Trace; c0165171 2 warnings issued. Results may not be reliable.