Squid eating up all CPU

Squid eating up all CPU

[Raymond A. Meijer]

Hi,

I have an interesting problem. I've been running Squid for a long time now on 
my workstation with its cache directories on a Reiser4 partition.

Since Reiser4 has been stable for some time now, I decided to reformat my 
other partitions (except / which is Ext3) to Reiser4 as well.

Everything seems to work well, except..the Squid process is eating up all CPU:

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
 4787 proxy     39   0 45700  10m 2580 R 87.7  1.4   7:12.94 squid

This happens even when there are no connections made through Squid!

My machine is a Pentium4 1.8GHz with 768MB RAM and 2 WD 40GB HDDs.

It's running Debian Testing with the following Squid (related) packages 
installed:

ii  squid                         2.5.6-8
ii  squid-cgi                     2.5.6-8
ii  squid-common                  2.5.6-8
ii  squid-prefetch                0.7-1
ii  squidclient                   2.5.6-8
ii  adzapper                      20040408-1

Kernel 2.6.8.1-cko5 is being used.

I though I'd ask this list since Squid was working fine, with low CPU usage, 
for many months. I've rebooted the machine several times in the past (before 
converting the system partitions to Reiser4) and Squid never displayed this 
behaviour before.

I don't see anything relevant in the Squid log files or in the syslog.

Where do I start the troubleshooting process? Has anybody seen this before?
I'm willing to try anything to pinpoint the problem and make sure it's not 
Reiser4 causing it ;)

Please let me know what other information you'd need.


Thanks,

Ray

Re: Squid eating up all CPU

[Alex Zarochentsev]

Hello,

On Tue, Sep 07, 2004 at 03:28:06PM +0300, Raymond A. Meijer wrote:
> Hi,
> 
> I have an interesting problem. I've been running Squid for a long time now on 
> my workstation with its cache directories on a Reiser4 partition.
> 
> Since Reiser4 has been stable for some time now, I decided to reformat my 
> other partitions (except / which is Ext3) to Reiser4 as well.
> 
> Everything seems to work well, except..the Squid process is eating up all CPU:
> 
>   PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
>  4787 proxy     39   0 45700  10m 2580 R 87.7  1.4   7:12.94 squid
> 
> This happens even when there are no connections made through Squid!
> 
> My machine is a Pentium4 1.8GHz with 768MB RAM and 2 WD 40GB HDDs.
> 
> It's running Debian Testing with the following Squid (related) packages 
> installed:
> 
> ii  squid                         2.5.6-8
> ii  squid-cgi                     2.5.6-8
> ii  squid-common                  2.5.6-8
> ii  squid-prefetch                0.7-1
> ii  squidclient                   2.5.6-8
> ii  adzapper                      20040408-1
> 
> Kernel 2.6.8.1-cko5 is being used.
> 
> I though I'd ask this list since Squid was working fine, with low CPU usage, 
> for many months. I've rebooted the machine several times in the past (before 
> converting the system partitions to Reiser4) and Squid never displayed this 
> behaviour before.
> 
> I don't see anything relevant in the Squid log files or in the syslog.
> 
> Where do I start the troubleshooting process? Has anybody seen this before?
> I'm willing to try anything to pinpoint the problem and make sure it's not 
> Reiser4 causing it ;)
> 
> Please let me know what other information you'd need.

can you boot the kernel with profile=2 boot parameter and get profile info for
the period when nothing except squid is active?

echo 1 > /proc/profile
sleep 300
cat /proc/profile  | readprofile -m [<actual system map file> | sort -rn | head -n 20

I think reiser4 should be built not as a module otherwise System.map would not
contain reiser4 symbols.

> Thanks,
> Ray

-- 
Alex.

Re: Squid eating up all CPU

[Raymond A. Meijer]

On Tue 7 September 2004 15:52, Alex Zarochentsev wrote:

Hi Alex,

> > Everything seems to work well, except..the Squid process is eating up all CPU:
> > 
> >   PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
> >  4787 proxy     39   0 45700  10m 2580 R 87.7  1.4   7:12.94 squid

> can you boot the kernel with profile=2 boot parameter and get profile info for
> the period when nothing except squid is active?
> 
> echo 1 > /proc/profile
> sleep 300
> cat /proc/profile  | readprofile -m [<actual system map file> | sort -rn | head -n 20
> 
> I think reiser4 should be built not as a module otherwise System.map would not
> contain reiser4 symbols.

I don't think Reiser4 is at fault here:

I found out that the Weatherfox plugin for Firefox had caused Firefox to
crash, and therefore every time I started Firefox the Quality Feedback 
Agent tried to send a message.

For some reason that didn't work, and the following entries showed up in 
Squid's access.log after a LONG time:

1094561818.215 1041126 127.0.0.1 TCP_MISS/504 1467 POST http://talkback.mozilla.org/spiral-bin/Collector.dll - DIRECT/207.126.111.208 text/html
1094561860.054 1004601 127.0.0.1 TCP_MISS/504 1467 POST http://talkback.mozilla.org/spiral-bin/Collector.dll - DIRECT/207.126.111.208 text/html
1094561860.054 945630 127.0.0.1 TCP_MISS/504 1467 POST http://talkback.mozilla.org/spiral-bin/Collector.dll - DIRECT/207.126.111.208 text/html

Apparently the QFA continued to do this even after closing both its window
and Firefox, without any relevant processes showing up with ps..?!

Does this sound familiar?

After I uninstalled the Weatherfox extension the symptoms disappeared.

I'll try to reproduce it though..


Ray

Re: Squid eating up all CPU

[Alex Zarochentsev]

On Tue, Sep 07, 2004 at 04:50:46PM +0300, Raymond A. Meijer wrote:
> On Tue 7 September 2004 15:52, Alex Zarochentsev wrote:
> 
> Hi Alex,
> 
> > > Everything seems to work well, except..the Squid process is eating up all CPU:
> > > 
> > >   PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
> > >  4787 proxy     39   0 45700  10m 2580 R 87.7  1.4   7:12.94 squid
> 
> > can you boot the kernel with profile=2 boot parameter and get profile info for
> > the period when nothing except squid is active?
> > 
> > echo 1 > /proc/profile
> > sleep 300
> > cat /proc/profile  | readprofile -m [<actual system map file> | sort -rn | head -n 20
> > 
> > I think reiser4 should be built not as a module otherwise System.map would not
> > contain reiser4 symbols.
> 
> I don't think Reiser4 is at fault here:
> 
> I found out that the Weatherfox plugin for Firefox had caused Firefox to
> crash, and therefore every time I started Firefox the Quality Feedback 
> Agent tried to send a message.
> 
> For some reason that didn't work, and the following entries showed up in 
> Squid's access.log after a LONG time:
> 
> 1094561818.215 1041126 127.0.0.1 TCP_MISS/504 1467 POST http://talkback.mozilla.org/spiral-bin/Collector.dll - DIRECT/207.126.111.208 text/html
> 1094561860.054 1004601 127.0.0.1 TCP_MISS/504 1467 POST http://talkback.mozilla.org/spiral-bin/Collector.dll - DIRECT/207.126.111.208 text/html
> 1094561860.054 945630 127.0.0.1 TCP_MISS/504 1467 POST http://talkback.mozilla.org/spiral-bin/Collector.dll - DIRECT/207.126.111.208 text/html
> 
> Apparently the QFA continued to do this even after closing both its window
> and Firefox, without any relevant processes showing up with ps..?!
> 
> Does this sound familiar?

there should be the QFA process, I think. 

> 
> After I uninstalled the Weatherfox extension the symptoms disappeared.
> 
> I'll try to reproduce it though..
> 
> Ray

-- 
Alex.

Re: Squid eating up all CPU

[Raymond A. Meijer]

On Tue 7 September 2004 18:03, Alex Zarochentsev wrote:

> > Apparently the QFA continued to do this even after closing both its
> > window and Firefox, without any relevant processes showing up with ps..?!

> there should be the QFA process, I think.

I thought so too, but I really couldn't find anything with ps, netstat or 
lsof...

Anyway, I don't think the problem's with Reiser4, but rather with QFA or 
Squid. I'll try to reproduce it later.

On topic: my machine crashed hard several hours ago because its UPS suddenly 
died. I'm happy to report that my file systems didn't have a single error at 
all! (I rebooted with "init=/bin/bash" to check them before mounting them)


Thanks,

Ray

Re: Squid eating up all CPU

[Matthijs van der Vleuten]

On Tue, 7 Sep 2004 15:28:06 +0300, Raymond A. Meijer
<rmeijer@internet.gr> wrote:
> Hi,
> 
> I have an interesting problem. I've been running Squid for a long time now on
> my workstation with its cache directories on a Reiser4 partition.
> 
> Since Reiser4 has been stable for some time now, I decided to reformat my
> other partitions (except / which is Ext3) to Reiser4 as well.
> 
> Everything seems to work well, except..the Squid process is eating up all CPU:
> 
>   PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
>  4787 proxy     39   0 45700  10m 2580 R 87.7  1.4   7:12.94 squid
> 
> This happens even when there are no connections made through Squid!
> 
> [...]
> 
> Kernel 2.6.8.1-cko5 is being used.
> 
> I though I'd ask this list since Squid was working fine, with low CPU usage,
> for many months. I've rebooted the machine several times in the past (before
> converting the system partitions to Reiser4) and Squid never displayed this
> behaviour before.
> 
> [...]
> 
> Thanks,
> 
> Ray

Upgrade to 2.6.8.1-ck6. 2.6.8.1-ck5 has disk cache issues.

Re: Squid eating up all CPU

[Raymond A. Meijer]

On Thu 9 September 2004 20:01, Matthijs van der Vleuten wrote:


> > Everything seems to work well, except..the Squid process is eating up all
> > CPU:

> > Kernel 2.6.8.1-cko5 is being used.

> Upgrade to 2.6.8.1-ck6. 2.6.8.1-ck5 has disk cache issues.

I've upgraded to -ck7 now. Let's see what happens...

First impression: my machine seems to be running faster and more smoothly than 
with -cko5.


Thanks,

Ray