All of lore.kernel.org
 help / color / mirror / Atom feed
From: Tomasz Chmielewski <mangoo@wpkg.org>
To: Wang Shilong <wangshilong1991@gmail.com>
Cc: "linux-btrfs@vger.kernel.org" <linux-btrfs@vger.kernel.org>
Subject: Re: Heavy memory leak when using quota groups
Date: Tue, 6 Aug 2013 10:57:35 +0800	[thread overview]
Message-ID: <20130806105735.1f080598@wpkg.org> (raw)
In-Reply-To: <9CC83110-9578-4D32-ABA8-93B65205D6F8@gmail.com>

On Tue, 6 Aug 2013 07:29:03 +0800
Wang Shilong <wangshilong1991@gmail.com> wrote:

> Hello.
> 
> >> I am trying to use qgroups
> >> functionality & with a basic random-write workload, it constantly
> >> keeps leaking memory & within few minutes of IO, there is either
> >> out-of-memory killer trying to kill some tasks or there are
> >> page-allocation failures that btrfs or other kernel module
> >> experiences.
> > 
> > FYI, I just saw something similar with 3.10 on a server with 32 GB
> > RAM:
> 
> Would please show how many qgroups are there in the system.
> 
> btrfs qgroup show <mnt>

There are two different btrfs filesystems here; notice there are quite
a bit of qgroups with negative numbers.


# btrfs qgroup show /mnt/lxc1
0/258 2068160512 2068160512
0/1601 0 0
0/2359 1361963708416 1361963708416
0/3870 12996984832 4096
0/3871 12936032256 275820544
0/3872 40094982144 -3129344
0/3873 1238417408 -286720
0/3900 40061427712 2592768
0/3901 0 4096
0/3902 -4096 0
0/3903 895385600 4096
0/3904 -8192 -4096
0/3905 40075735040 3133440
0/3906 -4096 0
0/3908 891162624 114688
0/3909 40076042240 372736
0/3910 -4096 0
0/3911 891224064 139264
0/3912 40076103680 708608
0/3913 7718686720 4096
0/3918 7631826944 3203072
0/3922 891256832 278528
0/3923 5142913024 4096
0/3924 0 0
0/3928 4530425856 21856256
0/3973 891744256 4096
0/3974 854753280 4096
0/3975 41452056576 4096
0/3976 72792285184 4096
0/3977 43131879424 4096
0/3978 882757632 0
0/3980 882757632 0
0/3981 852537344 0
0/3983 2410848256 4096
0/3984 852537344 0
0/3985 109482221568 4096
0/3987 -4096 0
0/3989 34457268224 4096
0/3990 -4096 0
0/4005 2454089728 0
0/4009 2454089728 0
0/4014 10458886144 4096
0/4020 1543729152 4096
0/4022 1015640064 4096
0/4039 55234445312 4096
0/4059 1014833152 0
0/4061 1014833152 0
0/4074 1457680384 0
0/4077 1457680384 0
0/4083 24318590976 0
0/4087 24318590976 0
0/4162 10207858688 0
0/4164 10207858688 0
0/4243 1598795776 1347584
0/4245 1598795776 0
0/4277 43304882176 0
0/4280 43304882176 0
0/4328 0 0
0/4339 108909649920 0
0/4341 108909649920 0
0/4342 72641134592 0
0/4343 72641134592 0
0/4346 54204522496 0
0/4347 54204522496 0
0/4348 5137539072 2932736
0/4349 7714144256 729088
0/4350 894935040 618496
0/4351 12996780032 210608128
0/4352 40108421120 8347648
0/4353 41457135616 99024896
0/4354 852701184 17911808
0/4355 888950784 23416832
0/4356 72641462272 45056
0/4357 43208957952 54571008
0/4358 2400776192 41017344
0/4359 109428551680 117022720
0/4360 24396820480 11505664
0/4361 10275590144 12472320
0/4362 1543102464 22564864
0/4363 1014951936 425984
0/4364 54707920896 183185408
0/4365 5142007808 5021696
0/4366 7714271232 774144
0/4367 895250432 733184
0/4368 78995476480 4096
0/4369 12999450624 209784832
0/4370 40116916224 7626752
0/4371 41466302464 11272192
0/4372 853426176 18030592
0/4373 889573376 23425024
0/4374 72641757184 57344
0/4375 79529275392 1884889088
0/4376 43121913856 58900480
0/4377 2397597696 37494784
0/4378 109448671232 149102592
0/4379 24440803328 27103232
0/4380 10342871040 8065024
0/4381 1543413760 557056
0/4382 1015025664 466944
0/4383 54857736192 180170752
0/4384 77708091392 10326016
0/4385 5139664896 4096
0/4386 5139664896 4096
0/4387 7718678528 4096
0/4388 7718678528 4096
0/4389 895197184 4096
0/4390 895197184 4096
0/4391 12951941120 4096
0/4392 12951941120 4096
0/4393 40108793856 4096
0/4394 40108793856 4096
0/4396 41437810688 4096
0/4397 41437810688 4096
0/4398 854634496 4096
0/4399 854634496 4096
0/4400 890630144 4096
0/4401 890630144 4096
0/4402 72791916544 4096
0/4403 72791916544 4096
0/4404 43130384384 4096
0/4405 43130384384 4096
0/4406 2395500544 4096
0/4407 2395500544 4096
0/4408 109446926336 4096
0/4409 109446926336 4096
0/4410 24507891712 4096
0/4411 24507891712 4096
0/4412 10401660928 4096
0/4413 10401660928 4096
0/4414 1543028736 4096
0/4415 1543028736 4096
0/4416 1014980608 4096
0/4417 1014980608 4096
0/4418 54934056960 4096
0/4419 54934056960 4096
0/4420 5142913024 4096
0/4421 7718686720 4096
0/4422 895385600 4096
0/4423 12996984832 4096
0/4424 40112762880 4096
0/4425 41452056576 4096
0/4426 854753280 4096
0/4427 891744256 4096
0/4428 72792285184 4096
0/4429 43131879424 4096
0/4430 2410848256 4096
0/4431 109482221568 4096
0/4432 34457268224 4096
0/4433 10458886144 4096
0/4434 1543729152 4096
0/4435 1015640064 4096
0/4436 55234445312 4096
0/4437 78995476480 4096

# btrfs qgroup show /mnt/lxc2
0/260 161639960576 161639960576
0/261 181149696 181149696
0/262 155557888 1007616
0/377 180408320 25899008
0/378 336346464256 336346464256
0/535 572301312 417751040
0/536 70203207680 70203207680
0/642 247451648 92934144
0/1276 631365632 4096
0/1277 38598176768 0
0/1278 603922432 -12591104
0/1279 38268366848 -21348352
0/1284 38299160576 0
0/1285 38299160576 0
0/1286 607039488 -12697600
0/1287 620396544 241664
0/1293 38301650944 21417984
0/1294 623255552 13103104
0/1303 38449602560 10883072
0/1304 624873472 4096
0/1305 624873472 4096
0/1307 38449627136 106496
0/1319 38450397184 94208
0/1321 628367360 192512
0/1322 0 0
0/1323 0 0
0/1324 0 -1051197440
0/1325 1051197440 0
0/1326 1073741824 0
0/1331 38597541888 61440
0/1332 630042624 118784
0/1335 38598545408 4096
0/1336 38598545408 4096
0/1337 631840768 4096
0/1338 631840768 4096
1/1 375578464256 375578464256
2/1 -4096 22732800


-- 
Tomasz Chmielewski
http://wpkg.org

  reply	other threads:[~2013-08-06  2:57 UTC|newest]

Thread overview: 16+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-08-05 16:35 Heavy memory leak when using quota groups Tomasz Chmielewski
2013-08-05 23:29 ` Wang Shilong
2013-08-06  2:57   ` Tomasz Chmielewski [this message]
2013-08-06  5:24 ` Arne Jansen
2013-08-06 16:42   ` Tomasz Chmielewski
2013-08-07  8:00     ` Tomasz Chmielewski
2013-08-08  3:52       ` Jérôme Poulin
     [not found] <CAGEjNMfpTD3wMsagrFYinuJj0ieT8+g66uVz_hFpgp=1j4hYFQ@mail.gmail.com>
2013-02-12  7:31 ` shyam btrfs
2013-02-13  8:49   ` Arne Jansen
2013-02-13  9:10     ` shyam btrfs
2013-02-13  9:41   ` Arne Jansen
2013-02-13 11:22   ` Arne Jansen
2013-02-15  4:34     ` shyam btrfs
2013-02-27  7:42       ` Arne Jansen
2013-02-28 10:10         ` shyam btrfs
2013-02-13  8:40 ` Arne Jansen

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20130806105735.1f080598@wpkg.org \
    --to=mangoo@wpkg.org \
    --cc=linux-btrfs@vger.kernel.org \
    --cc=wangshilong1991@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.