From: Wu Fengguang <wfg@linux.intel.com>
To: Eric Dumazet <eric.dumazet@gmail.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
LKML <linux-kernel@vger.kernel.org>, Jens Axboe <axboe@kernel.dk>,
Tejun Heo <tj@kernel.org>, Li Shaohua <shaohua.li@intel.com>,
Herbert Poetzl <herbert@13thfloor.at>
Subject: Re: Bad SSD performance with recent kernels
Date: Mon, 30 Jan 2012 22:01:09 +0800 [thread overview]
Message-ID: <20120130140109.GA15682@localhost> (raw)
In-Reply-To: <1327926896.2288.34.camel@edumazet-HP-Compaq-6005-Pro-SFF-PC>
On Mon, Jan 30, 2012 at 01:34:56PM +0100, Eric Dumazet wrote:
> Le lundi 30 janvier 2012 à 19:18 +0800, Wu Fengguang a écrit :
>
> > I agree with Shaohua that there may be timing/plug issues. There
> > happen to be some plug patches and (maybe correlated) big performance
> > drop between 2.6.38 and 2.6.39. The obvious way to move forward is to
> > get some blktrace data on simple dd + new buggy kernel and let's check
> > what's exactly going on.
> >
> > # start a background dd read
> > blktrace /dev/sda -w 10
> > blkparse -t sda
> >
>
> (Another machine here at office, hence /dev/sdb)
>
> echo 3 >/proc/sys/vm/drop_caches ;dd if=/dev/sdb of=/dev/null bs=2M
> count=2048
> 2048+0 enregistrements lus
> 2048+0 enregistrements écrits
> 4294967296 octets (4,3 GB) copiés, 26,0278 s, 165 MB/s
>
> # blktrace /dev/sdb -w 10
> === sdb ===
> CPU 0: 44766 events, 2099 KiB data
> CPU 1: 828895 events, 38855 KiB data
> Total: 873661 events (dropped 0), 40953 KiB data
>
> blkparse result is huge (55Mo)
>
> # blkparse -t sdb | tail -n 1000
Thanks for the data!
It shows that
- IO size is 256KB (which is not a problem in itself)
- The dispatch/complete pattern is
submit IO for range 1
complete IO for range 1
<dd busy, disk idle>
submit IO for range 2
complete IO for range 2
So we have periods that no IO is in flight at all, which leads to
under-utilized disk (which should show up in iostat as <100% disk util)
# grep '[DC]' blktrace
8,16 1 770606 9.990039807 4580 D R 4379392 + 512 ( 14826) [dd]
8,16 1 770607 9.991083069 0 C R 4379392 + 512 ( 1043262) [0]
8,16 1 770739 9.991647434 4580 D R 4379904 + 512 ( 14433) [dd]
8,16 1 770740 9.992693317 0 C R 4379904 + 512 ( 1045883) [0]
8,16 1 770872 9.993256451 4580 D R 4380416 + 512 ( 14539) [dd]
8,16 1 770873 9.994299156 0 C R 4380416 + 512 ( 1042705) [0]
8,16 1 771005 9.994863680 4580 D R 4380928 + 512 ( 14344) [dd]
8,16 1 771006 9.995909291 0 C R 4380928 + 512 ( 1045611) [0]
8,16 1 771138 9.996470460 4580 D R 4381440 + 512 ( 14043) [dd]
8,16 1 771139 9.997514205 0 C R 4381440 + 512 ( 1043745) [0]
8,16 1 771271 9.998077269 4580 D R 4381952 + 512 ( 14928) [dd]
8,16 1 771272 9.999120396 0 C R 4381952 + 512 ( 1043127) [0]
Thanks,
Fengguang
> 8,16 1 770475 9.989714963 4580 Q R 4379392 + 8 [dd]
> 8,16 1 770476 9.989721470 4580 G R 4379392 + 8 [dd]
> 8,16 1 770477 9.989723546 4580 P N [dd]
> 8,16 1 770478 9.989726994 4580 Q R 4379400 + 8 [dd]
> 8,16 1 770479 9.989728858 4580 M R 4379400 + 8 [dd]
> 8,16 1 770480 9.989731893 4580 Q R 4379408 + 8 [dd]
> 8,16 1 770481 9.989732467 4580 M R 4379408 + 8 [dd]
> 8,16 1 770482 9.989734574 4580 Q R 4379416 + 8 [dd]
> 8,16 1 770483 9.989735108 4580 M R 4379416 + 8 [dd]
> 8,16 1 770484 9.989737220 4580 Q R 4379424 + 8 [dd]
> 8,16 1 770485 9.989737721 4580 M R 4379424 + 8 [dd]
> 8,16 1 770486 9.989739953 4580 Q R 4379432 + 8 [dd]
> 8,16 1 770487 9.989740450 4580 M R 4379432 + 8 [dd]
> 8,16 1 770488 9.989742577 4580 Q R 4379440 + 8 [dd]
> 8,16 1 770489 9.989743078 4580 M R 4379440 + 8 [dd]
> 8,16 1 770490 9.989745241 4580 Q R 4379448 + 8 [dd]
> 8,16 1 770491 9.989745742 4580 M R 4379448 + 8 [dd]
> 8,16 1 770492 9.989747953 4580 Q R 4379456 + 8 [dd]
> 8,16 1 770493 9.989748485 4580 M R 4379456 + 8 [dd]
> 8,16 1 770494 9.989750726 4580 Q R 4379464 + 8 [dd]
> 8,16 1 770495 9.989751225 4580 M R 4379464 + 8 [dd]
> 8,16 1 770496 9.989753390 4580 Q R 4379472 + 8 [dd]
> 8,16 1 770497 9.989753891 4580 M R 4379472 + 8 [dd]
> 8,16 1 770498 9.989755928 4580 Q R 4379480 + 8 [dd]
> 8,16 1 770499 9.989756429 4580 M R 4379480 + 8 [dd]
> 8,16 1 770500 9.989758470 4580 Q R 4379488 + 8 [dd]
> 8,16 1 770501 9.989758975 4580 M R 4379488 + 8 [dd]
> 8,16 1 770502 9.989765725 4580 Q R 4379496 + 8 [dd]
> 8,16 1 770503 9.989766222 4580 M R 4379496 + 8 [dd]
> 8,16 1 770504 9.989768362 4580 Q R 4379504 + 8 [dd]
> 8,16 1 770505 9.989768864 4580 M R 4379504 + 8 [dd]
> 8,16 1 770506 9.989771157 4580 Q R 4379512 + 8 [dd]
> 8,16 1 770507 9.989771662 4580 M R 4379512 + 8 [dd]
> 8,16 1 770508 9.989775151 4580 Q R 4379520 + 8 [dd]
> 8,16 1 770509 9.989775649 4580 M R 4379520 + 8 [dd]
> 8,16 1 770510 9.989781743 4580 Q R 4379528 + 8 [dd]
> 8,16 1 770511 9.989782248 4580 M R 4379528 + 8 [dd]
> 8,16 1 770512 9.989784532 4580 Q R 4379536 + 8 [dd]
> 8,16 1 770513 9.989785033 4580 M R 4379536 + 8 [dd]
> 8,16 1 770514 9.989787291 4580 Q R 4379544 + 8 [dd]
> 8,16 1 770515 9.989787792 4580 M R 4379544 + 8 [dd]
> 8,16 1 770516 9.989790041 4580 Q R 4379552 + 8 [dd]
> 8,16 1 770517 9.989790540 4580 M R 4379552 + 8 [dd]
> 8,16 1 770518 9.989792607 4580 Q R 4379560 + 8 [dd]
> 8,16 1 770519 9.989793104 4580 M R 4379560 + 8 [dd]
> 8,16 1 770520 9.989795693 4580 Q R 4379568 + 8 [dd]
> 8,16 1 770521 9.989796191 4580 M R 4379568 + 8 [dd]
> 8,16 1 770522 9.989798349 4580 Q R 4379576 + 8 [dd]
> 8,16 1 770523 9.989798847 4580 M R 4379576 + 8 [dd]
> 8,16 1 770524 9.989800877 4580 Q R 4379584 + 8 [dd]
> 8,16 1 770525 9.989801581 4580 M R 4379584 + 8 [dd]
> 8,16 1 770526 9.989803693 4580 Q R 4379592 + 8 [dd]
> 8,16 1 770527 9.989804221 4580 M R 4379592 + 8 [dd]
> 8,16 1 770528 9.989806399 4580 Q R 4379600 + 8 [dd]
> 8,16 1 770529 9.989806901 4580 M R 4379600 + 8 [dd]
> 8,16 1 770530 9.989812437 4580 Q R 4379608 + 8 [dd]
> 8,16 1 770531 9.989812938 4580 M R 4379608 + 8 [dd]
> 8,16 1 770532 9.989814981 4580 Q R 4379616 + 8 [dd]
> 8,16 1 770533 9.989815482 4580 M R 4379616 + 8 [dd]
> 8,16 1 770534 9.989818053 4580 Q R 4379624 + 8 [dd]
> 8,16 1 770535 9.989818551 4580 M R 4379624 + 8 [dd]
> 8,16 1 770536 9.989820795 4580 Q R 4379632 + 8 [dd]
> 8,16 1 770537 9.989821296 4580 M R 4379632 + 8 [dd]
> 8,16 1 770538 9.989823436 4580 Q R 4379640 + 8 [dd]
> 8,16 1 770539 9.989823937 4580 M R 4379640 + 8 [dd]
> 8,16 1 770540 9.989929502 4580 Q R 4379648 + 8 [dd]
> 8,16 1 770541 9.989930247 4580 M R 4379648 + 8 [dd]
> 8,16 1 770542 9.989933189 4580 Q R 4379656 + 8 [dd]
> 8,16 1 770543 9.989933705 4580 M R 4379656 + 8 [dd]
> 8,16 1 770544 9.989935909 4580 Q R 4379664 + 8 [dd]
> 8,16 1 770545 9.989936411 4580 M R 4379664 + 8 [dd]
> 8,16 1 770546 9.989938572 4580 Q R 4379672 + 8 [dd]
> 8,16 1 770547 9.989939072 4580 M R 4379672 + 8 [dd]
> 8,16 1 770548 9.989941272 4580 Q R 4379680 + 8 [dd]
> 8,16 1 770549 9.989941770 4580 M R 4379680 + 8 [dd]
> 8,16 1 770550 9.989943952 4580 Q R 4379688 + 8 [dd]
> 8,16 1 770551 9.989944450 4580 M R 4379688 + 8 [dd]
> 8,16 1 770552 9.989946991 4580 Q R 4379696 + 8 [dd]
> 8,16 1 770553 9.989947492 4580 M R 4379696 + 8 [dd]
> 8,16 1 770554 9.989949671 4580 Q R 4379704 + 8 [dd]
> 8,16 1 770555 9.989950172 4580 M R 4379704 + 8 [dd]
> 8,16 1 770556 9.989952330 4580 Q R 4379712 + 8 [dd]
> 8,16 1 770557 9.989952832 4580 M R 4379712 + 8 [dd]
> 8,16 1 770558 9.989958393 4580 Q R 4379720 + 8 [dd]
> 8,16 1 770559 9.989958891 4580 M R 4379720 + 8 [dd]
> 8,16 1 770560 9.989961097 4580 Q R 4379728 + 8 [dd]
> 8,16 1 770561 9.989961598 4580 M R 4379728 + 8 [dd]
> 8,16 1 770562 9.989963825 4580 Q R 4379736 + 8 [dd]
> 8,16 1 770563 9.989964331 4580 M R 4379736 + 8 [dd]
> 8,16 1 770564 9.989966623 4580 Q R 4379744 + 8 [dd]
> 8,16 1 770565 9.989967122 4580 M R 4379744 + 8 [dd]
> 8,16 1 770566 9.989969303 4580 Q R 4379752 + 8 [dd]
> 8,16 1 770567 9.989969800 4580 M R 4379752 + 8 [dd]
> 8,16 1 770568 9.989971886 4580 Q R 4379760 + 8 [dd]
> 8,16 1 770569 9.989972388 4580 M R 4379760 + 8 [dd]
> 8,16 1 770570 9.989974789 4580 Q R 4379768 + 8 [dd]
> 8,16 1 770571 9.989975290 4580 M R 4379768 + 8 [dd]
> 8,16 1 770572 9.989977480 4580 Q R 4379776 + 8 [dd]
> 8,16 1 770573 9.989977981 4580 M R 4379776 + 8 [dd]
> 8,16 1 770574 9.989981251 4580 Q R 4379784 + 8 [dd]
> 8,16 1 770575 9.989981749 4580 M R 4379784 + 8 [dd]
> 8,16 1 770576 9.989984018 4580 Q R 4379792 + 8 [dd]
> 8,16 1 770577 9.989984519 4580 M R 4379792 + 8 [dd]
> 8,16 1 770578 9.989986711 4580 Q R 4379800 + 8 [dd]
> 8,16 1 770579 9.989987222 4580 M R 4379800 + 8 [dd]
> 8,16 1 770580 9.989989414 4580 Q R 4379808 + 8 [dd]
> 8,16 1 770581 9.989989915 4580 M R 4379808 + 8 [dd]
> 8,16 1 770582 9.989992107 4580 Q R 4379816 + 8 [dd]
> 8,16 1 770583 9.989992617 4580 M R 4379816 + 8 [dd]
> 8,16 1 770584 9.989994776 4580 Q R 4379824 + 8 [dd]
> 8,16 1 770585 9.989995276 4580 M R 4379824 + 8 [dd]
> 8,16 1 770586 9.990000570 4580 Q R 4379832 + 8 [dd]
> 8,16 1 770587 9.990001076 4580 M R 4379832 + 8 [dd]
> 8,16 1 770588 9.990003264 4580 Q R 4379840 + 8 [dd]
> 8,16 1 770589 9.990003785 4580 M R 4379840 + 8 [dd]
> 8,16 1 770590 9.990005849 4580 Q R 4379848 + 8 [dd]
> 8,16 1 770591 9.990006354 4580 M R 4379848 + 8 [dd]
> 8,16 1 770592 9.990008472 4580 Q R 4379856 + 8 [dd]
> 8,16 1 770593 9.990008986 4580 M R 4379856 + 8 [dd]
> 8,16 1 770594 9.990011382 4580 Q R 4379864 + 8 [dd]
> 8,16 1 770595 9.990011884 4580 M R 4379864 + 8 [dd]
> 8,16 1 770596 9.990014066 4580 Q R 4379872 + 8 [dd]
> 8,16 1 770597 9.990014568 4580 M R 4379872 + 8 [dd]
> 8,16 1 770598 9.990016740 4580 Q R 4379880 + 8 [dd]
> 8,16 1 770599 9.990017237 4580 M R 4379880 + 8 [dd]
> 8,16 1 770600 9.990019491 4580 Q R 4379888 + 8 [dd]
> 8,16 1 770601 9.990020001 4580 M R 4379888 + 8 [dd]
> 8,16 1 770602 9.990022222 4580 Q R 4379896 + 8 [dd]
> 8,16 1 770603 9.990022723 4580 M R 4379896 + 8 [dd]
> 8,16 1 770604 9.990024981 4580 I R 4379392 + 512 ( 303511) [dd]
> 8,16 1 0 9.990027734 0 m N cfq4580S / insert_request
> 8,16 1 770605 9.990031216 4580 U N [dd] 1
> 8,16 1 0 9.990033792 0 m N cfq4580S / dispatch_insert
> 8,16 1 0 9.990037429 0 m N cfq4580S / dispatched a request
> 8,16 1 0 9.990039146 0 m N cfq4580S / activate rq, drv=1
> 8,16 1 770606 9.990039807 4580 D R 4379392 + 512 ( 14826) [dd]
> 8,16 1 770607 9.991083069 0 C R 4379392 + 512 ( 1043262) [0]
> 8,16 1 0 9.991155388 0 m N cfq4580S / complete rqnoidle 0
> 8,16 1 0 9.991158292 0 m N cfq schedule dispatch
> 8,16 1 770608 9.991321889 4580 Q R 4379904 + 8 [dd]
> 8,16 1 770609 9.991328302 4580 G R 4379904 + 8 [dd]
> 8,16 1 770610 9.991330287 4580 P N [dd]
> 8,16 1 770611 9.991333624 4580 Q R 4379912 + 8 [dd]
> 8,16 1 770612 9.991335576 4580 M R 4379912 + 8 [dd]
> 8,16 1 770613 9.991338586 4580 Q R 4379920 + 8 [dd]
> 8,16 1 770614 9.991339095 4580 M R 4379920 + 8 [dd]
> 8,16 1 770615 9.991341209 4580 Q R 4379928 + 8 [dd]
> 8,16 1 770616 9.991341909 4580 M R 4379928 + 8 [dd]
> 8,16 1 770617 9.991344208 4580 Q R 4379936 + 8 [dd]
> 8,16 1 770618 9.991344707 4580 M R 4379936 + 8 [dd]
> 8,16 1 770619 9.991351891 4580 Q R 4379944 + 8 [dd]
> 8,16 1 770620 9.991352393 4580 M R 4379944 + 8 [dd]
> 8,16 1 770621 9.991354635 4580 Q R 4379952 + 8 [dd]
> 8,16 1 770622 9.991355134 4580 M R 4379952 + 8 [dd]
> 8,16 1 770623 9.991357304 4580 Q R 4379960 + 8 [dd]
> 8,16 1 770624 9.991357809 4580 M R 4379960 + 8 [dd]
> 8,16 1 770625 9.991359960 4580 Q R 4379968 + 8 [dd]
> 8,16 1 770626 9.991360458 4580 M R 4379968 + 8 [dd]
> 8,16 1 770627 9.991362540 4580 Q R 4379976 + 8 [dd]
> 8,16 1 770628 9.991363044 4580 M R 4379976 + 8 [dd]
> 8,16 1 770629 9.991366526 4580 Q R 4379984 + 8 [dd]
> 8,16 1 770630 9.991367025 4580 M R 4379984 + 8 [dd]
> 8,16 1 770631 9.991369183 4580 Q R 4379992 + 8 [dd]
> 8,16 1 770632 9.991369681 4580 M R 4379992 + 8 [dd]
> 8,16 1 770633 9.991371837 4580 Q R 4380000 + 8 [dd]
> 8,16 1 770634 9.991372336 4580 M R 4380000 + 8 [dd]
> 8,16 1 770635 9.991374518 4580 Q R 4380008 + 8 [dd]
> 8,16 1 770636 9.991375031 4580 M R 4380008 + 8 [dd]
> 8,16 1 770637 9.991377249 4580 Q R 4380016 + 8 [dd]
> 8,16 1 770638 9.991377748 4580 M R 4380016 + 8 [dd]
> 8,16 1 770639 9.991379891 4580 Q R 4380024 + 8 [dd]
> 8,16 1 770640 9.991380390 4580 M R 4380024 + 8 [dd]
> 8,16 1 770641 9.991382585 4580 Q R 4380032 + 8 [dd]
> 8,16 1 770642 9.991383084 4580 M R 4380032 + 8 [dd]
> 8,16 1 770643 9.991385207 4580 Q R 4380040 + 8 [dd]
> 8,16 1 770644 9.991385704 4580 M R 4380040 + 8 [dd]
> 8,16 1 770645 9.991387897 4580 Q R 4380048 + 8 [dd]
> 8,16 1 770646 9.991388396 4580 M R 4380048 + 8 [dd]
> 8,16 1 770647 9.991393804 4580 Q R 4380056 + 8 [dd]
> 8,16 1 770648 9.991394303 4580 M R 4380056 + 8 [dd]
> 8,16 1 770649 9.991396440 4580 Q R 4380064 + 8 [dd]
> 8,16 1 770650 9.991396938 4580 M R 4380064 + 8 [dd]
> 8,16 1 770651 9.991398996 4580 Q R 4380072 + 8 [dd]
> 8,16 1 770652 9.991399500 4580 M R 4380072 + 8 [dd]
> 8,16 1 770653 9.991401608 4580 Q R 4380080 + 8 [dd]
> 8,16 1 770654 9.991402107 4580 M R 4380080 + 8 [dd]
> 8,16 1 770655 9.991404535 4580 Q R 4380088 + 8 [dd]
> 8,16 1 770656 9.991405034 4580 M R 4380088 + 8 [dd]
> 8,16 1 770657 9.991407171 4580 Q R 4380096 + 8 [dd]
> 8,16 1 770658 9.991407671 4580 M R 4380096 + 8 [dd]
> 8,16 1 770659 9.991409829 4580 Q R 4380104 + 8 [dd]
> 8,16 1 770660 9.991410339 4580 M R 4380104 + 8 [dd]
> 8,16 1 770661 9.991416346 4580 Q R 4380112 + 8 [dd]
> 8,16 1 770662 9.991416853 4580 M R 4380112 + 8 [dd]
> 8,16 1 770663 9.991419016 4580 Q R 4380120 + 8 [dd]
> 8,16 1 770664 9.991419515 4580 M R 4380120 + 8 [dd]
> 8,16 1 770665 9.991421984 4580 Q R 4380128 + 8 [dd]
> 8,16 1 770666 9.991422483 4580 M R 4380128 + 8 [dd]
> 8,16 1 770667 9.991424780 4580 Q R 4380136 + 8 [dd]
> 8,16 1 770668 9.991425284 4580 M R 4380136 + 8 [dd]
> 8,16 1 770669 9.991427479 4580 Q R 4380144 + 8 [dd]
> 8,16 1 770670 9.991427978 4580 M R 4380144 + 8 [dd]
> 8,16 1 770671 9.991430076 4580 Q R 4380152 + 8 [dd]
> 8,16 1 770672 9.991430575 4580 M R 4380152 + 8 [dd]
> 8,16 1 770673 9.991536122 4580 Q R 4380160 + 8 [dd]
> 8,16 1 770674 9.991536827 4580 M R 4380160 + 8 [dd]
> 8,16 1 770675 9.991543663 4580 Q R 4380168 + 8 [dd]
> 8,16 1 770676 9.991544181 4580 M R 4380168 + 8 [dd]
> 8,16 1 770677 9.991546458 4580 Q R 4380176 + 8 [dd]
> 8,16 1 770678 9.991546957 4580 M R 4380176 + 8 [dd]
> 8,16 1 770679 9.991549153 4580 Q R 4380184 + 8 [dd]
> 8,16 1 770680 9.991549652 4580 M R 4380184 + 8 [dd]
> 8,16 1 770681 9.991551902 4580 Q R 4380192 + 8 [dd]
> 8,16 1 770682 9.991552400 4580 M R 4380192 + 8 [dd]
> 8,16 1 770683 9.991554621 4580 Q R 4380200 + 8 [dd]
> 8,16 1 770684 9.991555113 4580 M R 4380200 + 8 [dd]
> 8,16 1 770685 9.991557325 4580 Q R 4380208 + 8 [dd]
> 8,16 1 770686 9.991557824 4580 M R 4380208 + 8 [dd]
> 8,16 1 770687 9.991560192 4580 Q R 4380216 + 8 [dd]
> 8,16 1 770688 9.991560732 4580 M R 4380216 + 8 [dd]
> 8,16 1 770689 9.991562806 4580 Q R 4380224 + 8 [dd]
> 8,16 1 770690 9.991563305 4580 M R 4380224 + 8 [dd]
> 8,16 1 770691 9.991565370 4580 Q R 4380232 + 8 [dd]
> 8,16 1 770692 9.991565874 4580 M R 4380232 + 8 [dd]
> 8,16 1 770693 9.991567969 4580 Q R 4380240 + 8 [dd]
> 8,16 1 770694 9.991568468 4580 M R 4380240 + 8 [dd]
> 8,16 1 770695 9.991570671 4580 Q R 4380248 + 8 [dd]
> 8,16 1 770696 9.991571170 4580 M R 4380248 + 8 [dd]
> 8,16 1 770697 9.991573285 4580 Q R 4380256 + 8 [dd]
> 8,16 1 770698 9.991573783 4580 M R 4380256 + 8 [dd]
> 8,16 1 770699 9.991575855 4580 Q R 4380264 + 8 [dd]
> 8,16 1 770700 9.991576358 4580 M R 4380264 + 8 [dd]
> 8,16 1 770701 9.991578551 4580 Q R 4380272 + 8 [dd]
> 8,16 1 770702 9.991579050 4580 M R 4380272 + 8 [dd]
> 8,16 1 770703 9.991584418 4580 Q R 4380280 + 8 [dd]
> 8,16 1 770704 9.991584916 4580 M R 4380280 + 8 [dd]
> 8,16 1 770705 9.991587004 4580 Q R 4380288 + 8 [dd]
> 8,16 1 770706 9.991587503 4580 M R 4380288 + 8 [dd]
> 8,16 1 770707 9.991589615 4580 Q R 4380296 + 8 [dd]
> 8,16 1 770708 9.991590128 4580 M R 4380296 + 8 [dd]
> 8,16 1 770709 9.991592390 4580 Q R 4380304 + 8 [dd]
> 8,16 1 770710 9.991592907 4580 M R 4380304 + 8 [dd]
> 8,16 1 770711 9.991594957 4580 Q R 4380312 + 8 [dd]
> 8,16 1 770712 9.991595456 4580 M R 4380312 + 8 [dd]
> 8,16 1 770713 9.991597599 4580 Q R 4380320 + 8 [dd]
> 8,16 1 770714 9.991598098 4580 M R 4380320 + 8 [dd]
> 8,16 1 770715 9.991600165 4580 Q R 4380328 + 8 [dd]
> 8,16 1 770716 9.991600669 4580 M R 4380328 + 8 [dd]
> 8,16 1 770717 9.991602915 4580 Q R 4380336 + 8 [dd]
> 8,16 1 770718 9.991603413 4580 M R 4380336 + 8 [dd]
> 8,16 1 770719 9.991605563 4580 Q R 4380344 + 8 [dd]
> 8,16 1 770720 9.991606061 4580 M R 4380344 + 8 [dd]
> 8,16 1 770721 9.991608110 4580 Q R 4380352 + 8 [dd]
> 8,16 1 770722 9.991608609 4580 M R 4380352 + 8 [dd]
> 8,16 1 770723 9.991610674 4580 Q R 4380360 + 8 [dd]
> 8,16 1 770724 9.991611178 4580 M R 4380360 + 8 [dd]
> 8,16 1 770725 9.991613249 4580 Q R 4380368 + 8 [dd]
> 8,16 1 770726 9.991613748 4580 M R 4380368 + 8 [dd]
> 8,16 1 770727 9.991616309 4580 Q R 4380376 + 8 [dd]
> 8,16 1 770728 9.991616808 4580 M R 4380376 + 8 [dd]
> 8,16 1 770729 9.991619009 4580 Q R 4380384 + 8 [dd]
> 8,16 1 770730 9.991619507 4580 M R 4380384 + 8 [dd]
> 8,16 1 770731 9.991624896 4580 Q R 4380392 + 8 [dd]
> 8,16 1 770732 9.991625401 4580 M R 4380392 + 8 [dd]
> 8,16 1 770733 9.991627620 4580 Q R 4380400 + 8 [dd]
> 8,16 1 770734 9.991628119 4580 M R 4380400 + 8 [dd]
> 8,16 1 770735 9.991630192 4580 Q R 4380408 + 8 [dd]
> 8,16 1 770736 9.991630690 4580 M R 4380408 + 8 [dd]
> 8,16 1 770737 9.991633001 4580 I R 4379904 + 512 ( 304699) [dd]
> 8,16 1 0 9.991635738 0 m N cfq4580S / insert_request
> 8,16 1 770738 9.991638988 4580 U N [dd] 1
> 8,16 1 0 9.991641665 0 m N cfq4580S / dispatch_insert
> 8,16 1 0 9.991645149 0 m N cfq4580S / dispatched a request
> 8,16 1 0 9.991646825 0 m N cfq4580S / activate rq, drv=1
> 8,16 1 770739 9.991647434 4580 D R 4379904 + 512 ( 14433) [dd]
> 8,16 1 770740 9.992693317 0 C R 4379904 + 512 ( 1045883) [0]
> 8,16 1 0 9.992766012 0 m N cfq4580S / complete rqnoidle 0
> 8,16 1 0 9.992768895 0 m N cfq schedule dispatch
> 8,16 1 770741 9.992932816 4580 Q R 4380416 + 8 [dd]
> 8,16 1 770742 9.992939152 4580 G R 4380416 + 8 [dd]
> 8,16 1 770743 9.992941241 4580 P N [dd]
> 8,16 1 770744 9.992944673 4580 Q R 4380424 + 8 [dd]
> 8,16 1 770745 9.992946529 4580 M R 4380424 + 8 [dd]
> 8,16 1 770746 9.992949525 4580 Q R 4380432 + 8 [dd]
> 8,16 1 770747 9.992950035 4580 M R 4380432 + 8 [dd]
> 8,16 1 770748 9.992952218 4580 Q R 4380440 + 8 [dd]
> 8,16 1 770749 9.992952765 4580 M R 4380440 + 8 [dd]
> 8,16 1 770750 9.992954867 4580 Q R 4380448 + 8 [dd]
> 8,16 1 770751 9.992955366 4580 M R 4380448 + 8 [dd]
> 8,16 1 770752 9.992957451 4580 Q R 4380456 + 8 [dd]
> 8,16 1 770753 9.992957956 4580 M R 4380456 + 8 [dd]
> 8,16 1 770754 9.992960073 4580 Q R 4380464 + 8 [dd]
> 8,16 1 770755 9.992960572 4580 M R 4380464 + 8 [dd]
> 8,16 1 770756 9.992962600 4580 Q R 4380472 + 8 [dd]
> 8,16 1 770757 9.992963104 4580 M R 4380472 + 8 [dd]
> 8,16 1 770758 9.992965247 4580 Q R 4380480 + 8 [dd]
> 8,16 1 770759 9.992965753 4580 M R 4380480 + 8 [dd]
> 8,16 1 770760 9.992967787 4580 Q R 4380488 + 8 [dd]
> 8,16 1 770761 9.992968284 4580 M R 4380488 + 8 [dd]
> 8,16 1 770762 9.992970602 4580 Q R 4380496 + 8 [dd]
> 8,16 1 770763 9.992971101 4580 M R 4380496 + 8 [dd]
> 8,16 1 770764 9.992978036 4580 Q R 4380504 + 8 [dd]
> 8,16 1 770765 9.992978575 4580 M R 4380504 + 8 [dd]
> 8,16 1 770766 9.992980800 4580 Q R 4380512 + 8 [dd]
> 8,16 1 770767 9.992981312 4580 M R 4380512 + 8 [dd]
> 8,16 1 770768 9.992983463 4580 Q R 4380520 + 8 [dd]
> 8,16 1 770769 9.992983976 4580 M R 4380520 + 8 [dd]
> 8,16 1 770770 9.992986141 4580 Q R 4380528 + 8 [dd]
> 8,16 1 770771 9.992986652 4580 M R 4380528 + 8 [dd]
> 8,16 1 770772 9.992988835 4580 Q R 4380536 + 8 [dd]
> 8,16 1 770773 9.992989338 4580 M R 4380536 + 8 [dd]
> 8,16 1 770774 9.992991462 4580 Q R 4380544 + 8 [dd]
> 8,16 1 770775 9.992991961 4580 M R 4380544 + 8 [dd]
> 8,16 1 770776 9.992994020 4580 Q R 4380552 + 8 [dd]
> 8,16 1 770777 9.992994519 4580 M R 4380552 + 8 [dd]
> 8,16 1 770778 9.992996632 4580 Q R 4380560 + 8 [dd]
> 8,16 1 770779 9.992997135 4580 M R 4380560 + 8 [dd]
> 8,16 1 770780 9.992999236 4580 Q R 4380568 + 8 [dd]
> 8,16 1 770781 9.992999742 4580 M R 4380568 + 8 [dd]
> 8,16 1 770782 9.993001890 4580 Q R 4380576 + 8 [dd]
> 8,16 1 770783 9.993002389 4580 M R 4380576 + 8 [dd]
> 8,16 1 770784 9.993004438 4580 Q R 4380584 + 8 [dd]
> 8,16 1 770785 9.993004937 4580 M R 4380584 + 8 [dd]
> 8,16 1 770786 9.993007255 4580 Q R 4380592 + 8 [dd]
> 8,16 1 770787 9.993007754 4580 M R 4380592 + 8 [dd]
> 8,16 1 770788 9.993009828 4580 Q R 4380600 + 8 [dd]
> 8,16 1 770789 9.993010351 4580 M R 4380600 + 8 [dd]
> 8,16 1 770790 9.993012459 4580 Q R 4380608 + 8 [dd]
> 8,16 1 770791 9.993012958 4580 M R 4380608 + 8 [dd]
> 8,16 1 770792 9.993019700 4580 Q R 4380616 + 8 [dd]
> 8,16 1 770793 9.993020199 4580 M R 4380616 + 8 [dd]
> 8,16 1 770794 9.993022401 4580 Q R 4380624 + 8 [dd]
> 8,16 1 770795 9.993022909 4580 M R 4380624 + 8 [dd]
> 8,16 1 770796 9.993024945 4580 Q R 4380632 + 8 [dd]
> 8,16 1 770797 9.993025449 4580 M R 4380632 + 8 [dd]
> 8,16 1 770798 9.993027501 4580 Q R 4380640 + 8 [dd]
> 8,16 1 770799 9.993027999 4580 M R 4380640 + 8 [dd]
> 8,16 1 770800 9.993030163 4580 Q R 4380648 + 8 [dd]
> 8,16 1 770801 9.993030666 4580 M R 4380648 + 8 [dd]
> 8,16 1 770802 9.993033040 4580 Q R 4380656 + 8 [dd]
> 8,16 1 770803 9.993033538 4580 M R 4380656 + 8 [dd]
> 8,16 1 770804 9.993035704 4580 Q R 4380664 + 8 [dd]
> 8,16 1 770805 9.993036205 4580 M R 4380664 + 8 [dd]
> 8,16 1 770806 9.993143012 4580 Q R 4380672 + 8 [dd]
> 8,16 1 770807 9.993143745 4580 M R 4380672 + 8 [dd]
> 8,16 1 770808 9.993147049 4580 Q R 4380680 + 8 [dd]
> 8,16 1 770809 9.993147550 4580 M R 4380680 + 8 [dd]
> 8,16 1 770810 9.993149983 4580 Q R 4380688 + 8 [dd]
> 8,16 1 770811 9.993150482 4580 M R 4380688 + 8 [dd]
> 8,16 1 770812 9.993156384 4580 Q R 4380696 + 8 [dd]
> 8,16 1 770813 9.993156894 4580 M R 4380696 + 8 [dd]
> 8,16 1 770814 9.993159096 4580 Q R 4380704 + 8 [dd]
> 8,16 1 770815 9.993159606 4580 M R 4380704 + 8 [dd]
> 8,16 1 770816 9.993161853 4580 Q R 4380712 + 8 [dd]
> 8,16 1 770817 9.993162351 4580 M R 4380712 + 8 [dd]
> 8,16 1 770818 9.993164628 4580 Q R 4380720 + 8 [dd]
> 8,16 1 770819 9.993165127 4580 M R 4380720 + 8 [dd]
> 8,16 1 770820 9.993170698 4580 Q R 4380728 + 8 [dd]
> 8,16 1 770821 9.993171200 4580 M R 4380728 + 8 [dd]
> 8,16 1 770822 9.993173392 4580 Q R 4380736 + 8 [dd]
> 8,16 1 770823 9.993173894 4580 M R 4380736 + 8 [dd]
> 8,16 1 770824 9.993176081 4580 Q R 4380744 + 8 [dd]
> 8,16 1 770825 9.993176579 4580 M R 4380744 + 8 [dd]
> 8,16 1 770826 9.993178841 4580 Q R 4380752 + 8 [dd]
> 8,16 1 770827 9.993179340 4580 M R 4380752 + 8 [dd]
> 8,16 1 770828 9.993181445 4580 Q R 4380760 + 8 [dd]
> 8,16 1 770829 9.993181949 4580 M R 4380760 + 8 [dd]
> 8,16 1 770830 9.993184121 4580 Q R 4380768 + 8 [dd]
> 8,16 1 770831 9.993184619 4580 M R 4380768 + 8 [dd]
> 8,16 1 770832 9.993186741 4580 Q R 4380776 + 8 [dd]
> 8,16 1 770833 9.993187239 4580 M R 4380776 + 8 [dd]
> 8,16 1 770834 9.993189324 4580 Q R 4380784 + 8 [dd]
> 8,16 1 770835 9.993189822 4580 M R 4380784 + 8 [dd]
> 8,16 1 770836 9.993191998 4580 Q R 4380792 + 8 [dd]
> 8,16 1 770837 9.993192502 4580 M R 4380792 + 8 [dd]
> 8,16 1 770838 9.993194798 4580 Q R 4380800 + 8 [dd]
> 8,16 1 770839 9.993195297 4580 M R 4380800 + 8 [dd]
> 8,16 1 770840 9.993197858 4580 Q R 4380808 + 8 [dd]
> 8,16 1 770841 9.993198358 4580 M R 4380808 + 8 [dd]
> 8,16 1 770842 9.993201427 4580 Q R 4380816 + 8 [dd]
> 8,16 1 770843 9.993201926 4580 M R 4380816 + 8 [dd]
> 8,16 1 770844 9.993204159 4580 Q R 4380824 + 8 [dd]
> 8,16 1 770845 9.993204658 4580 M R 4380824 + 8 [dd]
> 8,16 1 770846 9.993206840 4580 Q R 4380832 + 8 [dd]
> 8,16 1 770847 9.993207338 4580 M R 4380832 + 8 [dd]
> 8,16 1 770848 9.993212789 4580 Q R 4380840 + 8 [dd]
> 8,16 1 770849 9.993213321 4580 M R 4380840 + 8 [dd]
> 8,16 1 770850 9.993215482 4580 Q R 4380848 + 8 [dd]
> 8,16 1 770851 9.993215986 4580 M R 4380848 + 8 [dd]
> 8,16 1 770852 9.993218173 4580 Q R 4380856 + 8 [dd]
> 8,16 1 770853 9.993218673 4580 M R 4380856 + 8 [dd]
> 8,16 1 770854 9.993220839 4580 Q R 4380864 + 8 [dd]
> 8,16 1 770855 9.993221338 4580 M R 4380864 + 8 [dd]
> 8,16 1 770856 9.993223551 4580 Q R 4380872 + 8 [dd]
> 8,16 1 770857 9.993224051 4580 M R 4380872 + 8 [dd]
> 8,16 1 770858 9.993226133 4580 Q R 4380880 + 8 [dd]
> 8,16 1 770859 9.993226632 4580 M R 4380880 + 8 [dd]
> 8,16 1 770860 9.993228840 4580 Q R 4380888 + 8 [dd]
> 8,16 1 770861 9.993229342 4580 M R 4380888 + 8 [dd]
> 8,16 1 770862 9.993231460 4580 Q R 4380896 + 8 [dd]
> 8,16 1 770863 9.993231958 4580 M R 4380896 + 8 [dd]
> 8,16 1 770864 9.993234011 4580 Q R 4380904 + 8 [dd]
> 8,16 1 770865 9.993234513 4580 M R 4380904 + 8 [dd]
> 8,16 1 770866 9.993236661 4580 Q R 4380912 + 8 [dd]
> 8,16 1 770867 9.993237160 4580 M R 4380912 + 8 [dd]
> 8,16 1 770868 9.993239233 4580 Q R 4380920 + 8 [dd]
> 8,16 1 770869 9.993239736 4580 M R 4380920 + 8 [dd]
> 8,16 1 770870 9.993241912 4580 I R 4380416 + 512 ( 302760) [dd]
> 8,16 1 0 9.993244448 0 m N cfq4580S / insert_request
> 8,16 1 770871 9.993247771 4580 U N [dd] 1
> 8,16 1 0 9.993250443 0 m N cfq4580S / dispatch_insert
> 8,16 1 0 9.993254093 0 m N cfq4580S / dispatched a request
> 8,16 1 0 9.993255838 0 m N cfq4580S / activate rq, drv=1
> 8,16 1 770872 9.993256451 4580 D R 4380416 + 512 ( 14539) [dd]
> 8,16 1 770873 9.994299156 0 C R 4380416 + 512 ( 1042705) [0]
> 8,16 1 0 9.994371989 0 m N cfq4580S / complete rqnoidle 0
> 8,16 1 0 9.994375064 0 m N cfq schedule dispatch
> 8,16 1 770874 9.994536199 4580 Q R 4380928 + 8 [dd]
> 8,16 1 770875 9.994542473 4580 G R 4380928 + 8 [dd]
> 8,16 1 770876 9.994544517 4580 P N [dd]
> 8,16 1 770877 9.994548013 4580 Q R 4380936 + 8 [dd]
> 8,16 1 770878 9.994550069 4580 M R 4380936 + 8 [dd]
> 8,16 1 770879 9.994553102 4580 Q R 4380944 + 8 [dd]
> 8,16 1 770880 9.994553612 4580 M R 4380944 + 8 [dd]
> 8,16 1 770881 9.994560750 4580 Q R 4380952 + 8 [dd]
> 8,16 1 770882 9.994561294 4580 M R 4380952 + 8 [dd]
> 8,16 1 770883 9.994563660 4580 Q R 4380960 + 8 [dd]
> 8,16 1 770884 9.994564176 4580 M R 4380960 + 8 [dd]
> 8,16 1 770885 9.994566309 4580 Q R 4380968 + 8 [dd]
> 8,16 1 770886 9.994566819 4580 M R 4380968 + 8 [dd]
> 8,16 1 770887 9.994568963 4580 Q R 4380976 + 8 [dd]
> 8,16 1 770888 9.994569474 4580 M R 4380976 + 8 [dd]
> 8,16 1 770889 9.994571592 4580 Q R 4380984 + 8 [dd]
> 8,16 1 770890 9.994572104 4580 M R 4380984 + 8 [dd]
> 8,16 1 770891 9.994574265 4580 Q R 4380992 + 8 [dd]
> 8,16 1 770892 9.994574776 4580 M R 4380992 + 8 [dd]
> 8,16 1 770893 9.994576861 4580 Q R 4381000 + 8 [dd]
> 8,16 1 770894 9.994577360 4580 M R 4381000 + 8 [dd]
> 8,16 1 770895 9.994579582 4580 Q R 4381008 + 8 [dd]
> 8,16 1 770896 9.994580081 4580 M R 4381008 + 8 [dd]
> 8,16 1 770897 9.994582161 4580 Q R 4381016 + 8 [dd]
> 8,16 1 770898 9.994582661 4580 M R 4381016 + 8 [dd]
> 8,16 1 770899 9.994584717 4580 Q R 4381024 + 8 [dd]
> 8,16 1 770900 9.994585216 4580 M R 4381024 + 8 [dd]
> 8,16 1 770901 9.994587324 4580 Q R 4381032 + 8 [dd]
> 8,16 1 770902 9.994587822 4580 M R 4381032 + 8 [dd]
> 8,16 1 770903 9.994589915 4580 Q R 4381040 + 8 [dd]
> 8,16 1 770904 9.994590414 4580 M R 4381040 + 8 [dd]
> 8,16 1 770905 9.994594071 4580 Q R 4381048 + 8 [dd]
> 8,16 1 770906 9.994594575 4580 M R 4381048 + 8 [dd]
> 8,16 1 770907 9.994596896 4580 Q R 4381056 + 8 [dd]
> 8,16 1 770908 9.994597407 4580 M R 4381056 + 8 [dd]
> 8,16 1 770909 9.994602878 4580 Q R 4381064 + 8 [dd]
> 8,16 1 770910 9.994603394 4580 M R 4381064 + 8 [dd]
> 8,16 1 770911 9.994605653 4580 Q R 4381072 + 8 [dd]
> 8,16 1 770912 9.994606164 4580 M R 4381072 + 8 [dd]
> 8,16 1 770913 9.994608528 4580 Q R 4381080 + 8 [dd]
> 8,16 1 770914 9.994609040 4580 M R 4381080 + 8 [dd]
> 8,16 1 770915 9.994611239 4580 Q R 4381088 + 8 [dd]
> 8,16 1 770916 9.994611751 4580 M R 4381088 + 8 [dd]
> 8,16 1 770917 9.994613936 4580 Q R 4381096 + 8 [dd]
> 8,16 1 770918 9.994614447 4580 M R 4381096 + 8 [dd]
> 8,16 1 770919 9.994616718 4580 Q R 4381104 + 8 [dd]
> 8,16 1 770920 9.994617229 4580 M R 4381104 + 8 [dd]
> 8,16 1 770921 9.994619394 4580 Q R 4381112 + 8 [dd]
> 8,16 1 770922 9.994619905 4580 M R 4381112 + 8 [dd]
> 8,16 1 770923 9.994622152 4580 Q R 4381120 + 8 [dd]
> 8,16 1 770924 9.994622663 4580 M R 4381120 + 8 [dd]
> 8,16 1 770925 9.994624765 4580 Q R 4381128 + 8 [dd]
> 8,16 1 770926 9.994625294 4580 M R 4381128 + 8 [dd]
> 8,16 1 770927 9.994627643 4580 Q R 4381136 + 8 [dd]
> 8,16 1 770928 9.994628172 4580 M R 4381136 + 8 [dd]
> 8,16 1 770929 9.994630638 4580 Q R 4381144 + 8 [dd]
> 8,16 1 770930 9.994631141 4580 M R 4381144 + 8 [dd]
> 8,16 1 770931 9.994633374 4580 Q R 4381152 + 8 [dd]
> 8,16 1 770932 9.994633885 4580 M R 4381152 + 8 [dd]
> 8,16 1 770933 9.994636086 4580 Q R 4381160 + 8 [dd]
> 8,16 1 770934 9.994636592 4580 M R 4381160 + 8 [dd]
> 8,16 1 770935 9.994638779 4580 Q R 4381168 + 8 [dd]
> 8,16 1 770936 9.994639291 4580 M R 4381168 + 8 [dd]
> 8,16 1 770937 9.994644640 4580 Q R 4381176 + 8 [dd]
> 8,16 1 770938 9.994645153 4580 M R 4381176 + 8 [dd]
> 8,16 1 770939 9.994750984 4580 Q R 4381184 + 8 [dd]
> 8,16 1 770940 9.994751713 4580 M R 4381184 + 8 [dd]
> 8,16 1 770941 9.994754423 4580 Q R 4381192 + 8 [dd]
> 8,16 1 770942 9.994754936 4580 M R 4381192 + 8 [dd]
> 8,16 1 770943 9.994757220 4580 Q R 4381200 + 8 [dd]
> 8,16 1 770944 9.994757719 4580 M R 4381200 + 8 [dd]
> 8,16 1 770945 9.994759967 4580 Q R 4381208 + 8 [dd]
> 8,16 1 770946 9.994760506 4580 M R 4381208 + 8 [dd]
> 8,16 1 770947 9.994762743 4580 Q R 4381216 + 8 [dd]
> 8,16 1 770948 9.994763242 4580 M R 4381216 + 8 [dd]
> 8,16 1 770949 9.994765425 4580 Q R 4381224 + 8 [dd]
> 8,16 1 770950 9.994765922 4580 M R 4381224 + 8 [dd]
> 8,16 1 770951 9.994768201 4580 Q R 4381232 + 8 [dd]
> 8,16 1 770952 9.994768700 4580 M R 4381232 + 8 [dd]
> 8,16 1 770953 9.994770798 4580 Q R 4381240 + 8 [dd]
> 8,16 1 770954 9.994771298 4580 M R 4381240 + 8 [dd]
> 8,16 1 770955 9.994773393 4580 Q R 4381248 + 8 [dd]
> 8,16 1 770956 9.994773892 4580 M R 4381248 + 8 [dd]
> 8,16 1 770957 9.994776015 4580 Q R 4381256 + 8 [dd]
> 8,16 1 770958 9.994776513 4580 M R 4381256 + 8 [dd]
> 8,16 1 770959 9.994778608 4580 Q R 4381264 + 8 [dd]
> 8,16 1 770960 9.994779107 4580 M R 4381264 + 8 [dd]
> 8,16 1 770961 9.994781210 4580 Q R 4381272 + 8 [dd]
> 8,16 1 770962 9.994781710 4580 M R 4381272 + 8 [dd]
> 8,16 1 770963 9.994787731 4580 Q R 4381280 + 8 [dd]
> 8,16 1 770964 9.994788230 4580 M R 4381280 + 8 [dd]
> 8,16 1 770965 9.994793675 4580 Q R 4381288 + 8 [dd]
> 8,16 1 770966 9.994794174 4580 M R 4381288 + 8 [dd]
> 8,16 1 770967 9.994796307 4580 Q R 4381296 + 8 [dd]
> 8,16 1 770968 9.994796806 4580 M R 4381296 + 8 [dd]
> 8,16 1 770969 9.994799419 4580 Q R 4381304 + 8 [dd]
> 8,16 1 770970 9.994799919 4580 M R 4381304 + 8 [dd]
> 8,16 1 770971 9.994802209 4580 Q R 4381312 + 8 [dd]
> 8,16 1 770972 9.994802707 4580 M R 4381312 + 8 [dd]
> 8,16 1 770973 9.994805174 4580 Q R 4381320 + 8 [dd]
> 8,16 1 770974 9.994805672 4580 M R 4381320 + 8 [dd]
> 8,16 1 770975 9.994807936 4580 Q R 4381328 + 8 [dd]
> 8,16 1 770976 9.994808440 4580 M R 4381328 + 8 [dd]
> 8,16 1 770977 9.994810715 4580 Q R 4381336 + 8 [dd]
> 8,16 1 770978 9.994811242 4580 M R 4381336 + 8 [dd]
> 8,16 1 770979 9.994813464 4580 Q R 4381344 + 8 [dd]
> 8,16 1 770980 9.994813963 4580 M R 4381344 + 8 [dd]
> 8,16 1 770981 9.994816205 4580 Q R 4381352 + 8 [dd]
> 8,16 1 770982 9.994816776 4580 M R 4381352 + 8 [dd]
> 8,16 1 770983 9.994819127 4580 Q R 4381360 + 8 [dd]
> 8,16 1 770984 9.994819628 4580 M R 4381360 + 8 [dd]
> 8,16 1 770985 9.994821810 4580 Q R 4381368 + 8 [dd]
> 8,16 1 770986 9.994822315 4580 M R 4381368 + 8 [dd]
> 8,16 1 770987 9.994824377 4580 Q R 4381376 + 8 [dd]
> 8,16 1 770988 9.994824876 4580 M R 4381376 + 8 [dd]
> 8,16 1 770989 9.994827067 4580 Q R 4381384 + 8 [dd]
> 8,16 1 770990 9.994827565 4580 M R 4381384 + 8 [dd]
> 8,16 1 770991 9.994829760 4580 Q R 4381392 + 8 [dd]
> 8,16 1 770992 9.994830259 4580 M R 4381392 + 8 [dd]
> 8,16 1 770993 9.994835522 4580 Q R 4381400 + 8 [dd]
> 8,16 1 770994 9.994836021 4580 M R 4381400 + 8 [dd]
> 8,16 1 770995 9.994838181 4580 Q R 4381408 + 8 [dd]
> 8,16 1 770996 9.994838680 4580 M R 4381408 + 8 [dd]
> 8,16 1 770997 9.994840857 4580 Q R 4381416 + 8 [dd]
> 8,16 1 770998 9.994841369 4580 M R 4381416 + 8 [dd]
> 8,16 1 770999 9.994843455 4580 Q R 4381424 + 8 [dd]
> 8,16 1 771000 9.994843954 4580 M R 4381424 + 8 [dd]
> 8,16 1 771001 9.994846149 4580 Q R 4381432 + 8 [dd]
> 8,16 1 771002 9.994846662 4580 M R 4381432 + 8 [dd]
> 8,16 1 771003 9.994849336 4580 I R 4380928 + 512 ( 306863) [dd]
> 8,16 1 0 9.994852010 0 m N cfq4580S / insert_request
> 8,16 1 771004 9.994855251 4580 U N [dd] 1
> 8,16 1 0 9.994857783 0 m N cfq4580S / dispatch_insert
> 8,16 1 0 9.994861277 0 m N cfq4580S / dispatched a request
> 8,16 1 0 9.994863066 0 m N cfq4580S / activate rq, drv=1
> 8,16 1 771005 9.994863680 4580 D R 4380928 + 512 ( 14344) [dd]
> 8,16 1 771006 9.995909291 0 C R 4380928 + 512 ( 1045611) [0]
> 8,16 1 0 9.995983219 0 m N cfq4580S / complete rqnoidle 0
> 8,16 1 0 9.995986144 0 m N cfq schedule dispatch
> 8,16 1 771007 9.996149764 4580 Q R 4381440 + 8 [dd]
> 8,16 1 771008 9.996155872 4580 G R 4381440 + 8 [dd]
> 8,16 1 771009 9.996157994 4580 P N [dd]
> 8,16 1 771010 9.996161548 4580 Q R 4381448 + 8 [dd]
> 8,16 1 771011 9.996163428 4580 M R 4381448 + 8 [dd]
> 8,16 1 771012 9.996166608 4580 Q R 4381456 + 8 [dd]
> 8,16 1 771013 9.996167115 4580 M R 4381456 + 8 [dd]
> 8,16 1 771014 9.996169178 4580 Q R 4381464 + 8 [dd]
> 8,16 1 771015 9.996169681 4580 M R 4381464 + 8 [dd]
> 8,16 1 771016 9.996171779 4580 Q R 4381472 + 8 [dd]
> 8,16 1 771017 9.996172277 4580 M R 4381472 + 8 [dd]
> 8,16 1 771018 9.996174323 4580 Q R 4381480 + 8 [dd]
> 8,16 1 771019 9.996174822 4580 M R 4381480 + 8 [dd]
> 8,16 1 771020 9.996176942 4580 Q R 4381488 + 8 [dd]
> 8,16 1 771021 9.996177446 4580 M R 4381488 + 8 [dd]
> 8,16 1 771022 9.996179520 4580 Q R 4381496 + 8 [dd]
> 8,16 1 771023 9.996180022 4580 M R 4381496 + 8 [dd]
> 8,16 1 771024 9.996182075 4580 Q R 4381504 + 8 [dd]
> 8,16 1 771025 9.996182574 4580 M R 4381504 + 8 [dd]
> 8,16 1 771026 9.996189624 4580 Q R 4381512 + 8 [dd]
> 8,16 1 771027 9.996190124 4580 M R 4381512 + 8 [dd]
> 8,16 1 771028 9.996192318 4580 Q R 4381520 + 8 [dd]
> 8,16 1 771029 9.996192819 4580 M R 4381520 + 8 [dd]
> 8,16 1 771030 9.996194916 4580 Q R 4381528 + 8 [dd]
> 8,16 1 771031 9.996195415 4580 M R 4381528 + 8 [dd]
> 8,16 1 771032 9.996197792 4580 Q R 4381536 + 8 [dd]
> 8,16 1 771033 9.996198291 4580 M R 4381536 + 8 [dd]
> 8,16 1 771034 9.996200401 4580 Q R 4381544 + 8 [dd]
> 8,16 1 771035 9.996200899 4580 M R 4381544 + 8 [dd]
> 8,16 1 771036 9.996202991 4580 Q R 4381552 + 8 [dd]
> 8,16 1 771037 9.996203495 4580 M R 4381552 + 8 [dd]
> 8,16 1 771038 9.996205593 4580 Q R 4381560 + 8 [dd]
> 8,16 1 771039 9.996206095 4580 M R 4381560 + 8 [dd]
> 8,16 1 771040 9.996208179 4580 Q R 4381568 + 8 [dd]
> 8,16 1 771041 9.996208678 4580 M R 4381568 + 8 [dd]
> 8,16 1 771042 9.996210778 4580 Q R 4381576 + 8 [dd]
> 8,16 1 771043 9.996211285 4580 M R 4381576 + 8 [dd]
> 8,16 1 771044 9.996213428 4580 Q R 4381584 + 8 [dd]
> 8,16 1 771045 9.996213932 4580 M R 4381584 + 8 [dd]
> 8,16 1 771046 9.996217450 4580 Q R 4381592 + 8 [dd]
> 8,16 1 771047 9.996217952 4580 M R 4381592 + 8 [dd]
> 8,16 1 771048 9.996220131 4580 Q R 4381600 + 8 [dd]
> 8,16 1 771049 9.996220644 4580 M R 4381600 + 8 [dd]
> 8,16 1 771050 9.996222799 4580 Q R 4381608 + 8 [dd]
> 8,16 1 771051 9.996223302 4580 M R 4381608 + 8 [dd]
> 8,16 1 771052 9.996225537 4580 Q R 4381616 + 8 [dd]
> 8,16 1 771053 9.996226039 4580 M R 4381616 + 8 [dd]
> 8,16 1 771054 9.996231412 4580 Q R 4381624 + 8 [dd]
> 8,16 1 771055 9.996231912 4580 M R 4381624 + 8 [dd]
> 8,16 1 771056 9.996234006 4580 Q R 4381632 + 8 [dd]
> 8,16 1 771057 9.996234505 4580 M R 4381632 + 8 [dd]
> 8,16 1 771058 9.996236661 4580 Q R 4381640 + 8 [dd]
> 8,16 1 771059 9.996237160 4580 M R 4381640 + 8 [dd]
> 8,16 1 771060 9.996239325 4580 Q R 4381648 + 8 [dd]
> 8,16 1 771061 9.996239829 4580 M R 4381648 + 8 [dd]
> 8,16 1 771062 9.996242197 4580 Q R 4381656 + 8 [dd]
> 8,16 1 771063 9.996242700 4580 M R 4381656 + 8 [dd]
> 8,16 1 771064 9.996244888 4580 Q R 4381664 + 8 [dd]
> 8,16 1 771065 9.996245388 4580 M R 4381664 + 8 [dd]
> 8,16 1 771066 9.996247580 4580 Q R 4381672 + 8 [dd]
> 8,16 1 771067 9.996248079 4580 M R 4381672 + 8 [dd]
> 8,16 1 771068 9.996250234 4580 Q R 4381680 + 8 [dd]
> 8,16 1 771069 9.996250735 4580 M R 4381680 + 8 [dd]
> 8,16 1 771070 9.996252898 4580 Q R 4381688 + 8 [dd]
> 8,16 1 771071 9.996253388 4580 M R 4381688 + 8 [dd]
> 8,16 1 771072 9.996357598 4580 Q R 4381696 + 8 [dd]
> 8,16 1 771073 9.996358355 4580 M R 4381696 + 8 [dd]
> 8,16 1 771074 9.996360935 4580 Q R 4381704 + 8 [dd]
> 8,16 1 771075 9.996361434 4580 M R 4381704 + 8 [dd]
> 8,16 1 771076 9.996363662 4580 Q R 4381712 + 8 [dd]
> 8,16 1 771077 9.996364166 4580 M R 4381712 + 8 [dd]
> 8,16 1 771078 9.996366220 4580 Q R 4381720 + 8 [dd]
> 8,16 1 771079 9.996366731 4580 M R 4381720 + 8 [dd]
> 8,16 1 771080 9.996368930 4580 Q R 4381728 + 8 [dd]
> 8,16 1 771081 9.996369429 4580 M R 4381728 + 8 [dd]
> 8,16 1 771082 9.996375003 4580 Q R 4381736 + 8 [dd]
> 8,16 1 771083 9.996375513 4580 M R 4381736 + 8 [dd]
> 8,16 1 771084 9.996377664 4580 Q R 4381744 + 8 [dd]
> 8,16 1 771085 9.996378380 4580 M R 4381744 + 8 [dd]
> 8,16 1 771086 9.996380579 4580 Q R 4381752 + 8 [dd]
> 8,16 1 771087 9.996381098 4580 M R 4381752 + 8 [dd]
> 8,16 1 771088 9.996383260 4580 Q R 4381760 + 8 [dd]
> 8,16 1 771089 9.996383759 4580 M R 4381760 + 8 [dd]
> 8,16 1 771090 9.996385969 4580 Q R 4381768 + 8 [dd]
> 8,16 1 771091 9.996386469 4580 M R 4381768 + 8 [dd]
> 8,16 1 771092 9.996388658 4580 Q R 4381776 + 8 [dd]
> 8,16 1 771093 9.996389162 4580 M R 4381776 + 8 [dd]
> 8,16 1 771094 9.996391335 4580 Q R 4381784 + 8 [dd]
> 8,16 1 771095 9.996391837 4580 M R 4381784 + 8 [dd]
> 8,16 1 771096 9.996393920 4580 Q R 4381792 + 8 [dd]
> 8,16 1 771097 9.996394419 4580 M R 4381792 + 8 [dd]
> 8,16 1 771098 9.996396469 4580 Q R 4381800 + 8 [dd]
> 8,16 1 771099 9.996396967 4580 M R 4381800 + 8 [dd]
> 8,16 1 771100 9.996399181 4580 Q R 4381808 + 8 [dd]
> 8,16 1 771101 9.996399684 4580 M R 4381808 + 8 [dd]
> 8,16 1 771102 9.996402243 4580 Q R 4381816 + 8 [dd]
> 8,16 1 771103 9.996402751 4580 M R 4381816 + 8 [dd]
> 8,16 1 771104 9.996404942 4580 Q R 4381824 + 8 [dd]
> 8,16 1 771105 9.996405441 4580 M R 4381824 + 8 [dd]
> 8,16 1 771106 9.996407662 4580 Q R 4381832 + 8 [dd]
> 8,16 1 771107 9.996408160 4580 M R 4381832 + 8 [dd]
> 8,16 1 771108 9.996410409 4580 Q R 4381840 + 8 [dd]
> 8,16 1 771109 9.996410910 4580 M R 4381840 + 8 [dd]
> 8,16 1 771110 9.996416841 4580 Q R 4381848 + 8 [dd]
> 8,16 1 771111 9.996417341 4580 M R 4381848 + 8 [dd]
> 8,16 1 771112 9.996419551 4580 Q R 4381856 + 8 [dd]
> 8,16 1 771113 9.996420050 4580 M R 4381856 + 8 [dd]
> 8,16 1 771114 9.996425832 4580 Q R 4381864 + 8 [dd]
> 8,16 1 771115 9.996426331 4580 M R 4381864 + 8 [dd]
> 8,16 1 771116 9.996428600 4580 Q R 4381872 + 8 [dd]
> 8,16 1 771117 9.996429101 4580 M R 4381872 + 8 [dd]
> 8,16 1 771118 9.996431277 4580 Q R 4381880 + 8 [dd]
> 8,16 1 771119 9.996431779 4580 M R 4381880 + 8 [dd]
> 8,16 1 771120 9.996434026 4580 Q R 4381888 + 8 [dd]
> 8,16 1 771121 9.996434525 4580 M R 4381888 + 8 [dd]
> 8,16 1 771122 9.996436615 4580 Q R 4381896 + 8 [dd]
> 8,16 1 771123 9.996437114 4580 M R 4381896 + 8 [dd]
> 8,16 1 771124 9.996439353 4580 Q R 4381904 + 8 [dd]
> 8,16 1 771125 9.996439864 4580 M R 4381904 + 8 [dd]
> 8,16 1 771126 9.996441959 4580 Q R 4381912 + 8 [dd]
> 8,16 1 771127 9.996442460 4580 M R 4381912 + 8 [dd]
> 8,16 1 771128 9.996445027 4580 Q R 4381920 + 8 [dd]
> 8,16 1 771129 9.996445526 4580 M R 4381920 + 8 [dd]
> 8,16 1 771130 9.996447737 4580 Q R 4381928 + 8 [dd]
> 8,16 1 771131 9.996448252 4580 M R 4381928 + 8 [dd]
> 8,16 1 771132 9.996450536 4580 Q R 4381936 + 8 [dd]
> 8,16 1 771133 9.996451040 4580 M R 4381936 + 8 [dd]
> 8,16 1 771134 9.996453308 4580 Q R 4381944 + 8 [dd]
> 8,16 1 771135 9.996453811 4580 M R 4381944 + 8 [dd]
> 8,16 1 771136 9.996456417 4580 I R 4381440 + 512 ( 300545) [dd]
> 8,16 1 0 9.996458987 0 m N cfq4580S / insert_request
> 8,16 1 771137 9.996462198 4580 U N [dd] 1
> 8,16 1 0 9.996464756 0 m N cfq4580S / dispatch_insert
> 8,16 1 0 9.996468170 0 m N cfq4580S / dispatched a request
> 8,16 1 0 9.996469836 0 m N cfq4580S / activate rq, drv=1
> 8,16 1 771138 9.996470460 4580 D R 4381440 + 512 ( 14043) [dd]
> 8,16 1 771139 9.997514205 0 C R 4381440 + 512 ( 1043745) [0]
> 8,16 1 0 9.997587102 0 m N cfq4580S / complete rqnoidle 0
> 8,16 1 0 9.997589870 0 m N cfq schedule dispatch
> 8,16 1 771140 9.997751496 4580 Q R 4381952 + 8 [dd]
> 8,16 1 771141 9.997758630 4580 G R 4381952 + 8 [dd]
> 8,16 1 771142 9.997760814 4580 P N [dd]
> 8,16 1 771143 9.997769413 4580 Q R 4381960 + 8 [dd]
> 8,16 1 771144 9.997771473 4580 M R 4381960 + 8 [dd]
> 8,16 1 771145 9.997774552 4580 Q R 4381968 + 8 [dd]
> 8,16 1 771146 9.997775056 4580 M R 4381968 + 8 [dd]
> 8,16 1 771147 9.997777142 4580 Q R 4381976 + 8 [dd]
> 8,16 1 771148 9.997777717 4580 M R 4381976 + 8 [dd]
> 8,16 1 771149 9.997779832 4580 Q R 4381984 + 8 [dd]
> 8,16 1 771150 9.997780366 4580 M R 4381984 + 8 [dd]
> 8,16 1 771151 9.997782454 4580 Q R 4381992 + 8 [dd]
> 8,16 1 771152 9.997782953 4580 M R 4381992 + 8 [dd]
> 8,16 1 771153 9.997785271 4580 Q R 4382000 + 8 [dd]
> 8,16 1 771154 9.997785779 4580 M R 4382000 + 8 [dd]
> 8,16 1 771155 9.997787937 4580 Q R 4382008 + 8 [dd]
> 8,16 1 771156 9.997788434 4580 M R 4382008 + 8 [dd]
> 8,16 1 771157 9.997790588 4580 Q R 4382016 + 8 [dd]
> 8,16 1 771158 9.997791085 4580 M R 4382016 + 8 [dd]
> 8,16 1 771159 9.997793251 4580 Q R 4382024 + 8 [dd]
> 8,16 1 771160 9.997793954 4580 M R 4382024 + 8 [dd]
> 8,16 1 771161 9.997796144 4580 Q R 4382032 + 8 [dd]
> 8,16 1 771162 9.997796672 4580 M R 4382032 + 8 [dd]
> 8,16 1 771163 9.997798737 4580 Q R 4382040 + 8 [dd]
> 8,16 1 771164 9.997799238 4580 M R 4382040 + 8 [dd]
> 8,16 1 771165 9.997801277 4580 Q R 4382048 + 8 [dd]
> 8,16 1 771166 9.997801788 4580 M R 4382048 + 8 [dd]
> 8,16 1 771167 9.997803925 4580 Q R 4382056 + 8 [dd]
> 8,16 1 771168 9.997804439 4580 M R 4382056 + 8 [dd]
> 8,16 1 771169 9.997806598 4580 Q R 4382064 + 8 [dd]
> 8,16 1 771170 9.997807095 4580 M R 4382064 + 8 [dd]
> 8,16 1 771171 9.997812761 4580 Q R 4382072 + 8 [dd]
> 8,16 1 771172 9.997813262 4580 M R 4382072 + 8 [dd]
> 8,16 1 771173 9.997815335 4580 Q R 4382080 + 8 [dd]
> 8,16 1 771174 9.997815836 4580 M R 4382080 + 8 [dd]
> 8,16 1 771175 9.997817949 4580 Q R 4382088 + 8 [dd]
> 8,16 1 771176 9.997818448 4580 M R 4382088 + 8 [dd]
> 8,16 1 771177 9.997820558 4580 Q R 4382096 + 8 [dd]
> 8,16 1 771178 9.997821057 4580 M R 4382096 + 8 [dd]
> 8,16 1 771179 9.997824698 4580 Q R 4382104 + 8 [dd]
> 8,16 1 771180 9.997825197 4580 M R 4382104 + 8 [dd]
> 8,16 1 771181 9.997827376 4580 Q R 4382112 + 8 [dd]
> 8,16 1 771182 9.997827874 4580 M R 4382112 + 8 [dd]
> 8,16 1 771183 9.997830036 4580 Q R 4382120 + 8 [dd]
> 8,16 1 771184 9.997830538 4580 M R 4382120 + 8 [dd]
> 8,16 1 771185 9.997832781 4580 Q R 4382128 + 8 [dd]
> 8,16 1 771186 9.997833278 4580 M R 4382128 + 8 [dd]
> 8,16 1 771187 9.997835542 4580 Q R 4382136 + 8 [dd]
> 8,16 1 771188 9.997836044 4580 M R 4382136 + 8 [dd]
> 8,16 1 771189 9.997838090 4580 Q R 4382144 + 8 [dd]
> 8,16 1 771190 9.997838591 4580 M R 4382144 + 8 [dd]
> 8,16 1 771191 9.997840646 4580 Q R 4382152 + 8 [dd]
> 8,16 1 771192 9.997841147 4580 M R 4382152 + 8 [dd]
> 8,16 1 771193 9.997843299 4580 Q R 4382160 + 8 [dd]
> 8,16 1 771194 9.997843797 4580 M R 4382160 + 8 [dd]
> 8,16 1 771195 9.997845909 4580 Q R 4382168 + 8 [dd]
> 8,16 1 771196 9.997846408 4580 M R 4382168 + 8 [dd]
> 8,16 1 771197 9.997848578 4580 Q R 4382176 + 8 [dd]
> 8,16 1 771198 9.997849082 4580 M R 4382176 + 8 [dd]
> 8,16 1 771199 9.997854848 4580 Q R 4382184 + 8 [dd]
> 8,16 1 771200 9.997855350 4580 M R 4382184 + 8 [dd]
> 8,16 1 771201 9.997857436 4580 Q R 4382192 + 8 [dd]
> 8,16 1 771202 9.997857934 4580 M R 4382192 + 8 [dd]
> 8,16 1 771203 9.997860278 4580 Q R 4382200 + 8 [dd]
> 8,16 1 771204 9.997860779 4580 M R 4382200 + 8 [dd]
> 8,16 1 771205 9.997964321 4580 Q R 4382208 + 8 [dd]
> 8,16 1 771206 9.997965007 4580 M R 4382208 + 8 [dd]
> 8,16 1 771207 9.997967619 4580 Q R 4382216 + 8 [dd]
> 8,16 1 771208 9.997968161 4580 M R 4382216 + 8 [dd]
> 8,16 1 771209 9.997970459 4580 Q R 4382224 + 8 [dd]
> 8,16 1 771210 9.997970963 4580 M R 4382224 + 8 [dd]
> 8,16 1 771211 9.997973081 4580 Q R 4382232 + 8 [dd]
> 8,16 1 771212 9.997973580 4580 M R 4382232 + 8 [dd]
> 8,16 1 771213 9.997975787 4580 Q R 4382240 + 8 [dd]
> 8,16 1 771214 9.997976285 4580 M R 4382240 + 8 [dd]
> 8,16 1 771215 9.997978452 4580 Q R 4382248 + 8 [dd]
> 8,16 1 771216 9.997978953 4580 M R 4382248 + 8 [dd]
> 8,16 1 771217 9.997981249 4580 Q R 4382256 + 8 [dd]
> 8,16 1 771218 9.997981751 4580 M R 4382256 + 8 [dd]
> 8,16 1 771219 9.997983917 4580 Q R 4382264 + 8 [dd]
> 8,16 1 771220 9.997984418 4580 M R 4382264 + 8 [dd]
> 8,16 1 771221 9.997986611 4580 Q R 4382272 + 8 [dd]
> 8,16 1 771222 9.997987121 4580 M R 4382272 + 8 [dd]
> 8,16 1 771223 9.997989204 4580 Q R 4382280 + 8 [dd]
> 8,16 1 771224 9.997989705 4580 M R 4382280 + 8 [dd]
> 8,16 1 771225 9.997991904 4580 Q R 4382288 + 8 [dd]
> 8,16 1 771226 9.997992402 4580 M R 4382288 + 8 [dd]
> 8,16 1 771227 9.997998036 4580 Q R 4382296 + 8 [dd]
> 8,16 1 771228 9.997998579 4580 M R 4382296 + 8 [dd]
> 8,16 1 771229 9.998000634 4580 Q R 4382304 + 8 [dd]
> 8,16 1 771230 9.998001136 4580 M R 4382304 + 8 [dd]
> 8,16 1 771231 9.998003255 4580 Q R 4382312 + 8 [dd]
> 8,16 1 771232 9.998003774 4580 M R 4382312 + 8 [dd]
> 8,16 1 771233 9.998005975 4580 Q R 4382320 + 8 [dd]
> 8,16 1 771234 9.998006476 4580 M R 4382320 + 8 [dd]
> 8,16 1 771235 9.998008972 4580 Q R 4382328 + 8 [dd]
> 8,16 1 771236 9.998009529 4580 M R 4382328 + 8 [dd]
> 8,16 1 771237 9.998011779 4580 Q R 4382336 + 8 [dd]
> 8,16 1 771238 9.998012277 4580 M R 4382336 + 8 [dd]
> 8,16 1 771239 9.998014476 4580 Q R 4382344 + 8 [dd]
> 8,16 1 771240 9.998014974 4580 M R 4382344 + 8 [dd]
> 8,16 1 771241 9.998017401 4580 Q R 4382352 + 8 [dd]
> 8,16 1 771242 9.998017899 4580 M R 4382352 + 8 [dd]
> 8,16 1 771243 9.998020091 4580 Q R 4382360 + 8 [dd]
> 8,16 1 771244 9.998020588 4580 M R 4382360 + 8 [dd]
> 8,16 1 771245 9.998022782 4580 Q R 4382368 + 8 [dd]
> 8,16 1 771246 9.998023389 4580 M R 4382368 + 8 [dd]
> 8,16 1 771247 9.998025647 4580 Q R 4382376 + 8 [dd]
> 8,16 1 771248 9.998026180 4580 M R 4382376 + 8 [dd]
> 8,16 1 771249 9.998028480 4580 Q R 4382384 + 8 [dd]
> 8,16 1 771250 9.998029020 4580 M R 4382384 + 8 [dd]
> 8,16 1 771251 9.998031205 4580 Q R 4382392 + 8 [dd]
> 8,16 1 771252 9.998031706 4580 M R 4382392 + 8 [dd]
> 8,16 1 771253 9.998033865 4580 Q R 4382400 + 8 [dd]
> 8,16 1 771254 9.998034366 4580 M R 4382400 + 8 [dd]
> 8,16 1 771255 9.998040073 4580 Q R 4382408 + 8 [dd]
> 8,16 1 771256 9.998040571 4580 M R 4382408 + 8 [dd]
> 8,16 1 771257 9.998042647 4580 Q R 4382416 + 8 [dd]
> 8,16 1 771258 9.998043150 4580 M R 4382416 + 8 [dd]
> 8,16 1 771259 9.998045325 4580 Q R 4382424 + 8 [dd]
> 8,16 1 771260 9.998045826 4580 M R 4382424 + 8 [dd]
> 8,16 1 771261 9.998047931 4580 Q R 4382432 + 8 [dd]
> 8,16 1 771262 9.998048432 4580 M R 4382432 + 8 [dd]
> 8,16 1 771263 9.998050535 4580 Q R 4382440 + 8 [dd]
> 8,16 1 771264 9.998051038 4580 M R 4382440 + 8 [dd]
> 8,16 1 771265 9.998056985 4580 Q R 4382448 + 8 [dd]
> 8,16 1 771266 9.998057500 4580 M R 4382448 + 8 [dd]
> 8,16 1 771267 9.998059576 4580 Q R 4382456 + 8 [dd]
> 8,16 1 771268 9.998060077 4580 M R 4382456 + 8 [dd]
> 8,16 1 771269 9.998062341 4580 I R 4381952 + 512 ( 303711) [dd]
> 8,16 1 0 9.998064881 0 m N cfq4580S / insert_request
> 8,16 1 771270 9.998068490 4580 U N [dd] 1
> 8,16 1 0 9.998071031 0 m N cfq4580S / dispatch_insert
> 8,16 1 0 9.998074991 0 m N cfq4580S / dispatched a request
> 8,16 1 0 9.998076645 0 m N cfq4580S / activate rq, drv=1
> 8,16 1 771271 9.998077269 4580 D R 4381952 + 512 ( 14928) [dd]
> 8,16 1 771272 9.999120396 0 C R 4381952 + 512 ( 1043127) [0]
> 8,16 1 0 9.999192302 0 m N cfq4580S / complete rqnoidle 0
> 8,16 1 0 9.999195361 0 m N cfq schedule dispatch
> 8,16 1 771273 9.999356099 4580 Q R 4382464 + 8 [dd]
> 8,16 1 771274 9.999362719 4580 G R 4382464 + 8 [dd]
> 8,16 1 771275 9.999364795 4580 P N [dd]
> 8,16 1 771276 9.999368199 4580 Q R 4382472 + 8 [dd]
> 8,16 1 771277 9.999370072 4580 M R 4382472 + 8 [dd]
> 8,16 1 771278 9.999373166 4580 Q R 4382480 + 8 [dd]
> 8,16 1 771279 9.999373710 4580 M R 4382480 + 8 [dd]
> 8,16 1 771280 9.999375830 4580 Q R 4382488 + 8 [dd]
> 8,16 1 771281 9.999376334 4580 M R 4382488 + 8 [dd]
> 8,16 1 771282 9.999378433 4580 Q R 4382496 + 8 [dd]
> 8,16 1 771283 9.999378932 4580 M R 4382496 + 8 [dd]
> 8,16 1 771284 9.999380973 4580 Q R 4382504 + 8 [dd]
> 8,16 1 771285 9.999381477 4580 M R 4382504 + 8 [dd]
> 8,16 1 771286 9.999383602 4580 Q R 4382512 + 8 [dd]
> 8,16 1 771287 9.999384101 4580 M R 4382512 + 8 [dd]
> 8,16 1 771288 9.999391190 4580 Q R 4382520 + 8 [dd]
> 8,16 1 771289 9.999391690 4580 M R 4382520 + 8 [dd]
> 8,16 1 771290 9.999393850 4580 Q R 4382528 + 8 [dd]
> 8,16 1 771291 9.999394351 4580 M R 4382528 + 8 [dd]
> 8,16 1 771292 9.999396618 4580 Q R 4382536 + 8 [dd]
> 8,16 1 771293 9.999397190 4580 M R 4382536 + 8 [dd]
> 8,16 1 771294 9.999399323 4580 Q R 4382544 + 8 [dd]
> 8,16 1 771295 9.999399864 4580 M R 4382544 + 8 [dd]
> 8,16 1 771296 9.999401953 4580 Q R 4382552 + 8 [dd]
> 8,16 1 771297 9.999402472 4580 M R 4382552 + 8 [dd]
> 8,16 1 771298 9.999404563 4580 Q R 4382560 + 8 [dd]
> 8,16 1 771299 9.999405057 4580 M R 4382560 + 8 [dd]
> 8,16 1 771300 9.999407109 4580 Q R 4382568 + 8 [dd]
> 8,16 1 771301 9.999407611 4580 M R 4382568 + 8 [dd]
> 8,16 1 771302 9.999409677 4580 Q R 4382576 + 8 [dd]
> 8,16 1 771303 9.999410176 4580 M R 4382576 + 8 [dd]
> 8,16 1 771304 9.999412226 4580 Q R 4382584 + 8 [dd]
> 8,16 1 771305 9.999412734 4580 M R 4382584 + 8 [dd]
> 8,16 1 771306 9.999416340 4580 Q R 4382592 + 8 [dd]
> 8,16 1 771307 9.999416862 4580 M R 4382592 + 8 [dd]
> 8,16 1 771308 9.999419187 4580 Q R 4382600 + 8 [dd]
> 8,16 1 771309 9.999419706 4580 M R 4382600 + 8 [dd]
> 8,16 1 771310 9.999421977 4580 Q R 4382608 + 8 [dd]
> 8,16 1 771311 9.999422503 4580 M R 4382608 + 8 [dd]
> 8,16 1 771312 9.999424582 4580 Q R 4382616 + 8 [dd]
> 8,16 1 771313 9.999425120 4580 M R 4382616 + 8 [dd]
> 8,16 1 771314 9.999427292 4580 Q R 4382624 + 8 [dd]
> 8,16 1 771315 9.999427805 4580 M R 4382624 + 8 [dd]
> 8,16 1 771316 9.999433255 4580 Q R 4382632 + 8 [dd]
> 8,16 1 771317 9.999433766 4580 M R 4382632 + 8 [dd]
> 8,16 1 771318 9.999435901 4580 Q R 4382640 + 8 [dd]
> 8,16 1 771319 9.999436412 4580 M R 4382640 + 8 [dd]
> 8,16 1 771320 9.999438504 4580 Q R 4382648 + 8 [dd]
> 8,16 1 771321 9.999439243 4580 M R 4382648 + 8 [dd]
> 8,16 1 771322 9.999441418 4580 Q R 4382656 + 8 [dd]
> 8,16 1 771323 9.999441949 4580 M R 4382656 + 8 [dd]
> 8,16 1 771324 9.999444183 4580 Q R 4382664 + 8 [dd]
> 8,16 1 771325 9.999444698 4580 M R 4382664 + 8 [dd]
> 8,16 1 771326 9.999446894 4580 Q R 4382672 + 8 [dd]
> 8,16 1 771327 9.999447411 4580 M R 4382672 + 8 [dd]
> 8,16 1 771328 9.999449485 4580 Q R 4382680 + 8 [dd]
> 8,16 1 771329 9.999449997 4580 M R 4382680 + 8 [dd]
> 8,16 1 771330 9.999452055 4580 Q R 4382688 + 8 [dd]
> 8,16 1 771331 9.999452566 4580 M R 4382688 + 8 [dd]
> 8,16 1 771332 9.999454606 4580 Q R 4382696 + 8 [dd]
> 8,16 1 771333 9.999455154 4580 M R 4382696 + 8 [dd]
> 8,16 1 771334 9.999457363 4580 Q R 4382704 + 8 [dd]
> 8,16 1 771335 9.999457875 4580 M R 4382704 + 8 [dd]
> 8,16 1 771336 9.999460045 4580 Q R 4382712 + 8 [dd]
> 8,16 1 771337 9.999460561 4580 M R 4382712 + 8 [dd]
> 8,16 1 771338 9.999564615 4580 Q R 4382720 + 8 [dd]
> 8,16 1 771339 9.999565347 4580 M R 4382720 + 8 [dd]
> 8,16 1 771340 9.999568401 4580 Q R 4382728 + 8 [dd]
> 8,16 1 771341 9.999568908 4580 M R 4382728 + 8 [dd]
> 8,16 1 771342 9.999571276 4580 Q R 4382736 + 8 [dd]
> 8,16 1 771343 9.999571792 4580 M R 4382736 + 8 [dd]
> 8,16 1 771344 9.999577396 4580 Q R 4382744 + 8 [dd]
> 8,16 1 771345 9.999578003 4580 M R 4382744 + 8 [dd]
> 8,16 1 771346 9.999580231 4580 Q R 4382752 + 8 [dd]
> 8,16 1 771347 9.999580749 4580 M R 4382752 + 8 [dd]
> 8,16 1 771348 9.999583114 4580 Q R 4382760 + 8 [dd]
> 8,16 1 771349 9.999583625 4580 M R 4382760 + 8 [dd]
> 8,16 1 771350 9.999585875 4580 Q R 4382768 + 8 [dd]
> 8,16 1 771351 9.999586374 4580 M R 4382768 + 8 [dd]
> 8,16 1 771352 9.999588531 4580 Q R 4382776 + 8 [dd]
> 8,16 1 771353 9.999589032 4580 M R 4382776 + 8 [dd]
> 8,16 1 771354 9.999591214 4580 Q R 4382784 + 8 [dd]
> 8,16 1 771355 9.999591714 4580 M R 4382784 + 8 [dd]
> 8,16 1 771356 9.999593930 4580 Q R 4382792 + 8 [dd]
> 8,16 1 771357 9.999594442 4580 M R 4382792 + 8 [dd]
> 8,16 1 771358 9.999596696 4580 Q R 4382800 + 8 [dd]
> 8,16 1 771359 9.999597190 4580 M R 4382800 + 8 [dd]
> 8,16 1 771360 9.999599406 4580 Q R 4382808 + 8 [dd]
> 8,16 1 771361 9.999599907 4580 M R 4382808 + 8 [dd]
> 8,16 1 771362 9.999602166 4580 Q R 4382816 + 8 [dd]
> 8,16 1 771363 9.999602667 4580 M R 4382816 + 8 [dd]
> 8,16 1 771364 9.999604755 4580 Q R 4382824 + 8 [dd]
> 8,16 1 771365 9.999605259 4580 M R 4382824 + 8 [dd]
> 8,16 1 771366 9.999607486 4580 Q R 4382832 + 8 [dd]
> 8,16 1 771367 9.999607978 4580 M R 4382832 + 8 [dd]
> 8,16 1 771368 9.999610062 4580 Q R 4382840 + 8 [dd]
> 8,16 1 771369 9.999610564 4580 M R 4382840 + 8 [dd]
> 8,16 1 771370 9.999612914 4580 Q R 4382848 + 8 [dd]
> 8,16 1 771371 9.999613418 4580 M R 4382848 + 8 [dd]
> 8,16 1 771372 9.999618806 4580 Q R 4382856 + 8 [dd]
> 8,16 1 771373 9.999619308 4580 M R 4382856 + 8 [dd]
> 8,16 1 771374 9.999621579 4580 Q R 4382864 + 8 [dd]
> 8,16 1 771375 9.999622092 4580 M R 4382864 + 8 [dd]
> 8,16 1 771376 9.999624260 4580 Q R 4382872 + 8 [dd]
> 8,16 1 771377 9.999624779 4580 M R 4382872 + 8 [dd]
> 8,16 1 771378 9.999627506 4580 Q R 4382880 + 8 [dd]
> 8,16 1 771379 9.999628012 4580 M R 4382880 + 8 [dd]
> 8,16 1 771380 9.999630135 4580 Q R 4382888 + 8 [dd]
> 8,16 1 771381 9.999630635 4580 M R 4382888 + 8 [dd]
> 8,16 1 771382 9.999632876 4580 Q R 4382896 + 8 [dd]
> 8,16 1 771383 9.999633378 4580 M R 4382896 + 8 [dd]
> 8,16 1 771384 9.999635541 4580 Q R 4382904 + 8 [dd]
> 8,16 1 771385 9.999636043 4580 M R 4382904 + 8 [dd]
> 8,16 1 771386 9.999638232 4580 Q R 4382912 + 8 [dd]
> 8,16 1 771387 9.999638736 4580 M R 4382912 + 8 [dd]
> 8,16 1 771388 9.999640940 4580 Q R 4382920 + 8 [dd]
> 8,16 1 771389 9.999641440 4580 M R 4382920 + 8 [dd]
> 8,16 1 771390 9.999643644 4580 Q R 4382928 + 8 [dd]
> 8,16 1 771391 9.999644157 4580 M R 4382928 + 8 [dd]
> 8,16 1 771392 9.999646440 4580 Q R 4382936 + 8 [dd]
> 8,16 1 771393 9.999646960 4580 M R 4382936 + 8 [dd]
> 8,16 1 771394 9.999649193 4580 Q R 4382944 + 8 [dd]
> 8,16 1 771395 9.999649697 4580 M R 4382944 + 8 [dd]
> 8,16 1 771396 9.999651771 4580 Q R 4382952 + 8 [dd]
> 8,16 1 771397 9.999652272 4580 M R 4382952 + 8 [dd]
> 8,16 1 771398 9.999654476 4580 Q R 4382960 + 8 [dd]
> 8,16 1 771399 9.999654975 4580 M R 4382960 + 8 [dd]
> 8,16 1 771400 9.999660256 4580 Q R 4382968 + 8 [dd]
> 8,16 1 771401 9.999660760 4580 M R 4382968 + 8 [dd]
> 8,16 1 771402 9.999663197 4580 I R 4382464 + 512 ( 300478) [dd]
> 8,16 1 0 9.999665743 0 m N cfq4580S / insert_request
> 8,16 1 771403 9.999669190 4580 U N [dd] 1
> 8,16 1 0 9.999672048 0 m N cfq4580S / dispatch_insert
> 8,16 1 0 9.999675568 0 m N cfq4580S / dispatched a request
> 8,16 1 0 9.999677281 0 m N cfq4580S / activate rq, drv=1
> 8,16 1 771404 9.999677892 4580 D R 4382464 + 512 ( 14695) [dd]
> CPU0 (sdb):
> Reads Queued: 20608, 82432KiB Writes Queued: 0, 0KiB
> Read Dispatches: 322, 82432KiB Write Dispatches: 0, 0KiB
> Reads Requeued: 0 Writes Requeued: 0
> Reads Completed: 22, 5632KiB Writes Completed: 0, 0KiB
> Read Merges: 20286, 81144KiB Write Merges: 0, 0KiB
> Read depth: 1 Write depth: 0
> IO unplugs: 322 Timer unplugs: 0
> CPU1 (sdb):
> Reads Queued: 371058, 1484MiB Writes Queued: 0, 0KiB
> Read Dispatches: 5798, 1484MiB Write Dispatches: 0, 0KiB
> Reads Requeued: 0 Writes Requeued: 0
> Reads Completed: 6097, 1560MiB Writes Completed: 0, 0KiB
> Read Merges: 365261, 1461MiB Write Merges: 0, 0KiB
> Read depth: 1 Write depth: 0
> IO unplugs: 5798 Timer unplugs: 0
>
> Total (sdb):
> Reads Queued: 391666, 1566MiB Writes Queued: 0, 0KiB
> Read Dispatches: 6120, 1566MiB Write Dispatches: 0, 0KiB
> Reads Requeued: 0 Writes Requeued: 0
> Reads Completed: 6119, 1566MiB Writes Completed: 0, 0KiB
> Read Merges: 385547, 1542MiB Write Merges: 0, 0KiB
> IO unplugs: 6120 Timer unplugs: 0
>
> Throughput (R/W): 156662KiB/s / 0KiB/s
> Events (sdb): 851428 entries
> Skips: 0 forward (0 - 0.0%)
> Input file sdb.blktrace.0 added
> Input file sdb.blktrace.1 added
>
next prev parent reply other threads:[~2012-01-30 14:11 UTC|newest]
Thread overview: 36+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-01-27 6:00 Bad SSD performance with recent kernels Herbert Poetzl
2012-01-27 6:44 ` Eric Dumazet
2012-01-28 12:51 ` Wu Fengguang
2012-01-28 13:33 ` Eric Dumazet
2012-01-29 5:59 ` Wu Fengguang
2012-01-29 8:42 ` Herbert Poetzl
2012-01-29 9:28 ` Wu Fengguang
2012-01-29 10:03 ` Eric Dumazet
2012-01-29 11:16 ` Wu Fengguang
2012-01-29 13:13 ` Eric Dumazet
2012-01-29 15:52 ` Pádraig Brady
2012-01-29 16:10 ` Wu Fengguang
2012-01-29 20:15 ` Herbert Poetzl
2012-01-30 11:18 ` Wu Fengguang
2012-01-30 12:34 ` Eric Dumazet
2012-01-30 14:01 ` Wu Fengguang [this message]
2012-01-30 14:05 ` Wu Fengguang
2012-01-30 3:17 ` Shaohua Li
2012-01-30 5:31 ` Eric Dumazet
2012-01-30 5:45 ` Shaohua Li
2012-01-30 7:13 ` Herbert Poetzl
2012-01-30 7:22 ` Shaohua Li
2012-01-30 7:36 ` Herbert Poetzl
2012-01-30 8:12 ` Shaohua Li
2012-01-30 10:31 ` Shaohua Li
2012-01-30 14:28 ` Wu Fengguang
2012-01-30 14:51 ` Eric Dumazet
2012-01-30 22:26 ` Vivek Goyal
2012-01-31 0:14 ` Shaohua Li
2012-01-31 1:07 ` Wu Fengguang
2012-01-31 3:00 ` Shaohua Li
2012-01-31 2:17 ` Eric Dumazet
2012-01-31 8:46 ` Eric Dumazet
2012-01-31 6:36 ` Herbert Poetzl
2012-01-30 14:48 ` Wu Fengguang
2012-01-28 17:01 ` Herbert Poetzl
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20120130140109.GA15682@localhost \
--to=wfg@linux.intel.com \
--cc=akpm@linux-foundation.org \
--cc=axboe@kernel.dk \
--cc=eric.dumazet@gmail.com \
--cc=herbert@13thfloor.at \
--cc=linux-kernel@vger.kernel.org \
--cc=shaohua.li@intel.com \
--cc=tj@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.