From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:36915) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1V9fpv-0006uv-IS for qemu-devel@nongnu.org; Wed, 14 Aug 2013 14:30:28 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1V9fpn-0002Ee-Ma for qemu-devel@nongnu.org; Wed, 14 Aug 2013 14:30:23 -0400 Received: from nodalink.pck.nerim.net ([62.212.105.220]:57086 helo=paradis.irqsave.net) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1V9fpm-0002DG-Ua for qemu-devel@nongnu.org; Wed, 14 Aug 2013 14:30:15 -0400 Date: Wed, 14 Aug 2013 20:31:58 +0200 From: =?iso-8859-1?Q?Beno=EEt?= Canet Message-ID: <20130814183158.GC5281@irqsave.net> References: <1376326396-7676-1-git-send-email-benoit@irqsave.net> <1376326396-7676-6-git-send-email-benoit@irqsave.net> <20130814094846.GD11081@localhost.localdomain> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline In-Reply-To: <20130814094846.GD11081@localhost.localdomain> Content-Transfer-Encoding: quoted-printable Subject: Re: [Qemu-devel] [PATCH V5 5/5] block: Add iops_sector_count to do the iops accounting for a given io size. List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: Fam Zheng Cc: kwolf@redhat.com, pbonzini@redhat.com, qemu-devel@nongnu.org, stefanha@redhat.com Le Wednesday 14 Aug 2013 =E0 17:48:46 (+0800), Fam Zheng a =E9crit : > On Mon, 08/12 18:53, Beno=EEt Canet wrote: > > This feature can be used in case where users are avoiding the iops li= mit by > > doing jumbo I/Os hammering the storage backend. > >=20 > You are accounting io ops by the op size: > (unit =3D size / iops_sector_count), which is equivelant to bps. So I'= m > still not understanding why can't such jumbo IO be throttled by bps > limits. I am aiming at providing to the users an amazon like feature set. http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/AmazonEBS.html >>From the provisioned volume section: The read and write operations have a block size of 16 KB or less. If the = I/O increases above 16 KB, the IOPS delivered drop in proportion to the incre= ase in the size of the I/O. For example, a 1000 IOPS volume can deliver 1000 16 = KB writes per second, 500 32 KB writes per second, or 250 64 KB writes per s= econd. Best regards Beno=EEt >=20 > > Signed-off-by: Benoit Canet > > --- > > block/qapi.c | 3 +++ > > blockdev.c | 22 +++++++++++++++++++--- > > hmp.c | 8 ++++++-- > > qapi-schema.json | 10 ++++++++-- > > qemu-options.hx | 2 +- > > qmp-commands.hx | 8 ++++++-- > > 6 files changed, 43 insertions(+), 10 deletions(-) > >=20 > > diff --git a/block/qapi.c b/block/qapi.c > > index 5ba10f4..f98ff64 100644 > > --- a/block/qapi.c > > +++ b/block/qapi.c > > @@ -258,6 +258,9 @@ void bdrv_query_info(BlockDriverState *bs, > > cfg.buckets[THROTTLE_OPS_WRITE].max; > > info->inserted->iops_wr_max =3D > > cfg.buckets[THROTTLE_OPS_WRITE].max; > > + > > + info->inserted->has_iops_sector_count =3D cfg.op_size; > > + info->inserted->iops_sector_count =3D cfg.op_size; > > } > > =20 > > bs0 =3D bs; > > diff --git a/blockdev.c b/blockdev.c > > index 22016a2..e2b0ee0 100644 > > --- a/blockdev.c > > +++ b/blockdev.c > > @@ -500,7 +500,7 @@ static DriveInfo *blockdev_init(QemuOpts *all_opt= s, > > qemu_opt_get_number(opts, "throttling.iops-write-max", 0); > > =20 > > cfg.unit_size =3D BDRV_SECTOR_SIZE; > > - cfg.op_size =3D 0; > > + cfg.op_size =3D qemu_opt_get_number(opts, "throttling.iops-secto= r-count", 0); > > =20 > > if (!check_throttle_config(&cfg, &error)) { > > error_report("%s", error_get_pretty(error)); > > @@ -786,6 +786,9 @@ DriveInfo *drive_init(QemuOpts *all_opts, BlockIn= terfaceType block_default_type) > > qemu_opt_rename(all_opts, "bps_rd_max", "throttling.bps-read-max= "); > > qemu_opt_rename(all_opts, "bps_wr_max", "throttling.bps-write-ma= x"); > > =20 > > + qemu_opt_rename(all_opts, > > + "iops_sector_count", "throttling.iops-sector-cou= nt"); > > + > > qemu_opt_rename(all_opts, "readonly", "read-only"); > > =20 > > value =3D qemu_opt_get(all_opts, "cache"); > > @@ -1285,7 +1288,9 @@ void qmp_block_set_io_throttle(const char *devi= ce, int64_t bps, int64_t bps_rd, > > bool has_iops_rd_max, > > int64_t iops_rd_max, > > bool has_iops_wr_max, > > - int64_t iops_wr_max, Error **errp) > > + int64_t iops_wr_max, > > + bool has_iops_sector_count, > > + int64_t iops_sector_count, Error **er= rp) > > { > > ThrottleConfig cfg; > > BlockDriverState *bs; > > @@ -1325,7 +1330,10 @@ void qmp_block_set_io_throttle(const char *dev= ice, int64_t bps, int64_t bps_rd, > > } > > =20 > > cfg.unit_size =3D BDRV_SECTOR_SIZE; > > - cfg.op_size =3D 0; > > + > > + if (has_iops_sector_count) { > > + cfg.op_size =3D iops_sector_count; > > + } > > =20 > > if (!check_throttle_config(&cfg, errp)) { > > return; > > @@ -2051,6 +2059,10 @@ QemuOptsList qemu_common_drive_opts =3D { > > .type =3D QEMU_OPT_NUMBER, > > .help =3D "total bytes write burst", > > },{ > > + .name =3D "throttling.iops-sector-count", > > + .type =3D QEMU_OPT_NUMBER, > > + .help =3D "when limiting by iops max size of an I/O in s= ector", > > + },{ > > .name =3D "copy-on-read", > > .type =3D QEMU_OPT_BOOL, > > .help =3D "copy read data from backing file into image f= ile", > > @@ -2197,6 +2209,10 @@ QemuOptsList qemu_old_drive_opts =3D { > > .type =3D QEMU_OPT_NUMBER, > > .help =3D "total bytes write burst", > > },{ > > + .name =3D "iops_sector_count", > > + .type =3D QEMU_OPT_NUMBER, > > + .help =3D "when limiting by iops max size of an I/O in s= ector", > > + },{ > > .name =3D "copy-on-read", > > .type =3D QEMU_OPT_BOOL, > > .help =3D "copy read data from backing file into image f= ile", > > diff --git a/hmp.c b/hmp.c > > index e0c387c..01f7685 100644 > > --- a/hmp.c > > +++ b/hmp.c > > @@ -351,7 +351,8 @@ void hmp_info_block(Monitor *mon, const QDict *qd= ict) > > " iops_wr=3D%" PRId64 > > " iops_max=3D%" PRId64 > > " iops_rd_max=3D%" PRId64 > > - " iops_wr_max=3D%" PRId64 "\n", > > + " iops_wr_max=3D%" PRId64 > > + " iops_sector_count=3D%" PRId64 "\n", > > info->value->inserted->bps, > > info->value->inserted->bps_rd, > > info->value->inserted->bps_wr, > > @@ -363,7 +364,8 @@ void hmp_info_block(Monitor *mon, const QDict *qd= ict) > > info->value->inserted->iops_wr, > > info->value->inserted->iops_max, > > info->value->inserted->iops_rd_max, > > - info->value->inserted->iops_wr_max); > > + info->value->inserted->iops_wr_max, > > + info->value->inserted->iops_sector_count= ); > > } else { > > monitor_printf(mon, " [not inserted]"); > > } > > @@ -1124,6 +1126,8 @@ void hmp_block_set_io_throttle(Monitor *mon, co= nst QDict *qdict) > > false, > > 0, > > false, > > + 0, > > + false, /* No default I/O size */ > > 0, &err); > > hmp_handle_error(mon, &err); > > } > > diff --git a/qapi-schema.json b/qapi-schema.json > > index 5e5461e..c7b1d5e 100644 > > --- a/qapi-schema.json > > +++ b/qapi-schema.json > > @@ -797,6 +797,8 @@ > > # > > # @iops_wr_max: #optional write I/O operations max (Since 1.7) > > # > > +# @iops_sector_count: #optional an I/O size in sector (Since 1.6) > > +# > > # Since: 0.14.0 > > # > > # Notes: This interface is only found in @BlockInfo. > > @@ -810,7 +812,8 @@ > > 'image': 'ImageInfo', > > '*bps_max': 'int', '*bps_rd_max': 'int', > > '*bps_wr_max': 'int', '*iops_max': 'int', > > - '*iops_rd_max': 'int', '*iops_wr_max': 'int' }} > > + '*iops_rd_max': 'int', '*iops_wr_max': 'int', > > + '*iops_sector_count': 'int' } } > > =20 > > ## > > # @BlockDeviceIoStatus: > > @@ -2201,6 +2204,8 @@ > > # > > # @iops_wr_max: #optional write I/O operations max (Since 1.7) > > # > > +# @iops_sector_count: #optional an I/O size in sector (Since 1.6) > > +# > > # Returns: Nothing on success > > # If @device is not a valid block device, DeviceNotFound > > # > > @@ -2211,7 +2216,8 @@ > > 'iops': 'int', 'iops_rd': 'int', 'iops_wr': 'int', > > '*bps_max': 'int', '*bps_rd_max': 'int', > > '*bps_wr_max': 'int', '*iops_max': 'int', > > - '*iops_rd_max': 'int', '*iops_wr_max': 'int' }} > > + '*iops_rd_max': 'int', '*iops_wr_max': 'int', > > + '*iops_sector_count': 'int' }} > > =20 > > ## > > # @block-stream: > > diff --git a/qemu-options.hx b/qemu-options.hx > > index 3aa8f9e..c539dd0 100644 > > --- a/qemu-options.hx > > +++ b/qemu-options.hx > > @@ -411,7 +411,7 @@ DEF("drive", HAS_ARG, QEMU_OPTION_drive, > > " [,readonly=3Don|off][,copy-on-read=3Don|off]\n" > > " [[,bps=3Db]|[[,bps_rd=3Dr][,bps_wr=3Dw]]][[,iops=3Di]|[[= ,iops_rd=3Dr]" > > " [,iops_wr=3Dw][,bps_max=3Dbt]|[[,bps_rd_max=3Drt][,bps_= wr_max=3Dwt]]]" > > - " [[,iops_max=3Dit]|[[,iops_rd_max=3Drt][,iops_wr_max=3Dwt= ]]\n" > > + " [[,iops_max=3Dit]|[[,iops_rd_max=3Drt][,iops_wr_max=3Dwt= ][,iops_sector_count=3Dcnt]]\n" > > " use 'file' as a drive image\n", QEMU_ARCH_ALL) > > STEXI > > @item -drive @var{option}[,@var{option}[,@var{option}[,...]]] > > diff --git a/qmp-commands.hx b/qmp-commands.hx > > index 1610831..bcd255f 100644 > > --- a/qmp-commands.hx > > +++ b/qmp-commands.hx > > @@ -1389,7 +1389,7 @@ EQMP > > =20 > > { > > .name =3D "block_set_io_throttle", > > - .args_type =3D "device:B,bps:l,bps_rd:l,bps_wr:l,iops:l,iop= s_rd:l,iops_wr:l,bps_max:l?,bps_rd_max:l?,bps_wr_max:l?,iops_max:l?,iops_= rd_max:l?,iops_wr_max:l?", > > + .args_type =3D "device:B,bps:l,bps_rd:l,bps_wr:l,iops:l,iop= s_rd:l,iops_wr:l,bps_max:l?,bps_rd_max:l?,bps_wr_max:l?,iops_max:l?,iops_= rd_max:l?,iops_wr_max:l?,iops_sector_count:l?", > > .mhandler.cmd_new =3D qmp_marshal_input_block_set_io_throttl= e, > > }, > > =20 > > @@ -1414,6 +1414,7 @@ Arguments: > > - "iops_max": total I/O operations max(json-int) > > - "iops_rd_max": read I/O operations max(json-int) > > - "iops_wr_max": write I/O operations max(json-int) > > +- "iops_sector_count": I/O sector count when limiting(json-int) > > =20 > > Example: > > =20 > > @@ -1429,7 +1430,8 @@ Example: > > "bps_wr_max": "0", > > "iops_max": "0", > > "iops_rd_max": "0", > > - "iops_wr_max": "0" }=A0= } > > + "iops_wr_max": "0", > > + "iops_sector_count": = "0" } } > > <- { "return": {} } > > =20 > > EQMP > > @@ -1776,6 +1778,7 @@ Each json-object contain the following: > > - "iops_max": total I/O operations max(json-int) > > - "iops_rd_max": read I/O operations max(json-int) > > - "iops_wr_max": write I/O operations max(json-int) > > + - "iops_sector_count": I/O sector count when limiting(json= -int) > > - "image": the detail of the image, it is a json-object con= taining > > the following: > > - "filename": image file name (json-string) > > @@ -1851,6 +1854,7 @@ Example: > > "iops_max": "0", > > "iops_rd_max": "0", > > "iops_wr_max": "0", > > + "iops_sector_count": "0", > > "image":{ > > "filename":"disks/test.qcow2", > > "format":"qcow2", > > --=20 > > 1.7.10.4 > >=20 > >=20 >=20