From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:47059) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1bnJdH-0004SP-2l for qemu-devel@nongnu.org; Fri, 23 Sep 2016 02:06:48 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1bnJdD-0005gT-Or for qemu-devel@nongnu.org; Fri, 23 Sep 2016 02:06:47 -0400 Received: from mx1.redhat.com ([209.132.183.28]:35972) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1bnJdD-0005ft-FA for qemu-devel@nongnu.org; Fri, 23 Sep 2016 02:06:43 -0400 References: <20160921113303.1420.63544.stgit@PASHA-ISP.def.inno> <20160921113309.1420.66285.stgit@PASHA-ISP.def.inno> From: Jason Wang Message-ID: <4d7877c8-21dc-3286-2f98-70aa36d16c0c@redhat.com> Date: Fri, 23 Sep 2016 14:06:33 +0800 MIME-Version: 1.0 In-Reply-To: <20160921113309.1420.66285.stgit@PASHA-ISP.def.inno> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable Subject: Re: [Qemu-devel] [PATCH v4 1/8] record/replay: add network support List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: Pavel Dovgalyuk , qemu-devel@nongnu.org Cc: peter.maydell@linaro.org, quintela@redhat.com, pbonzini@redhat.com, mst@redhat.com On 2016=E5=B9=B409=E6=9C=8821=E6=97=A5 19:33, Pavel Dovgalyuk wrote: > This patch adds support of recording and replaying network packets in > irount rr mode. > > Record and replay for network interactions is performed with the networ= k filter. > Each backend must have its own instance of the replay filter as follows= : > -netdev user,id=3Dnet1 -device rtl8139,netdev=3Dnet1 > -object filter-replay,id=3Dreplay,netdev=3Dnet1 > > Replay network filter is used to record and replay network packets. Whi= le > recording the virtual machine this filter puts all packets coming from > the outer world into the log. In replay mode packets from the log are > injected into the network device. All interactions with network backend > in replay mode are disabled. > > Signed-off-by: Pavel Dovgalyuk Looks good, just few nits, see below. Thanks > --- > docs/replay.txt | 14 ++++++ > include/sysemu/replay.h | 12 +++++ > net/Makefile.objs | 1 > net/filter-replay.c | 92 +++++++++++++++++++++++++++++++++++++= + > replay/Makefile.objs | 1 > replay/replay-events.c | 11 +++++ > replay/replay-internal.h | 10 ++++ > replay/replay-net.c | 111 +++++++++++++++++++++++++++++++++++++= +++++++++ > replay/replay.c | 2 - > vl.c | 3 + > 10 files changed, 255 insertions(+), 2 deletions(-) > create mode 100644 net/filter-replay.c > create mode 100644 replay/replay-net.c > > diff --git a/docs/replay.txt b/docs/replay.txt > index 779c6c0..347b2ff 100644 > --- a/docs/replay.txt > +++ b/docs/replay.txt > @@ -195,3 +195,17 @@ Queue is flushed at checkpoints and information ab= out processed requests > is recorded to the log. In replay phase the queue is matched with > events read from the log. Therefore block devices requests are proces= sed > deterministically. > + > +Network devices > +--------------- > + > +Record and replay for network interactions is performed with the netwo= rk filter. > +Each backend must have its own instance of the replay filter as follow= s: > + -netdev user,id=3Dnet1 -device rtl8139,netdev=3Dnet1 > + -object filter-replay,id=3Dreplay,netdev=3Dnet1 > + > +Replay network filter is used to record and replay network packets. Wh= ile > +recording the virtual machine this filter puts all packets coming from > +the outer world into the log. In replay mode packets from the log are > +injected into the network device. All interactions with network backen= d > +in replay mode are disabled. > diff --git a/include/sysemu/replay.h b/include/sysemu/replay.h > index 0a88393..a408633 100644 > --- a/include/sysemu/replay.h > +++ b/include/sysemu/replay.h > @@ -39,6 +39,8 @@ enum ReplayCheckpoint { > }; > typedef enum ReplayCheckpoint ReplayCheckpoint; > =20 > +typedef struct ReplayNetState ReplayNetState; > + > extern ReplayMode replay_mode; > =20 > /* Replay process control functions */ > @@ -133,4 +135,14 @@ void replay_char_read_all_save_error(int res); > /*! Writes character read_all execution result into the replay log. *= / > void replay_char_read_all_save_buf(uint8_t *buf, int offset); > =20 > +/* Network */ > + > +/*! Registers replay network filter attached to some backend. */ > +ReplayNetState *replay_register_net(NetFilterState *nfs); > +/*! Unregisters replay network filter. */ > +void replay_unregister_net(ReplayNetState *rns); > +/*! Called to write network packet to the replay log. */ > +void replay_net_packet_event(ReplayNetState *rns, unsigned flags, > + const struct iovec *iov, int iovcnt); > + > #endif > diff --git a/net/Makefile.objs b/net/Makefile.objs > index b7c22fd..f787ba4 100644 > --- a/net/Makefile.objs > +++ b/net/Makefile.objs > @@ -16,3 +16,4 @@ common-obj-$(CONFIG_NETMAP) +=3D netmap.o > common-obj-y +=3D filter.o > common-obj-y +=3D filter-buffer.o > common-obj-y +=3D filter-mirror.o > +common-obj-y +=3D filter-replay.o > diff --git a/net/filter-replay.c b/net/filter-replay.c > new file mode 100644 > index 0000000..cff65f8 > --- /dev/null > +++ b/net/filter-replay.c > @@ -0,0 +1,92 @@ > +/* > + * filter-replay.c > + * > + * Copyright (c) 2010-2016 Institute for System Programming > + * of the Russian Academy of Sciences. > + * > + * This work is licensed under the terms of the GNU GPL, version 2 or = later. > + * See the COPYING file in the top-level directory. > + * > + */ > + > +#include "qemu/osdep.h" > +#include "clients.h" > +#include "qapi/error.h" > +#include "qemu-common.h" > +#include "qemu/error-report.h" > +#include "qemu/iov.h" > +#include "qemu/log.h" > +#include "qemu/timer.h" > +#include "qapi/visitor.h" > +#include "net/filter.h" > +#include "sysemu/replay.h" > + > +#define TYPE_FILTER_REPLAY "filter-replay" > + > +#define FILTER_REPLAY(obj) \ > + OBJECT_CHECK(NetFilterReplayState, (obj), TYPE_FILTER_REPLAY) > + > +struct NetFilterReplayState { > + NetFilterState nfs; > + ReplayNetState *rns; > +}; > +typedef struct NetFilterReplayState NetFilterReplayState; > + > +static ssize_t filter_replay_receive_iov(NetFilterState *nf, > + NetClientState *sndr, > + unsigned flags, > + const struct iovec *iov, > + int iovcnt, NetPacketSent *se= nt_cb) > +{ > + NetFilterReplayState *nfrs =3D FILTER_REPLAY(nf); > + switch (replay_mode) { > + case REPLAY_MODE_RECORD: > + if (nf->netdev =3D=3D sndr) { > + replay_net_packet_event(nfrs->rns, flags, iov, iovcnt); > + return iov_size(iov, iovcnt); > + } > + return 0; > + case REPLAY_MODE_PLAY: > + /* Drop all packets in replay mode. > + Packets from the log will be injected by the replay module.= */ > + return iov_size(iov, iovcnt); > + default: > + /* Pass all the packets. */ > + return 0; > + } > +} > + > +static void filter_replay_instance_init(Object *obj) > +{ > + NetFilterReplayState *nfrs =3D FILTER_REPLAY(obj); > + nfrs->rns =3D replay_register_net(&nfrs->nfs); > +} > + > +static void filter_replay_instance_finalize(Object *obj) > +{ > + NetFilterReplayState *nfrs =3D FILTER_REPLAY(obj); > + replay_unregister_net(nfrs->rns); > +} > + > +static void filter_replay_class_init(ObjectClass *oc, void *data) > +{ > + NetFilterClass *nfc =3D NETFILTER_CLASS(oc); > + > + nfc->receive_iov =3D filter_replay_receive_iov; > +} > + > +static const TypeInfo filter_replay_info =3D { > + .name =3D TYPE_FILTER_REPLAY, > + .parent =3D TYPE_NETFILTER, > + .class_init =3D filter_replay_class_init, > + .instance_init =3D filter_replay_instance_init, > + .instance_finalize =3D filter_replay_instance_finalize, > + .instance_size =3D sizeof(NetFilterReplayState), > +}; > + > +static void filter_replay_register_types(void) > +{ > + type_register_static(&filter_replay_info); > +} > + > +type_init(filter_replay_register_types); > diff --git a/replay/Makefile.objs b/replay/Makefile.objs > index fcb3f74..f55a6b5 100644 > --- a/replay/Makefile.objs > +++ b/replay/Makefile.objs > @@ -4,3 +4,4 @@ common-obj-y +=3D replay-events.o > common-obj-y +=3D replay-time.o > common-obj-y +=3D replay-input.o > common-obj-y +=3D replay-char.o > +common-obj-y +=3D replay-net.o > diff --git a/replay/replay-events.c b/replay/replay-events.c > index 3807245..9ce9e51 100644 > --- a/replay/replay-events.c > +++ b/replay/replay-events.c > @@ -54,6 +54,9 @@ static void replay_run_event(Event *event) > case REPLAY_ASYNC_EVENT_BLOCK: > aio_bh_call(event->opaque); > break; > + case REPLAY_ASYNC_EVENT_NET: > + replay_event_net_run(event->opaque); > + break; > default: > error_report("Replay: invalid async event ID (%d) in the queu= e", > event->event_kind); > @@ -189,6 +192,9 @@ static void replay_save_event(Event *event, int che= ckpoint) > case REPLAY_ASYNC_EVENT_BLOCK: > replay_put_qword(event->id); > break; > + case REPLAY_ASYNC_EVENT_NET: > + replay_event_net_save(event->opaque); > + break; > default: > error_report("Unknown ID %" PRId64 " of replay event", ev= ent->id); > exit(1); > @@ -252,6 +258,11 @@ static Event *replay_read_event(int checkpoint) > read_id =3D replay_get_qword(); > } > break; > + case REPLAY_ASYNC_EVENT_NET: > + event =3D g_malloc0(sizeof(Event)); > + event->event_kind =3D read_event_kind; > + event->opaque =3D replay_event_net_load(); > + return event; > default: > error_report("Unknown ID %d of replay event", read_event_kind= ); > exit(1); > diff --git a/replay/replay-internal.h b/replay/replay-internal.h > index efbf14c..d28cfb7 100644 > --- a/replay/replay-internal.h > +++ b/replay/replay-internal.h > @@ -50,6 +50,7 @@ enum ReplayAsyncEventKind { > REPLAY_ASYNC_EVENT_INPUT_SYNC, > REPLAY_ASYNC_EVENT_CHAR_READ, > REPLAY_ASYNC_EVENT_BLOCK, > + REPLAY_ASYNC_EVENT_NET, > REPLAY_ASYNC_COUNT > }; > =20 > @@ -155,4 +156,13 @@ void replay_event_char_read_save(void *opaque); > /*! Reads char event read from the file. */ > void *replay_event_char_read_load(void); > =20 > +/* Network devices */ > + > +/*! Called to run network event. */ > +void replay_event_net_run(void *opaque); > +/*! Writes network event to the file. */ > +void replay_event_net_save(void *opaque); > +/*! Reads network from the file. */ > +void *replay_event_net_load(void); > + > #endif > diff --git a/replay/replay-net.c b/replay/replay-net.c > new file mode 100644 > index 0000000..4f7b995 > --- /dev/null > +++ b/replay/replay-net.c > @@ -0,0 +1,111 @@ > +/* > + * replay-net.c > + * > + * Copyright (c) 2010-2016 Institute for System Programming > + * of the Russian Academy of Sciences. > + * > + * This work is licensed under the terms of the GNU GPL, version 2 or = later. > + * See the COPYING file in the top-level directory. > + * > + */ > + > +#include "qemu/osdep.h" > +#include "qemu/error-report.h" > +#include "sysemu/replay.h" > +#include "replay-internal.h" > +#include "sysemu/sysemu.h" > +#include "net/net.h" > +#include "net/filter.h" > +#include "qemu/iov.h" > + > +struct ReplayNetState { > + NetFilterState *nfs; > + int id; > +}; > + > +typedef struct NetEvent { > + uint8_t id; > + uint32_t flags; > + uint8_t *data; > + size_t size; > +} NetEvent; > + > +static NetFilterState **network_filters; > +static int network_filters_count; > + > +ReplayNetState *replay_register_net(NetFilterState *nfs) > +{ > + ReplayNetState *rns =3D g_new0(ReplayNetState, 1); > + rns->nfs =3D nfs; > + rns->id =3D network_filters_count++; > + network_filters =3D g_realloc(network_filters, > + network_filters_count > + * sizeof(*network_filters)); Any chance to avoid maintaining such array? E.g by having a pointer to=20 NetFilterState in each NetEvent? > + network_filters[network_filters_count - 1] =3D nfs; > + return rns; > +} > + > +void replay_unregister_net(ReplayNetState *rns) > +{ > + network_filters[rns->id] =3D NULL; > + g_free(rns); > +} > + > +void replay_net_packet_event(ReplayNetState *rns, unsigned flags, > + const struct iovec *iov, int iovcnt) > +{ > + NetEvent *event; > + int i; > + > + event =3D g_new(NetEvent, 1); > + event->flags =3D flags; > + event->data =3D g_malloc(iov_size(iov, iovcnt)); > + event->size =3D 0; > + event->id =3D rns->id; > + > + for (i =3D 0; i < iovcnt; i++) { > + size_t len =3D iov[i].iov_len; > + > + memcpy(event->data + event->size, iov[i].iov_base, len); > + event->size +=3D len; > + } You can use iov_to_buf() instead. > + > + replay_add_event(REPLAY_ASYNC_EVENT_NET, event, NULL, 0); > +} > + > +void replay_event_net_run(void *opaque) > +{ > + NetEvent *event =3D opaque; > + struct iovec iov =3D { > + .iov_base =3D (void *)event->data, > + .iov_len =3D event->size > + }; > + > + assert(event->id < network_filters_count); > + > + qemu_netfilter_pass_to_next(network_filters[event->id]->netdev, > + event->flags, &iov, 1, network_filters[event->id]); > + > + g_free(event->data); > + g_free(event); > +} > + > +void replay_event_net_save(void *opaque) > +{ > + NetEvent *event =3D opaque; > + > + replay_put_byte(event->id); > + replay_put_dword(event->flags); > + replay_put_array(event->data, event->size); > +} > + > +void *replay_event_net_load(void) > +{ > + NetEvent *event =3D g_new(NetEvent, 1); > + > + event->id =3D replay_get_byte(); > + event->flags =3D replay_get_dword(); > + replay_get_array_alloc(&event->data, &event->size); > + > + return event; > +} > diff --git a/replay/replay.c b/replay/replay.c > index 167fd29..e040f6f 100644 > --- a/replay/replay.c > +++ b/replay/replay.c > @@ -21,7 +21,7 @@ > =20 > /* Current version of the replay mechanism. > Increase it when file format changes. */ > -#define REPLAY_VERSION 0xe02004 > +#define REPLAY_VERSION 0xe02005 > /* Size of replay log header */ > #define HEADER_SIZE (sizeof(uint32_t) + sizeof(uint64= _t)) > =20 > diff --git a/vl.c b/vl.c > index fca0487..fd7f17e 100644 > --- a/vl.c > +++ b/vl.c > @@ -2807,7 +2807,8 @@ static bool object_create_initial(const char *typ= e) > if (g_str_equal(type, "filter-buffer") || > g_str_equal(type, "filter-dump") || > g_str_equal(type, "filter-mirror") || > - g_str_equal(type, "filter-redirector")) { > + g_str_equal(type, "filter-redirector") || > + g_str_equal(type, "filter-replay")) { > return false; > } > =20 >