From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([208.118.235.92]:46777) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UhA02-0002dI-R2 for qemu-devel@nongnu.org; Mon, 27 May 2013 22:51:07 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Uh9zt-00013G-Nm for qemu-devel@nongnu.org; Mon, 27 May 2013 22:50:58 -0400 Received: from fgwmail6.fujitsu.co.jp ([192.51.44.36]:54656) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Uh9zt-00012s-6W for qemu-devel@nongnu.org; Mon, 27 May 2013 22:50:49 -0400 Received: from m2.gw.fujitsu.co.jp (unknown [10.0.50.72]) by fgwmail6.fujitsu.co.jp (Postfix) with ESMTP id 164273EE0C1 for ; Tue, 28 May 2013 11:50:47 +0900 (JST) Received: from smail (m2 [127.0.0.1]) by outgoing.m2.gw.fujitsu.co.jp (Postfix) with ESMTP id 0557445DD78 for ; Tue, 28 May 2013 11:50:47 +0900 (JST) Received: from s2.gw.fujitsu.co.jp (s2.gw.fujitsu.co.jp [10.0.50.92]) by m2.gw.fujitsu.co.jp (Postfix) with ESMTP id D4A2145DDCF for ; Tue, 28 May 2013 11:50:46 +0900 (JST) Received: from s2.gw.fujitsu.co.jp (localhost.localdomain [127.0.0.1]) by s2.gw.fujitsu.co.jp (Postfix) with ESMTP id C932E1DB803F for ; Tue, 28 May 2013 11:50:46 +0900 (JST) Received: from s01.fujitsu.com (s01.gw.fujitsu.co.jp [133.161.11.16]) by s2.gw.fujitsu.co.jp (Postfix) with ESMTP id 73D1D1DB802C for ; Tue, 28 May 2013 11:50:46 +0900 (JST) Received: from s01.gw.fujitsu.co.jp (localhost [127.0.0.1]) by s01.fujitsu.com (Postfix) with ESMTP id 54277AC3C0 for ; Tue, 28 May 2013 11:50:46 +0900 (JST) Received: from localhost.localdomain (unknown [10.167.226.41]) by s01.fujitsu.com (Postfix) with ESMTP id 0D1EDAC3AF for ; Tue, 28 May 2013 11:50:46 +0900 (JST) From: qiaonuohan@cn.fujitsu.com Date: Tue, 28 May 2013 10:50:28 +0800 Message-Id: <1369709437-24969-1-git-send-email-qiaonuohan@cn.fujitsu.com> Subject: [Qemu-devel] [PATCH v4 0/9] Make 'dump-guest-memory' dump in kdump-compressed format List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: eblake@redhat.com, lcapitulino@redhat.com, afaerber@suse.de Cc: zhangxh@cn.fujitsu.com, kumagai-atsushi@mxc.nes.nec.co.jp, Qiao Nuohan , anderson@redhat.com, qemu-devel@nongnu.org From: Qiao Nuohan Hi, all The last version is here: http://lists.gnu.org/archive/html/qemu-devel/2013-05/msg02280.html Command 'dump-guest-memory' was introduced to dump guest's memory. But the vmcore's format is only elf32 or elf64. The message is here: http://lists.gnu.org/archive/html/qemu-devel/2012-04/msg03379.html For migration, 'dump-guest-memory' is supposed to support compression feature. Because of the regression, the missing of compression feature, we post these patches to make 'dump-guest-memory' be able to dump guest's in kdump-compressed format. Then vmcore can be much smaller, and easily be delivered. The kdump-compressed format is *linux specific* *linux standard* crash dump format used in kdump framework. The kdump-compressed format is readable only with the crash utility, and it can be smaller than the ELF format because of the compression support. Note, similar to 'dump-guest-memory': 1. The guest should be x86 or x86_64. The other arch is not supported now. 2. If the OS is in the second kernel, gdb may not work well, and crash can work by specifying '--machdep phys_addr=xxx' in the command line. The reason is that the second kernel will update the page table, and we can not get the page table for the first kernel. 3. The cpu's state is stored in QEMU note. 4. The vmcore are able to be compressed with zlib, lzo or snappy. zlib is available by default, and option '--enable-lzo' or '--enable-snappy' should be used with configure to make lzo or snappy available. Changelog: Changes from v3 to v4: 1. change to avoid conflict with Andreas's patches 2. rebase Changes from v2 to v3: 1. Address Eric's comment Changes from v1 to v2: 1. Address Eric & Daniel's comment: fix manner of string copy. 2. Address Eric's comment: replace reinventing new constants by using the ready-made ones accoring. 3. Address Andreas's comment: remove useless include. Qiao Nuohan (9): dump: Add API to manipulate dump_bitmap dump: Add API to manipulate cache_data dump: Move struct definition into dump_memroy.h dump: Add API to create header of vmcore dump: Add API to create data of dump bitmap dump: Add API to create page dump: Add API to free memory used by creating header, bitmap and page dump: Add API to write header, bitmap and page into vmcore dump: Make kdump-compressed format available for 'dump-guest-memory' Makefile.target | 1 + cache_data.c | 121 ++++++ configure | 50 +++ dump.c | 866 ++++++++++++++++++++++++++++++++++++++++-- dump_bitmap.c | 171 +++++++++ hmp-commands.hx | 12 +- hmp.c | 23 +- include/cache_data.h | 56 +++ include/dump_bitmap.h | 60 +++ include/sysemu/dump_memory.h | 178 +++++++++ qapi-schema.json | 22 +- qmp-commands.hx | 6 +- 12 files changed, 1526 insertions(+), 40 deletions(-) create mode 100644 cache_data.c create mode 100644 dump_bitmap.c create mode 100644 include/cache_data.h create mode 100644 include/dump_bitmap.h create mode 100644 include/sysemu/dump_memory.h