Re: ARM: Issues while Enabling hibernation in domU(linux) on jacinto-j6

[moin anjnawala <moinanjnawala@gmail.com>]

Hi Julien,
As you specified earlier I am now able to boot using xen4.10. I am
using linux4.4 as dom0 as well as domU.In domU, I have enabled
hibenation related configs and I am trying suspend to disk.With xen
4.10, hibernation is done sucessfuly but resume crashes.
I have used given config file for domU.
name = "domU"
kernel = "/ZI-uh1"
memory = 200
vcpus = 1
cpus = 1
disk = [ 'phy:/rfs1.img,xvda,rw']

extra = 'no_console_suspend loglevel=8 console=hvc0 xenconsole=tty
earlyprintk=xx
en rw dhcp=off resume=/dev/xvda resume_offset=331776 root=/dev/xvda rootwait'

The hibernate(domU console) and resume logs are shown as below:


root@debian-jessie:~# swapon /swapfile.img

swapon: /swapfile.img: insecure permissions 0644, 0600 suggested.
[   50.064545] Adding 102396k swap on /swapfile.img.  Priority:-1
extents:1 across:102396k SS
root@debian-jessie:~#
root@debian-jessie:~#
root@debian-jessie:~# echo disk > /sys/power/state
[   56.649793] PM: Syncing filesystems ... done.
[   56.686770] Freezing user space processes ... (elapsed 0.002 seconds) done.
[   56.689454] PM: Basic memory bitmaps created
[   56.689497] PM: Preallocating image memory... done (allocated 11077 pages)
[   57.119960] PM: Allocated 44308 kbytes in 0.43 seconds (103.04 MB/s)
[   57.120010] Freezing remaining freezable tasks ... (elapsed 0.009
seconds) done.
[   58.922629] PM: freeze of devices complete after 1791.756 msecs
[   58.925167] PM: late freeze of devices complete after 2.485 msecs
[   58.927231] PM: noirq freeze of devices complete after 2.010 msecs
[   58.927275] Disabling non-boot CPUs ...
[   58.927307] PM: Creating hibernation image:
[   58.927307] PM: Need to copy 10790 pages
[   58.927307] PM: Normal pages needed: 10790 + 1024, available pages: 40398
[   58.927307] PM: Hibernation image created (10790 pages copied)
[   58.928629] PM: noirq thaw of devices complete after 1.310 msecs
[   58.930334] PM: early thaw of devices complete after 1.589 msecs
[   60.634498] PM: thaw of devices complete after 1704.114 msecs
[   60.635878] PM: writing image.
[   60.680038] PM: Using 1 thread(s) for compression.
[   60.680038] PM: Compressing and saving image data (10801 pages)...
[   60.680170] PM: Image saving progress:   0%
[   61.288932] PM: Image saving progress:  10%
[   61.809937] PM: Image saving progress:  20%
[   61.994594] PM: Image saving progress:  30%
[   62.360616] PM: Image saving progress:  40%
[   62.583613] random: nonblocking pool is initialized
[   62.592295] PM: Image saving progress:  50%
[   62.665052] PM: Image saving progress:  60%
[   62.700022] PM: Image saving progress:  70%
[   62.759685] PM: Image saving progress:  80%
[   62.821796] PM: Image saving progress:  90%
[   62.854694] PM: Image saving progress: 100%
[   62.855175] PM: Image saving done.
[   62.855210] PM: Wrote 43204 kbytes in 2.17 seconds (19.90 MB/s)
[   62.863308] PM: S|
[   62.921029] reboot: Power down
root@Dom0:~#
root@Dom0:~#
root@Dom0:~#
root@Dom0:~#
root@Dom0:~#
root@Dom0:~#
root@Dom0:~#
root@Dom0:~#
root@Dom0:~# xl create -c /vnc_l.cfg
Parsing config from /vnc_l.cfg
(XEN) d2v0: vGICD: unhandled word write 0xffffffff to ICACTIVER0
[    0.000000] Booting Linux on physical CPU 0x0
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 4.4.91-00002-g89baae6-dirty
(omkar.bolla@CPU-308U) (gcc version 4.8.4 (Ubuntu/Linaro
4.8.4-2ubuntu1~14.04.1) ) #107 SMP PR
EEMPT Tue Jun 5 16:51:21 IST 2018
[    0.000000] CPU: ARMv7 Processor [412fc0f2] revision 2 (ARMv7), cr=50c5387d
[    0.000000] CPU: PIPT / VIPT nonaliasing data cache, PIPT instruction cache
[    0.000000] Machine model: XENVM-4.10
[    0.000000] cma: Reserved 24 MiB at 0x4b000000
[    0.000000] Memory policy: Data cache writealloc
[    0.000000] On node 0 totalpages: 51200
[    0.000000] free_area_init_node: node 0, pgdat c07eb740,
node_mem_map cae2b000
[    0.000000]   Normal zone: 450 pages used for memmap
[    0.000000]   Normal zone: 0 pages reserved
[    0.000000]   Normal zone: 51200 pages, LIFO batch:15
[    0.000000] psci: probing for conduit method from DT.
[    0.000000] psci: PSCIv1.1 detected in firmware.
[    0.000000] psci: Using standard PSCI v0.2 function IDs
[    0.000000] psci: Trusted OS migration not required
[    0.000000] Xen 4.10 support found
[    0.000000] PERCPU: Embedded 11 pages/cpu @cae1d000 s15872 r8192
d20992 u45056
[    0.000000] pcpu-alloc: s15872 r8192 d20992 u45056 alloc=11*4096
[    0.000000] pcpu-alloc: [0] 0
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.
Total pages: 50750
[    0.000000] Kernel command line: no_console_suspend loglevel=8
console=hvc0 xenconsole=tty earlyprintk=xen rw dhcp=off
resume=/dev/xvda resume_offse
t=331776 root=/dev/xvda rootwait xen-fbfront.video=2,1024,768
[    0.000000] PID hash table entries: 1024 (order: 0, 4096 bytes)
[    0.000000] Dentry cache hash table entries: 32768 (order: 5, 131072 bytes)
[    0.000000] Inode-cache hash table entries: 16384 (order: 4, 65536 bytes)
[    0.000000] Memory: 169692K/204800K available (4636K kernel code,
383K rwdata, 2568K rodata, 280K init, 295K bss, 10532K reserved,
24576K cma-reserv
ed, 0K highmem)
[    0.000000] Virtual kernel memory layout:
[    0.000000]     vector  : 0xffff0000 - 0xffff1000   (   4 kB)
[    0.000000]     fixmap  : 0xffc00000 - 0xfff00000   (3072 kB)
[    0.000000]     vmalloc : 0xcd000000 - 0xff800000   ( 808 MB)
[    0.000000]     lowmem  : 0xc0000000 - 0xcc800000   ( 200 MB)
[    0.000000]     pkmap   : 0xbfe00000 - 0xc0000000   (   2 MB)
[    0.000000]     modules : 0xbf800000 - 0xbfe00000   (   6 MB)
[    0.000000]       .text : 0xc0008000 - 0xc048f2c4   (4637 kB)
[    0.000000]       .init : 0xc0748000 - 0xc078e000   ( 280 kB)
[    0.000000]       .data : 0xc078e000 - 0xc07ede40   ( 384 kB)
[    0.000000]        .bss : 0xc07ef000 - 0xc0838dd8   ( 296 kB)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.000000] Preemptible hierarchical RCU implementation.
[    0.000000]  Build-time adjustment of leaf fanout to 32.
[    0.000000]  RCU restricting CPUs from NR_CPUS=2 to nr_cpu_ids=1.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=32, nr_cpu_ids=1
[    0.000000] NR_IRQS:16 nr_irqs:16 16
[    0.000000] Architected cp15 timer(s) running at 6.14MHz (virt).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff
max_cycles: 0x16ac02862, max_idle_ns: 440795202218 ns
[    0.000003] sched_clock: 56 bits at 6MHz, resolution 162ns, wraps
every 4398046511085ns
[    0.000012] Switching to timer-based delay loop, resolution 162ns
[    0.000106] Console: colour dummy device 80x30
[    0.002199] console [hvc0] enabled
[    0.002245] Calibrating delay loop (skipped), value calculated
using timer frequency.. 12.28 BogoMIPS (lpj=61440)
[    0.002318] pid_max: default: 32768 minimum: 301
[    0.002451] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes)
[    0.002498] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes)
[    0.003131] Initializing cgroup subsys io
[    0.003173] Initializing cgroup subsys memory
[    0.003231] Initializing cgroup subsys devices
[    0.003275] Initializing cgroup subsys freezer
[    0.003318] Initializing cgroup subsys perf_event
[    0.003360] Initializing cgroup subsys pids
[    0.003414] CPU: Testing write buffer coherency: ok
[    0.003668] /cpus/cpu@0 missing clock-frequency property
[    0.003712] CPU0: update cpu_capacity 1024
[    0.003744] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
[    0.004068] xen:grant_table: Grant tables using version 1 layout
[    0.004156] Grant table initialized
[    0.004234] xen:events: Using FIFO-based ABI
[    0.004284] Xen: initializing cpu0
[    0.004390] Setting up static identity map for 0x40008240 - 0x40008294
[    0.050408] Brought up 1 CPUs
[    0.050445] SMP: Total of 1 processors activated (12.28 BogoMIPS).
[    0.226433] CPU: All CPU(s) started in SVC mode.
[    0.226486] CPU0: update max cpu_capacity 1024
[    0.227460] devtmpfs: initialized
[    0.236617] VFP support v0.3: implementor 41 architecture 4 part 30
variant f rev 0
[    0.236994] clocksource: jiffies: mask: 0xffffffff max_cycles:
0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.237075] futex hash table entries: 256 (order: 2, 16384 bytes)
[    0.247162] pinctrl core: initialized pinctrl subsystem
[    0.248072] NET: Registered protocol family 16
[    0.249662] DMA: preallocated 256 KiB pool for atomic coherent allocations
[    0.273657] hw-breakpoint: Failed to enable monitor mode on CPU 0.
[    0.387619] xen:balloon: Initialising balloon driver
[    0.590742] xen_balloon: Initialising balloon driver
[    0.592211] media: Linux media interface: v0.10
[    0.592310] Linux video capture interface: v2.00
[    0.592383] pps_core: LinuxPPS API ver. 1 registered
[    0.592420] pps_core: Software ver. 5.3.6 - Copyright 2005-2007
Rodolfo Giometti <giometti@linux.it>
[    0.592498] PTP clock support registered
[    0.592571] EDAC MC: Ver: 3.0.0
[    0.598236] Advanced Linux Sound Architecture Driver Initialized.
[    0.599323] clocksource: Switched to clocksource arch_sys_counter
[    0.610934] NET: Registered protocol family 2
[    0.611463] TCP established hash table entries: 2048 (order: 1, 8192 bytes)
[    0.611528] TCP bind hash table entries: 2048 (order: 2, 16384 bytes)
[    0.611604] TCP: Hash tables configured (established 2048 bind 2048)
[    0.611682] UDP hash table entries: 256 (order: 1, 8192 bytes)
[    0.611741] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes)
[    0.611921] NET: Registered protocol family 1
[    0.629499] RPC: Registered named UNIX socket transport module.
[    0.629548] RPC: Registered udp transport module.
[    0.629585] RPC: Registered tcp transport module.
[    0.629621] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    0.629674] PCI: CLS 0 bytes, default 64
[    0.669371] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.689724] NFS: Registering the id_resolver key type
[    0.689788] Key type id_resolver registered
[    0.689820] Key type id_legacy registered
[    0.689912] ntfs: driver 2.1.32 [Flags: R/O].
[    0.692559] Block layer SCSI generic (bsg) driver version 0.4
loaded (major 247)
[    0.692623] io scheduler noop registered
[    0.692659] io scheduler deadline registered
[    0.692725] io scheduler cfq registered (default)
[    0.801768] Console: switching to colour frame buffer device 100x37
[    0.807703] xen:xen_evtchn: Event-channel device installed
[    0.860618] Serial: 8250/16550 driver, 10 ports, IRQ sharing disabled
[    0.863176] [drm] Initialized drm 1.1.0 20060810
[    1.185970] brd: module loaded
[    1.339782] loop: module loaded
[    1.342441] libphy: Fixed MDIO Bus: probed
[    1.343226] xen_netfront: Initialising Xen virtual ethernet driver
[    1.363729] mousedev: PS/2 mouse device common for all mice
[    1.402163] input: Xen Virtual Keyboard as /devices/virtual/input/input0
[    1.402805] input: Xen Virtual Pointer as /devices/virtual/input/input1
[    1.415272] i2c /dev entries driver
[    1.416302] ledtrig-cpu: registered to indicate activity on CPUs
[    1.418098] NET: Registered protocol family 10
[    1.419445] blkfront: xvda: flush diskcache: enabled; persistent
grants: enabled; indirect descriptors: enabled;
[    1.429716] sit: IPv6 over IPv4 tunneling driver
[    1.430399] NET: Registered protocol family 17
[    1.430570] Key type dns_resolver registered
[    1.430743] Registering SWP/SWPB emulation handler
[    1.549644] hctosys: unable to open rtc device (rtc0)
[    1.549805] PM: Checking hibernation image partition /dev/xvda
[    1.549867] PM: Hibernation image partition 202:0 present
[    1.549892] PM: Looking for hibernation image.
[    1.565902] PM: Image signature found, resuming
[    1.569834] PM: Preparing processes for restore.
[    1.569923] Freezing user space processes ... (elapsed 0.000 seconds) done.
[    1.569926] PM: Loading hibernation image.
[    1.569958] PM: Basic memory bitmaps created
[    1.595098] PM: Using 1 thread(s) for decompression.
[    1.595098] PM: Loading and decompressing image data (10801 pages)...
[    1.826173] PM: Image loading progress:   0%
[    1.892454] PM: Image loading progress:  10%
[    1.925053] PM: Image loading progress:  20%
[    1.959479] PM: Image loading progress:  30%
[    1.991475] PM: Image loading progress:  40%
[    2.018025] PM: Image loading progress:  50%
[    2.048493] PM: Image loading progress:  60%
[    2.072979] PM: Image loading progress:  70%
[    2.100511] PM: Image loading progress:  80%
[    2.133094] PM: Image loading progress:  90%
[    2.162493] PM: Image loading progress: 100%
[    2.162758] PM: Image loading done.
[    2.162806] PM: Read 43204 kbytes in 0.56 seconds (77.15 MB/s)
[    2.170238] PM: Image successfully loaded
[    3.414275] PM: quiesce of devices complete after 1242.505 msecs
[    3.416950] PM: late quiesce of devices complete after 2.627 msecs
[    3.441364] PM: noirq quiesce of devices complete after 24.364 msecs
[    3.441414] Disabling non-boot CPUs ...
[   58.929359] PM: noirq restore of devices complete after 2.041 msecs
[   58.931802] PM: early restore of devices complete after 2.335 msecs
[   58.973057] xenbus: Failed to release watch
/local/domain/0/backend/vbd/1/51712/state: -2
[   58.973936] Unhandled fault: terminal exception (0x002) at 0xcd042a70
[   58.973978] pgd = c9a10000
[   58.973995] [cd042a70] *pgd=4a805811, *pte=3800266f, *ppte=3800241f
[   58.974052] Internal error: : 2 [#1] PREEMPT SMP THUMB2
[   58.974081] Modules linked in:
[   58.974116] CPU: 0 PID: 296 Comm: bash Tainted: G        W
4.4.91-00002-g89baae6-dirty #107
[   58.974157] Hardware name: Generic DT based system
[   58.974184] task: c984ce00 task.stack: c99da000
[   58.974226] PC is at gnttab_end_foreign_access_ref_v1+0xe/0x5c
[   58.974264] LR is at gnttab_end_foreign_access_ref+0x13/0x2c
[   58.974299] pc : [<c024668a>]    lr : [<c0246843>]    psr: 600000b3
[   58.974299] sp : c99dbd5c  ip : 00000000  fp : c9c22480
[   58.974354] r10: ca220000  r9 : 00000100  r8 : 00000200
[   58.974381] r7 : 0000054e  r6 : ca230800  r5 : 0000054e  r4 : 00000000
[   58.974414] r3 : cd040000  r2 : cd042a70  r1 : 00000000  r0 : 0000054e
[   58.974450] Flags: nZCv  IRQs off  FIQs on  Mode SVC_32  ISA Thumb
Segment none
[   58.974490] Control: 50c5387d  Table: 49a1006a  DAC: 00000051
[   58.974523]
[   58.974523] PC: 0xc024660a:
[   58.974549] 6608  f07bd508 4620fe95 f9f6f07f fc06f07c fe94f07b
23acf243 f2cc4620 21000349
[   58.974707] 6628  f853681b f5e23025 b002fffd bf00bd70 f245b410
f2cc6480 2b000482 2301bf0c
[   58.974888] 6648  68a42305 46a468a4 4b04f85d bf004760 6380f245
0382f2cc f83368db f0000030
[   58.975070] 6668  47700018 6380f245 0382f2cc 695b689b bf004718
6380f245 f2cc2100 b4100382
[   58.975251] 6688  eb0368db f83302c0 f0133030 d1170f18 8f5bf3bf
f000f8b2 4f5fe8d2 0000f04f
[   58.975432] 66a8  0f03ea94 e8c2bf08 28001f50 b2a4d1f4 8f5bf3bf
d00742a3 f0134623 d0e70f18
[   58.975587] 66c8  f85d2000 47704b04 f85d2001 47704b04 f245b410
f2cc6480 23020482 68a468a4
[   58.975712] 66e8  f85d46a4 47604b04 6380f245 0382f2cc 691b689b
bf004718 f1a06800 fab030ff
[   58.975838] 6708  0940f080 bf004770 6380f245 0382f2cc 0a8cb430
f3c1691a 68030509 2024f852
[   58.975973]
[   58.975973] LR: 0xc02467c3:
[   58.976011] 67c0  f06f4770 4770001b f245b470 f2cc6580 00c60582
199a68eb 3030f833 0104f003
[   58.976144] 67e0  b9c9b289 8f5bf3bf f000f8b2 4f5fe8d2 0000f04f
0f03ea94 e8c2bf08 28001f50
[   58.976271] 6800  f3bfd1f4 b2a48f5b d00d42a3 07588813 071bd5e8
8813d402 d5fc071b 8f4ff3bf
[   58.976396] 6820  441e68eb b1086870 4770bc70 bf00de02 f245b538
f2cc6380 46050382 68db689b
[   58.976520] 6840  46044798 2401b110 bd384620 3078f241 f2cc4629
f6570068 e7f5fc37 b085b500
[   58.976646] 6860  f647a904 200673f0 f8212201 46693d10 fabaf5c7
db032800 300cf9bd b1039802
[   58.976751] 6880  b0052004 fb04f85d f7ffb538 f245ffe7 f2cc6480
69630482 b1234605 461842ab
[   58.976876] 68a0  4628bf28 f7ffbd38 4603ffd9 616042ab bf284618
bd384628 1300f242 0379f2cc
[   58.977011] 68c0  47f0e92d 789b460c 1c4eb088 f245b37b f2cc6a80
f8da0a82 429e301c 4605d864
[   58.977147]
[   58.977147] SP: 0xc99dbcdc:
[   58.977187] bcdc  00000000 c99dbd7c 00000001 c9de9c00 c024668a
600000b3 ffffffff c99dbd3c
[   58.977322] bcfc  00000200 00000100 c0011cfb 0000054e 00000000
cd042a70 cd040000 00000000
[   58.977457] bd1c  0000054e ca230800 0000054e 00000200 00000100
ca220000 c9c22480 00000000
[   59.064426] bd3c  c99dbd5c c0246843 c024668a 600000b3 ffffffff
00000051 caf8e4c4 c02d9abd
[   59.064521] bd5c  00000000 c9c22488 00000000 00000000 c024732f
c9de9c00 ca2308d8 ca230800
[   59.064615] bd7c  c9c22c80 ca2308d8 ca230800 ca2308b0 c02d9aed
c02da569 ca220000 ca8ac200
[   59.064710] bd9c  ca8ac200 c07cf0fc 00000000 ca8ac220 00000040
c082be78 c02da581 c02da569
[   59.064822] bdbc  ca8ac220 00000000 c024c8ed 00000000 00000000
00000040 00000000 00000000
[   59.064917]
[   59.064917] FP: 0xc9c22400:
[   59.064947] 2400  00000000 caf8a72c c9c223c8 c9c22448 00000000
00000000 00000000 00000000
[   59.065041] 2420  00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[   59.065139] 2440  00000000 caf8a750 c9c22408 c9e6bf08 00000000
00000000 00000000 00000000
[   59.065233] 2460  00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[   59.065327] 2480  0000056e caf8a774 c9c224c8 ca2308b0 00000000
00000000 00000000 00000000
[   59.065424] 24a0  00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[   59.065518] 24c0  0000056d caf8a798 c9c22508 c9c22488 00000000
00000000 00000000 00000000
[   59.065609] 24e0  00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[   59.065728]

Can you point me towards what could be the issue ? If any other
information is needed then I can provide it to you.

Regards,
Moinuddin

On Tue, May 22, 2018 at 7:49 PM, Julien Grall <julien.grall@arm.com> wrote:
>
>
> On 22/05/18 14:17, moin anjnawala wrote:
>>
>> Hi,
>
>
> Hello,
>
>> I am using xen4.6 and Linux-4.4 as dom0 and domU on Jacinto j6 board.
>> The system is able to boot and create domains successfully. Now, I am
>> trying to enable hibernation in domU. The hibernation seems to be
>> completed successfully. After hibernating domU and recreating domU. It
>> is able to resume but gives following error messages for vbd in kernel
>> logs
>
> Xen 4.6 has been released 3 years and is 5 releases old. You should use a
> recent Xen and Linux when doing development as bug may have been fixed in
> recent version. Please reproduce your error on recent version (Xen 4.10 at
> least).
>
> Regards,
>
> --
> Julien Grall

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel