From mboxrd@z Thu Jan 1 00:00:00 1970 From: Anthony Wright Subject: Memory allocation going seriously wonky on 4.1.1 Date: Fri, 30 Sep 2011 16:07:06 +0100 Message-ID: <4E85DB1A.5060606@overnetdata.com> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="------------030503060601060101090300" Return-path: List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xensource.com Errors-To: xen-devel-bounces@lists.xensource.com To: "xen-devel@lists.xensource.com" List-Id: xen-devel@lists.xenproject.org This is a multi-part message in MIME format. --------------030503060601060101090300 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit I have a machine with 16GB of RAM running 32 bit xen 4.1.1 with Dom0 running a 3.0.4 linux kernel and 23 paravirtualized DomUs. As the free ram gets to 2391 MB free the system behaves as if it's got no more ram, and starts grabbing ram from Dom0, before getting even more confused and failing to start DomUs and eventually crashing the whole machine. I have attached a tarball with the output of xl dmesg, xl info & xl list at various points. Stage 1 Everything is fine, Dom0 has 2000MB according to xl list, and 'xl info' says there is 2405MB free. Stage 2 I have increased the memory for the DomU labelled 10-4 from 700MB to 1000MB, Dom0 has 1713MB and 'xl info' says there is 2391MB free. Stage 3 I have tried to increase the memory for the DomU labelled 13-4 from 700MB to 1000MB, but it failed on the 'xl create' displaying the message 'failed to free memory for the domain'. Dom0 has 1413MB and 'xl info' says there is 3391MB free. State 4 I tried to create the 13-4 DomU again, and this time it succeeds. Dom0 has 1413MB and 'xl info' says there is 2391MB free. If I repeatedly stop and start DomUs at this point, particularly if I request more ram, the machine locks up. This may be due to lack of Dom0 ram. --------------030503060601060101090300 Content-Type: application/octet-stream; name="vm-memory-logs.tar.bz2" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="vm-memory-logs.tar.bz2" QlpoOTFBWSZTWZFK8qoAP7//x//8gEJv9//7f+//7v////QIAAAA0AggAAAIYB2/AByAKAAA AAAAEgAAAAAAAAAAAAAAAAAAAAAAAAAAAcAA0GhoNABpkGhkDTQAAGQAZAZAA4ABoNDQaADT INDIGmgAAMgAyAyAA1U/JkyVDEAAAAAAAAAAAAAAADgAGg0NBoANMg0MgaaAAAyADIDIAHAA NBoaDQAaZBoZA00AABkAGQGQACqIQJoBNACZNCYQ0amAh6AmVPamyRtDJpPJpT9UPFHqfjAz j+BHZDtI8ULXQP9ikRKJwhEEd9CIXkeH1HkpXJ5PHS+t91rvcHWWH2HEMiMIUQi0NFdHmX0m 7O6udMFKUmnNWtal5riYEwNJMCYREiFBrhJCsCIiSYEJISISTA1EkURCEogk/+hEhQiISESR IkiYRIkSQ/I/kexs036zzn+AyPQfgfaf+j4z8j2htJEMDSSfcdxcVLi4of0OgqN5Y90wNxiQ i8kH1nIWOssXl5Q9B4S8uOIwLypYsSOw7ShChkWLipERJQvLihsKGRcXCp6D4jpydebNEJtP CxnK0YQNaNTCRN3BnJkCKIiTyEDRhJopJ0Ug4aEhJYs0kSCsxQUIHi0Ec7ACYJwBAdASbjEa s4jIk1EaB+RJ65Y6TlKGwuMzSWJFiSI8UCUQRB9xJDadR2FREf+YEoQEP3l5cPEaA4JmUTEy mYiZTMTKZhzFEQpMzEzpERt3BExQg4RtLhQZkRGJjtERjJ4i4oiI4jIH2EnfPAeEwLGskP6m I7j95ecD/4cxiUMCSpynGcRmZlwkjeSf4MihJoPQbDI5TrRQmSJLyoqO0sRQkkOqIEbjt6cr 6WrSpWO2eDu5RmRcyIiIOkWDxRnd1Vg7ojPB3fO6cZums0lMzD9xxjSSYkWJJEkSSaogR3EG 075/2VLEiG7XpmlEtsa7WrsjARGZSkRGJ0EkKFihFCRsJHkJI1nuFxuGwoOc0FCpJCOgaCRE UiIiHKWPIe8SazYdJzj3ihoNxyGJyn1GRzFChJ9ZY6yw6yo6T3yhY8xvPKeYksLEkbCSRYqJ KkSWPiKnMDA8BQ6BJ3EjtO0yIuPsPQe2cx75kLyhQkSSSSSSSSSSSSSSSO4+kId8d4+o7RiZ jEKkqkfoN5+Z7ZdQwOkxMR4SS+ERH8SHtkbDzAahek4FIZlxoKn9j0mJFYQkiTmhwOs2ngPZ HqixcVKnjPZLi44REbTznOaip4xEPwKjsHQawPtLhcXmRQ0FR5yhmVOg7595959p2HOdhQ9B JUkXEmBIjkOM2HhNBQ1CxsKEnIUOU/iULFxQSXlCJF5IWHMWOA5iS49J4BkXli8zDvEkd4kV JGZJ75eYESXFC4uKkkbCw5DyF4qQzGB8hUsfAdZoMzyDwmk4zE/MvHEMzE1l5J9xQWIFTlOg 7j1T4TMbiTcSDsKmg0ChwKDSWLyShvMypvLHeKl5U1HWbSpcXEnAhJiJFRYofCSR5ySxYeke 0ekqPbLFCT/RQeubjqHA6Cp7Q0j0GwoVOkuMCwaDzlTvFj1zlPWLixGk/saTsFSTAvNJtO+Z G4xFDWeI7xUsZnpPlOM94yO0943knmNxmcpzG44DgO+cZoMzSbz/s9QoJNBcXF5zG8k0mk3D 5Deec9cZlTebhoOk6xvOQ2D2hzkjQZnKfAfcbzsLzIzMRmd47BY6QOUXHYLjA8B0DsO4uP1n jJEkjxlCg6hIiQjMmIgh8xIR5gREWLyoRHESI3nOaiwxJKESSPmEekkj1CTlJKEnmPSe+P1H SYG8zLzmHSfCEHzlChERBxEkOA90RUjaIh8prNY8Y2m8fOcDE92IiIaCIJRERCyEQ8MOByEf qMD2DM981GkqcpQvPSPIMz/JeWXE4mZmZlCptI+YwJJOBJH1HlO47x7p8R0HShENJF5C44iT vknswOSBqIoWPCSJEdJQ8JJrLGocR7g69HLt6um7rp1BTqtddSlMZmt+GgqdRjjgHWDOypE4 g5BBQMwmTFDFEgIABAESINTMyIyRCWQVQpxEHdkY4KCY1VIAYIGOBjATwJ4FDr16t20/Weco PGSWD1D2RYsNGjRorWtZrWtiNpFkwXG+hANUheSKC8oCMjxmJl9JceczMzlNJ7xeGkkLH8zQ dpJIfYLjqJPYJJNBEklCpIoSJKEkmRgSbC4hvIoXy6pVJRpmLy+EIgwERI1plEzEyShGJJEn /BYvKmBmbTvmIhhJAO+YmJ8BrKlxIXw7T1i88BJUoXDE1Ggqe0YHEVPdNpzj8fOXi8kk1CSh pKG4k2IguOQZlRQ+YkkkipcYEklBUIuhIjeJEkkJEkiSOIjeVItYkqUOMqJJKFpIqXElbyov itilxYkkjlGJMLqVKmWBeabhbyChWthIqMDQSUGBIf3OoaSpiNp+BQas4mciSSIjqRGuNZYq XlD2REesPrMSQf1KmBYazuKGRcEYH8iRUuOMqekwNMGgk9Y27P6mB78D1DnGsNRQ8JvPtHYf pJP0i+No17I6iNhsgsO2BuO0C4ui+DJJjR650l8XwsgvLFi0cRMcC4oVUGOgvLkWGMXihtKG RJF5ejq/AkI2wLjnMs2JiuhxGN5edJgYLsBzGkvLy+/jNxoGRxncd41m8k4EcDbvxqVHVEaB riIjrOUIx5CY4yxDpMjkLwLzaNBgXihIuLjkKkVjrObI75eYiI5TdSHfEgpHOUIGJIxMDjhY 6ip0HAsVMHAuKDSUNpXlN2swKFRznOLxgahlpjE0FKYEReU4FShefkXGRqNIRUkhFTMoO4sO dmdKCpnHQOIoSXb5rSYpSZvF5gcZiXnAxjIjUUjElzmo3G0ochUoLsChrLeU7xsLz0EkMCFB uLElsIqSZQOap0cgupEji3TQYGYd8vI8BJSMG7Mil9NJuhwKFCSkQjQaS89coUOBQyOwvOUs ZFY0CSgmOU3ChcSScDYaDk5RcYDgcBkWzLz0kZQuTugTGBkUMSSbEabGekxOIk4G0yOI2Quy z06YVzoZRFczDomZSzGJ0FCOBdDRrzrDQc5t2lSx4STQXkkmF1CpFsoWMaqGngVF4k3XVw3X EjlKHUS/GZTN8XlRoEm4mIbjSXsiWYoTcSJCNxCLhcUIoSQkNvQXl8DpI2tBUxPzOYDSRY15 U3GJvRvLNu8vKm80U51qX7zVERQjOTbauuL6XEZlKl9ihrndCtDAwLzQYmweIYc8zMzOJQyN RQ2mykxMj1z3DUSeAxN5zDQdhtMS4eIjTDiJOMScgyOBHEWFw3lDeiZQqOKNRQwNpf1ljQWP vHvH1HxnxkknnPSf+z5TWYnOfcfrOMYEmoqWPxOQwPxiw+cU8BcZGRvP7HymkkMj4ygewSLE lj7ShrLigP4m8wP0lj0H7hxGZ95yG06DM1mZyHA0H7TAuOYkdxznqnceM9UD2CgsesPEaT4x 3h7wR5TrO0SfUeY90uKCIUJPmPuFC8+g/oewfxEXGkkiDESYH5lCLiR4Cw9JkVNgsUI9JwOg k9woPmNB9hiaSo2EmBqJPXD0kkDiHfNRY5D4S83i81HKbDYSCNpsJLChU/kZCoSNpqKDQaRq LEnxHzGgyIQqUKEPYLz6SpUEg9YzPAcAjEazSVMB3jjHGPbBERYoJIdpIxOU/M5RpLiGkc58 JrIjrEnGQhJeJC8KC8kKHgI6hU6TYLCpBHqiRIkhqJNxHMJKnhLDMqRCFxJH7TWUKm4qekzM RGgkNZIhoJOYhiOs5Chylw+EIkjA1lw5BuKDMjYKknA9c5TQGseuUN5pN5UuHAUOojUPEVOw vIIiJI2jjLFhYRJgfeWPAXEknhOgoMDgNY6DE7SELFjnJLDcRcKFiIhsBG43l5cZGgMCKkR1 hEgcRQ2cRYuMzI0HUXBeLElDYaTA2kjIuJNRFjgXnQO8YDAzMzM75JUhkPwNRiMCTcScZJsJ IWKEm0qRHukkf9EkXGkwIoaTQZFC4iOIUJFxyEOkcRIjQN5QyKmkkyLHAuLGgiRDmIkcZJEN goCIihBcRY0Cp+ZIjpPqP2DuPAXCx1kj9JJ6xYoSfcfgbBYzPfI/mYGBIuJLixU/cd4+A2n5 EiwfAfOXkkn6iS4+4vFDgP2Fx/gsYn6yhkfsFCxqOM4g2nEc0DnMD2DE+k0m0VNRDUJJIjuK ihgZjI75kXmo+gvHvD8TjKniFwSf5GQcp8h0FDSXCgsYjWPISYF5iXCTSLjAhFRpJJJNReKG JGcDUeM7DMkWFDI2GJ5TtLyTymY906BQ6BcYkc5mSLypcfeSdCEQ6yOc4DIk+c/kXkVGIiEn USfwNhmSOc+cZj5z4jEf0JJJJPESUJKEi47DIJIuNJGgcZ2HmH0BuCxkReIOosYm4jrJKkXF iGok0iTQJH3Cp7JkXkbCRzkkZElRrFBQ6ihzEkSSRJIkSIsVJFCEbDlFCKmZqMTYRoC4ofGW KFi8/4ESMCTvDIhkaiwuP9GR2kXmgqZmRFDxmw2ihQwPyOUobDoNJgaDoO0dJ6hqJJLFxkVI aiSwyMzwDAchyFxkSXmBiYEiTUZip4CG0saiSSSx9pIwLFxJcSdJmUPrElxJgbi49UhYWESa RkQkiRpP2lCLENgwEnlLCx5zeLEwH0ERvJJB2AkvNY7iNhGB0DYby8uLC89sjE7xibhEMiG0 aDQOY0lipIipUkoOMhDlMySppMjUfIZmgYGYyO41jvjvHmHtFjpHqHKSahYkJKEjuOck7i8S cRcR7pgWJLzcXDUWOg7DMkSbxvKkeYWOIipENZgWPKeMLiSSTUJMBeWFIGg6iSTrNB6Sp1Gk vEioihcSP/BJGBcGs/QO47xY/udxie0Q75JEYEaS4scgk+U9w6TIkwOUZB75cRidpcayRU9U k85YKmRY7TEscZmbTAdIyHAkaCTIkkuEQkh4CNp5RxCReFjAeQkzO0sKmgoGk2lCRQcZrJKF RccR1FB6T6TxnmKFxtIkyGJ7JCR4STpIqQoeId86CxeNhEkkJLiKlRDgVJFCOkXGI6zjNZeZ FxFxJ85J1nMR9pF0DEbjUaTQOo6SYIqRFRQqbjwlxHcdY1mZGRiFDYRwGAVNcCSo4igsKmgV DGAoGBYoSSVJEFCSKkihUihIkkoSKDrFBD6CREnIbiMCRJFhJeYCSTSRQoBUSKiT3RJePoNJ 5SxqI9AoRxD/kzNIkhEmYjUUNJgWJOIi4k9QbAjynSXkkVEHiPIc4dRQ3i8jETAwKnAxFR4y HQRI9Y8JDUIRiSKFxJGsuNRigftHAqf5NIgxGIjAdpG+A3mSBkRJxHyFDAfvGwvGs5zzHQc5 GRYsSHGHKP5n5GIqLFxG4N53j6yhFjAi8oRQ5CNhFYGsaxBJtKFAyhQ9siIqSIki8ScY0DEo SXknIdJFDMjpJOQuOcUNxoNpGg1kNo2Gw2GAvEVI1j1iERvLyhqPlgf4gdI3HSeQZjSJIiHI ahIqRIcZqPbNBgQvgPEfkVKHA5zzGRYuOo5zkKklCShmdw2GIqKnhLG4vKCRYzOk7RSBYbDI koaSGJHiEnUO+SaSSppJMBHeJLFTSUN5GkRDAvLxkYiwgsQ9gkQaCTkMSgxNBqgaCppNBeXi MUCpcRkXGZCJLGRJUkcReXmBGZU9BJUxOoqR0EjIzMSMjSRYyJgeqSSYElxGAxIuMSwqXmoh caShcaCRxF5UZmgdxUyLjEqRiaCRGJcWDA0FBiYklxmIxMiTkNpzBcNR/AdR+g2j/RvI6zcM i4f3Gosbhxki81kbBeHEf6gVG8VGowIbxyGkhCSSOUj/f+/h+H/da1rX6a1m00vOMk0mRHES WI9J6SR+ojeXGwgsRU+wjcesSdZwEknkJhDoNpHSSf8jwHjNhEkkSf9FAkkoUKChISegoKHx lUQqESg//i7kinChISKV5VQ= --------------030503060601060101090300 Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel --------------030503060601060101090300--