* Re: [KVM-AUTOTEST PATCH] A test patch - Boot VMs until one of them becomes unresponsive [not found] <120253480.1747631244710010660.JavaMail.root@zmail05.collab.prod.int.phx2.redhat.com> @ 2009-06-11 8:53 ` Michael Goldish 2009-06-11 9:46 ` Yolkfull Chow 2009-06-12 13:27 ` [KVM-AUTOTEST PATCH] stress_boot - Boot VMs until one of them becomes unresponsive - Version2 Yolkfull Chow 0 siblings, 2 replies; 6+ messages in thread From: Michael Goldish @ 2009-06-11 8:53 UTC (permalink / raw) To: Yolkfull Chow; +Cc: Uri Lublin, kvm ----- "Yolkfull Chow" <yzhou@redhat.com> wrote: > Michael, these are the backtrace messages: > > ... > 20090611-064959 > no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024: > > ERROR: run_once: Test failed: [Errno 12] Cannot allocate memory > 20090611-064959 > no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024: > > DEBUG: run_once: Postprocessing on error... > 20090611-065000 > no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024: > > DEBUG: postprocess_vm: Postprocessing VM 'vm1'... > 20090611-065000 > no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024: > > DEBUG: postprocess_vm: VM object found in environment > 20090611-065000 > no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024: > > DEBUG: send_monitor_cmd: Sending monitor command: screendump > /kvm-autotest/client/results/default/kvm_runtest_2.[RHEL-Server-5.3-64][None][1024][1][qcow2]<no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024>/debug/post_vm1.ppm > 20090611-065000 > no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024: > > DEBUG: run_once: Contents of environment: {'vm__vm1': <kvm_vm.VM > instance at 0x92999a28>} > post-test sysinfo error: > Traceback (most recent call last): > File "/kvm-autotest/client/common_lib/log.py", line 58, in > decorated_func > fn(*args, **dargs) > File "/kvm-autotest/client/bin/base_sysinfo.py", line 213, in > log_after_each_test > log.run(test_sysinfodir) > File "/kvm-autotest/client/bin/base_sysinfo.py", line 112, in run > shell=True, env=env) > File "/usr/lib64/python2.4/subprocess.py", line 412, in call > return Popen(*args, **kwargs).wait() > File "/usr/lib64/python2.4/subprocess.py", line 542, in __init__ > errread, errwrite) > File "/usr/lib64/python2.4/subprocess.py", line 902, in > _execute_child > self.pid = os.fork() > OSError: [Errno 12] Cannot allocate memory > 2009-06-11 06:50:02,859 Configuring logger for client level > FAIL > kvm_runtest_2.[RHEL-Server-5.3-64][None][1024][1][qcow2]<no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024> > > kvm_runtest_2.[RHEL-Server-5.3-64][None][1024][1][qcow2]<no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024> > > timestamp=1244717402 localtime=Jun 11 06:50:02 Unhandled > OSError: > [Errno 12] Cannot allocate memory > Traceback (most recent call last): > File "/kvm-autotest/client/common_lib/test.py", line 304, > > in _exec > self.execute(*p_args, **p_dargs) > File "/kvm-autotest/client/common_lib/test.py", line 187, > > in execute > self.run_once(*args, **dargs) > File > "/kvm-autotest/client/tests/kvm_runtest_2/kvm_runtest_2.py", line 145, > > in run_once > routine_obj.routine(self, params, env) > File > "/kvm-autotest/client/tests/kvm_runtest_2/kvm_tests.py", line 3071, in > > run_boot_vms > curr_vm_session = kvm_utils.wait_for(curr_vm.ssh_login, > > 240, 0, 2) > File > "/kvm-autotest/client/tests/kvm_runtest_2/kvm_utils.py", line 797, in > > wait_for > output = func() > File > "/kvm-autotest/client/tests/kvm_runtest_2/kvm_vm.py", > line 728, in ssh_login > session = kvm_utils.ssh(address, port, username, > password, prompt, timeout) > File > "/kvm-autotest/client/tests/kvm_runtest_2/kvm_utils.py", line 553, in > ssh > return remote_login(command, password, prompt, "\n", > timeout) > File > "/kvm-autotest/client/tests/kvm_runtest_2/kvm_utils.py", line 431, in > > remote_login > sub = kvm_spawn(command, linesep) > File > "/kvm-autotest/client/tests/kvm_runtest_2/kvm_utils.py", line 114, in > > __init__ > (pid, fd) = pty.fork() > File "/usr/lib64/python2.4/pty.py", line 108, in fork > pid = os.fork() > OSError: [Errno 12] Cannot allocate memory > Persistent state variable __group_level now set to 1 > END FAIL > kvm_runtest_2.[RHEL-Server-5.3-64][None][1024][1][qcow2]<no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024> > > kvm_runtest_2.[RHEL-Server-5.3-64][None][1024][1][qcow2]<no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024> > > timestamp=1244717403 localtime=Jun 11 06:50:03 > Dropping caches > 2009-06-11 06:50:03,409 running: sync > JOB ERROR: Unhandled OSError: [Errno 12] Cannot allocate memory > Traceback (most recent call last): > File "/kvm-autotest/client/bin/job.py", line 978, in step_engine > execfile(self.control, global_control_vars, global_control_vars) > File "/kvm-autotest/client/control", line 1030, in ? > cfg_to_test("kvm_tests.cfg") > File "/kvm-autotest/client/control", line 1013, in cfg_to_test > current_status = job.run_test("kvm_runtest_2", params=dict, > tag=tagname) > File "/kvm-autotest/client/bin/job.py", line 44, in wrapped > utils.drop_caches() > File "/kvm-autotest/client/bin/base_utils.py", line 638, in > drop_caches > utils.system("sync") > File "/kvm-autotest/client/common_lib/utils.py", line 510, in > system > stdout_tee=sys.stdout, stderr_tee=sys.stderr).exit_status > File "/kvm-autotest/client/common_lib/utils.py", line 330, in run > bg_job = join_bg_jobs( > File "/kvm-autotest/client/common_lib/utils.py", line 37, in > __init__ > stdin=stdin) > File "/usr/lib64/python2.4/subprocess.py", line 542, in __init__ > errread, errwrite) > File "/usr/lib64/python2.4/subprocess.py", line 902, in > _execute_child > self.pid = os.fork() > OSError: [Errno 12] Cannot allocate memory > > Persistent state variable __group_level now set to 0 > END ABORT ---- ---- timestamp=1244717418 localtime=Jun 11 > > 06:50:18 Unhandled OSError: [Errno 12] Cannot allocate memory > Traceback (most recent call last): > File "/kvm-autotest/client/bin/job.py", line 978, in step_engine > execfile(self.control, global_control_vars, > global_control_vars) > File "/kvm-autotest/client/control", line 1030, in ? > cfg_to_test("kvm_tests.cfg") > File "/kvm-autotest/client/control", line 1013, in cfg_to_test > current_status = job.run_test("kvm_runtest_2", params=dict, > tag=tagname) > File "/kvm-autotest/client/bin/job.py", line 44, in wrapped > utils.drop_caches() > File "/kvm-autotest/client/bin/base_utils.py", line 638, in > drop_caches > utils.system("sync") > File "/kvm-autotest/client/common_lib/utils.py", line 510, in > system > stdout_tee=sys.stdout, stderr_tee=sys.stderr).exit_status > File "/kvm-autotest/client/common_lib/utils.py", line 330, in > run > bg_job = join_bg_jobs( > File "/kvm-autotest/client/common_lib/utils.py", line 37, in > __init__ > stdin=stdin) > File "/usr/lib64/python2.4/subprocess.py", line 542, in __init__ > errread, errwrite) > File "/usr/lib64/python2.4/subprocess.py", line 902, in > _execute_child > self.pid = os.fork() > OSError: [Errno 12] Cannot allocate memory > [root@dhcp-66-70-9 kvm_runtest_2]# Thanks. It does indeed look like a legitimate OSError in os.fork(). BTW, do you have any idea why the result dir has such a weird name? /kvm-autotest/client/results/default/kvm_runtest_2.[RHEL-Server-5.3-64][None][1024][1][qcow2]<no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024>/debug/post_vm1.ppm And why sometimes a normal looking tag appears (in the log messages): no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024 Why all the [] and <> in the weird version? Did you somehow do that intentionally, or is it some sort of bug? And why is 'None' there? The tag is supposed to be the test's 'shortname', which is determined by kvm_config.py as it parses kvm_tests.cfg (or the config file you're using). Normally the result dir should just be kvm_runtest_2.shortname, and in this case: kvm_runtest_2.no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024 ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [KVM-AUTOTEST PATCH] A test patch - Boot VMs until one of them becomes unresponsive 2009-06-11 8:53 ` [KVM-AUTOTEST PATCH] A test patch - Boot VMs until one of them becomes unresponsive Michael Goldish @ 2009-06-11 9:46 ` Yolkfull Chow 2009-06-12 13:27 ` [KVM-AUTOTEST PATCH] stress_boot - Boot VMs until one of them becomes unresponsive - Version2 Yolkfull Chow 1 sibling, 0 replies; 6+ messages in thread From: Yolkfull Chow @ 2009-06-11 9:46 UTC (permalink / raw) To: Michael Goldish; +Cc: Uri Lublin, kvm On 06/11/2009 04:53 PM, Michael Goldish wrote: > ----- "Yolkfull Chow"<yzhou@redhat.com> wrote: > > >> Michael, these are the backtrace messages: >> >> ... >> 20090611-064959 >> no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024: >> >> ERROR: run_once: Test failed: [Errno 12] Cannot allocate memory >> 20090611-064959 >> no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024: >> >> DEBUG: run_once: Postprocessing on error... >> 20090611-065000 >> no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024: >> >> DEBUG: postprocess_vm: Postprocessing VM 'vm1'... >> 20090611-065000 >> no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024: >> >> DEBUG: postprocess_vm: VM object found in environment >> 20090611-065000 >> no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024: >> >> DEBUG: send_monitor_cmd: Sending monitor command: screendump >> /kvm-autotest/client/results/default/kvm_runtest_2.[RHEL-Server-5.3-64][None][1024][1][qcow2]<no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024>/debug/post_vm1.ppm >> 20090611-065000 >> no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024: >> >> DEBUG: run_once: Contents of environment: {'vm__vm1':<kvm_vm.VM >> instance at 0x92999a28>} >> post-test sysinfo error: >> Traceback (most recent call last): >> File "/kvm-autotest/client/common_lib/log.py", line 58, in >> decorated_func >> fn(*args, **dargs) >> File "/kvm-autotest/client/bin/base_sysinfo.py", line 213, in >> log_after_each_test >> log.run(test_sysinfodir) >> File "/kvm-autotest/client/bin/base_sysinfo.py", line 112, in run >> shell=True, env=env) >> File "/usr/lib64/python2.4/subprocess.py", line 412, in call >> return Popen(*args, **kwargs).wait() >> File "/usr/lib64/python2.4/subprocess.py", line 542, in __init__ >> errread, errwrite) >> File "/usr/lib64/python2.4/subprocess.py", line 902, in >> _execute_child >> self.pid = os.fork() >> OSError: [Errno 12] Cannot allocate memory >> 2009-06-11 06:50:02,859 Configuring logger for client level >> FAIL >> kvm_runtest_2.[RHEL-Server-5.3-64][None][1024][1][qcow2]<no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024> >> >> kvm_runtest_2.[RHEL-Server-5.3-64][None][1024][1][qcow2]<no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024> >> >> timestamp=1244717402 localtime=Jun 11 06:50:02 Unhandled >> OSError: >> [Errno 12] Cannot allocate memory >> Traceback (most recent call last): >> File "/kvm-autotest/client/common_lib/test.py", line 304, >> >> in _exec >> self.execute(*p_args, **p_dargs) >> File "/kvm-autotest/client/common_lib/test.py", line 187, >> >> in execute >> self.run_once(*args, **dargs) >> File >> "/kvm-autotest/client/tests/kvm_runtest_2/kvm_runtest_2.py", line 145, >> >> in run_once >> routine_obj.routine(self, params, env) >> File >> "/kvm-autotest/client/tests/kvm_runtest_2/kvm_tests.py", line 3071, in >> >> run_boot_vms >> curr_vm_session = kvm_utils.wait_for(curr_vm.ssh_login, >> >> 240, 0, 2) >> File >> "/kvm-autotest/client/tests/kvm_runtest_2/kvm_utils.py", line 797, in >> >> wait_for >> output = func() >> File >> "/kvm-autotest/client/tests/kvm_runtest_2/kvm_vm.py", >> line 728, in ssh_login >> session = kvm_utils.ssh(address, port, username, >> password, prompt, timeout) >> File >> "/kvm-autotest/client/tests/kvm_runtest_2/kvm_utils.py", line 553, in >> ssh >> return remote_login(command, password, prompt, "\n", >> timeout) >> File >> "/kvm-autotest/client/tests/kvm_runtest_2/kvm_utils.py", line 431, in >> >> remote_login >> sub = kvm_spawn(command, linesep) >> File >> "/kvm-autotest/client/tests/kvm_runtest_2/kvm_utils.py", line 114, in >> >> __init__ >> (pid, fd) = pty.fork() >> File "/usr/lib64/python2.4/pty.py", line 108, in fork >> pid = os.fork() >> OSError: [Errno 12] Cannot allocate memory >> Persistent state variable __group_level now set to 1 >> END FAIL >> kvm_runtest_2.[RHEL-Server-5.3-64][None][1024][1][qcow2]<no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024> >> >> kvm_runtest_2.[RHEL-Server-5.3-64][None][1024][1][qcow2]<no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024> >> >> timestamp=1244717403 localtime=Jun 11 06:50:03 >> Dropping caches >> 2009-06-11 06:50:03,409 running: sync >> JOB ERROR: Unhandled OSError: [Errno 12] Cannot allocate memory >> Traceback (most recent call last): >> File "/kvm-autotest/client/bin/job.py", line 978, in step_engine >> execfile(self.control, global_control_vars, global_control_vars) >> File "/kvm-autotest/client/control", line 1030, in ? >> cfg_to_test("kvm_tests.cfg") >> File "/kvm-autotest/client/control", line 1013, in cfg_to_test >> current_status = job.run_test("kvm_runtest_2", params=dict, >> tag=tagname) >> File "/kvm-autotest/client/bin/job.py", line 44, in wrapped >> utils.drop_caches() >> File "/kvm-autotest/client/bin/base_utils.py", line 638, in >> drop_caches >> utils.system("sync") >> File "/kvm-autotest/client/common_lib/utils.py", line 510, in >> system >> stdout_tee=sys.stdout, stderr_tee=sys.stderr).exit_status >> File "/kvm-autotest/client/common_lib/utils.py", line 330, in run >> bg_job = join_bg_jobs( >> File "/kvm-autotest/client/common_lib/utils.py", line 37, in >> __init__ >> stdin=stdin) >> File "/usr/lib64/python2.4/subprocess.py", line 542, in __init__ >> errread, errwrite) >> File "/usr/lib64/python2.4/subprocess.py", line 902, in >> _execute_child >> self.pid = os.fork() >> OSError: [Errno 12] Cannot allocate memory >> >> Persistent state variable __group_level now set to 0 >> END ABORT ---- ---- timestamp=1244717418 localtime=Jun 11 >> >> 06:50:18 Unhandled OSError: [Errno 12] Cannot allocate memory >> Traceback (most recent call last): >> File "/kvm-autotest/client/bin/job.py", line 978, in step_engine >> execfile(self.control, global_control_vars, >> global_control_vars) >> File "/kvm-autotest/client/control", line 1030, in ? >> cfg_to_test("kvm_tests.cfg") >> File "/kvm-autotest/client/control", line 1013, in cfg_to_test >> current_status = job.run_test("kvm_runtest_2", params=dict, >> tag=tagname) >> File "/kvm-autotest/client/bin/job.py", line 44, in wrapped >> utils.drop_caches() >> File "/kvm-autotest/client/bin/base_utils.py", line 638, in >> drop_caches >> utils.system("sync") >> File "/kvm-autotest/client/common_lib/utils.py", line 510, in >> system >> stdout_tee=sys.stdout, stderr_tee=sys.stderr).exit_status >> File "/kvm-autotest/client/common_lib/utils.py", line 330, in >> run >> bg_job = join_bg_jobs( >> File "/kvm-autotest/client/common_lib/utils.py", line 37, in >> __init__ >> stdin=stdin) >> File "/usr/lib64/python2.4/subprocess.py", line 542, in __init__ >> errread, errwrite) >> File "/usr/lib64/python2.4/subprocess.py", line 902, in >> _execute_child >> self.pid = os.fork() >> OSError: [Errno 12] Cannot allocate memory >> [root@dhcp-66-70-9 kvm_runtest_2]# >> > Thanks. It does indeed look like a legitimate OSError in os.fork(). > > BTW, do you have any idea why the result dir has such a weird name? > /kvm-autotest/client/results/default/kvm_runtest_2.[RHEL-Server-5.3-64][None][1024][1][qcow2]<no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024>/debug/post_vm1.ppm > > And why sometimes a normal looking tag appears (in the log messages): > no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024 > > Why all the [] and<> in the weird version? Did you somehow do that intentionally, or is it some sort of bug? > And why is 'None' there? The tag is supposed to be the test's 'shortname', which is determined by kvm_config.py > as it parses kvm_tests.cfg (or the config file you're using). > > Normally the result dir should just be kvm_runtest_2.shortname, and in this case: > kvm_runtest_2.no_boundary.local_stg.RHEL.5.3-server-64.no_ksm.boot_vms.e1000.user.size_1024 > Hi Michael, it's not any sort of defect or problem, we just did that intentionally for some purpose. And now we had unified it with autotest's style. Thank you so much for kindly remind. :) -- Yolkfull Regards, ^ permalink raw reply [flat|nested] 6+ messages in thread
* [KVM-AUTOTEST PATCH] stress_boot - Boot VMs until one of them becomes unresponsive - Version2 2009-06-11 8:53 ` [KVM-AUTOTEST PATCH] A test patch - Boot VMs until one of them becomes unresponsive Michael Goldish 2009-06-11 9:46 ` Yolkfull Chow @ 2009-06-12 13:27 ` Yolkfull Chow 2009-06-18 8:17 ` Lucas Meneghel Rodrigues 1 sibling, 1 reply; 6+ messages in thread From: Yolkfull Chow @ 2009-06-12 13:27 UTC (permalink / raw) To: kvm; +Cc: Michael Goldish, Uri Lublin [-- Attachment #1: Type: text/plain, Size: 176 bytes --] Following are the differences between version 1: 1) use framework to destroy VMs except the main_vm 2) use snapshot to boot other VMs except the first one Regards, Yolkfull [-- Attachment #2: stress_boot_v2.patch --] [-- Type: text/plain, Size: 4431 bytes --] diff --git a/client/tests/kvm/kvm.py b/client/tests/kvm/kvm.py index 9428162..1f553b4 100644 --- a/client/tests/kvm/kvm.py +++ b/client/tests/kvm/kvm.py @@ -53,6 +53,7 @@ class kvm(test.test): "autotest": test_routine("kvm_tests", "run_autotest"), "kvm_install": test_routine("kvm_install", "run_kvm_install"), "linux_s3": test_routine("kvm_tests", "run_linux_s3"), + "stress_boot": test_routine("kvm_tests", "run_stress_boot"), } # Make it possible to import modules from the test's bindir diff --git a/client/tests/kvm/kvm_tests.cfg.sample b/client/tests/kvm/kvm_tests.cfg.sample index c73da7c..ff7abea 100644 --- a/client/tests/kvm/kvm_tests.cfg.sample +++ b/client/tests/kvm/kvm_tests.cfg.sample @@ -81,6 +81,10 @@ variants: - linux_s3: install setup type = linux_s3 + - stress_boot: + type = stress_boot + max_vms = 5 + # NICs variants: - @rtl8139: @@ -101,6 +105,8 @@ variants: ssh_status_test_command = echo $? username = root password = 123456 + stress_boot: + alive_test_cmd = ps aux variants: - Fedora: @@ -291,6 +297,8 @@ variants: password = 123456 migrate: migration_test_command = ver && vol + stress_boot: + alive_test_cmd = systeminfo variants: - Win2000: diff --git a/client/tests/kvm/kvm_tests.py b/client/tests/kvm/kvm_tests.py index 54d2a7a..fde33bb 100644 --- a/client/tests/kvm/kvm_tests.py +++ b/client/tests/kvm/kvm_tests.py @@ -466,3 +466,77 @@ def run_linux_s3(test, params, env): logging.info("VM resumed after S3") session.close() + + +def run_stress_boot(tests, params, env): + """ + Boots VMs until one of them becomes unresponsive, and records the maximum + number of VMs successfully started: + 1) boot the first vm + 2) boot the second vm cloned from the first vm, check whether it boots up + and all booted vms can ssh-login + 3) go on until cannot create VM anymore or cannot allocate memory for VM + + @param test: kvm test object + @param params: Dictionary with the test parameters + @param env: Dictionary with test environment. + """ + # boot the first vm + vm = kvm_utils.env_get_vm(env, params.get("main_vm")) + + if not vm: + raise error.TestError("VM object not found in environment") + if not vm.is_alive(): + raise error.TestError("VM seems to be dead; Test requires a living VM") + + logging.info("Waiting for first guest to be up...") + + session = kvm_utils.wait_for(vm.ssh_login, 240, 0, 2) + if not session: + raise error.TestFail("Could not log into first guest") + + num = 1 + vms = [] + sessions = [session] + + # boot the VMs + while num <= int(params.get("max_vms")): + try: + vm_name = "vm" + str(num) + + # clone vm according to the first one + vm_params = params.copy() + vm_params['image_snapshot'] = "yes" + vm_params['kill_vm'] = "yes" + vm_params['kill_vm_gracefully'] = "no" + curr_vm = vm.clone(vm_name, vm_params) + kvm_utils.env_register_vm(env, vm_name, curr_vm) + params['vms'] += " " + vm_name + + #vms.append(curr_vm) + logging.info("Booting guest #%d" % num) + if not curr_vm.create(): + raise error.TestFail("Cannot create VM #%d" % num) + + curr_vm_session = kvm_utils.wait_for(curr_vm.ssh_login, 240, 0, 2) + if not curr_vm_session: + raise error.TestFail("Could not log into guest #%d" % num) + + logging.info("Guest #%d boots up successfully" % num) + sessions.append(curr_vm_session) + + # check whether all previous ssh sessions are responsive + for i, vm_session in enumerate(sessions): + if vm_session.get_command_status(params.get("alive_test_cmd")): + raise error.TestFail("Session #%d is not responsive" % i) + num += 1 + + except (error.TestFail, OSError): + for se in sessions: + se.close() + logging.info("Total number booted: %d" % num) + raise + else: + for se in sessions: + se.close() + logging.info("Total number booted: %d" % num) ^ permalink raw reply related [flat|nested] 6+ messages in thread
* Re: [KVM-AUTOTEST PATCH] stress_boot - Boot VMs until one of them becomes unresponsive - Version2 2009-06-12 13:27 ` [KVM-AUTOTEST PATCH] stress_boot - Boot VMs until one of them becomes unresponsive - Version2 Yolkfull Chow @ 2009-06-18 8:17 ` Lucas Meneghel Rodrigues 2009-06-18 9:16 ` Yolkfull Chow 0 siblings, 1 reply; 6+ messages in thread From: Lucas Meneghel Rodrigues @ 2009-06-18 8:17 UTC (permalink / raw) To: Yolkfull Chow; +Cc: kvm, Michael Goldish, Uri Lublin On Fri, 2009-06-12 at 21:27 +0800, Yolkfull Chow wrote: > Following are the differences between version 1: > > 1) use framework to destroy VMs except the main_vm > 2) use snapshot to boot other VMs except the first one > > > Regards, > Yolkfull Hi Yolkfull, Michael and Uri already made a thorough first comment about your test, and I have a minor thing to note (and I admit I'm being picky here): + # check whether all previous ssh sessions are responsive + for i, vm_session in enumerate(sessions): + if vm_session.get_command_status(params.get("alive_test_cmd")): + raise error.TestFail("Session #%d is not responsive" % i) + num += 1 + + except (error.TestFail, OSError): + for se in sessions: + se.close() + logging.info("Total number booted: %d" % num) + raise + else: + for se in sessions: + se.close() + logging.info("Total number booted: %d" % num) When the test finishes successfuly, the counter num will be incremented by one, will break the while condition and later will be used to print the number of vms successfuly booted. In the end the total number of vms booted that the test will report is the actual number of vms booted plus 1. To fix this we can either: * Just subtract 1 from num at the last info logging call; * Remove num initialization and replace the while loop by a for num in range(1, int(params.get("max_vms")): this way we don't even need to increment num manually. It's up to you which one you're going to implement. I have tested your code and it works fine (aside from the minor cosmetic issue). Once you send me an updated version, I am going to apply it. Thanks for your work! -- Lucas Meneghel Rodrigues Software Engineer (QE) Red Hat - Emerging Technologies ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [KVM-AUTOTEST PATCH] stress_boot - Boot VMs until one of them becomes unresponsive - Version2 2009-06-18 8:17 ` Lucas Meneghel Rodrigues @ 2009-06-18 9:16 ` Yolkfull Chow 2009-06-19 13:06 ` Lucas Meneghel Rodrigues 0 siblings, 1 reply; 6+ messages in thread From: Yolkfull Chow @ 2009-06-18 9:16 UTC (permalink / raw) To: Lucas Meneghel Rodrigues; +Cc: kvm, Michael Goldish, Uri Lublin [-- Attachment #1: Type: text/plain, Size: 2236 bytes --] On 06/18/2009 04:17 PM, Lucas Meneghel Rodrigues wrote: > On Fri, 2009-06-12 at 21:27 +0800, Yolkfull Chow wrote: > >> Following are the differences between version 1: >> >> 1) use framework to destroy VMs except the main_vm >> 2) use snapshot to boot other VMs except the first one >> >> >> Regards, >> Yolkfull >> > Hi Yolkfull, Michael and Uri already made a thorough first comment about > your test, and I have a minor thing to note (and I admit I'm being picky > here): > > + # check whether all previous ssh sessions are responsive > + for i, vm_session in enumerate(sessions): > + if vm_session.get_command_status(params.get("alive_test_cmd")): > + raise error.TestFail("Session #%d is not responsive" % i) > + num += 1 > + > + except (error.TestFail, OSError): > + for se in sessions: > + se.close() > + logging.info("Total number booted: %d" % num) > + raise > + else: > + for se in sessions: > + se.close() > + logging.info("Total number booted: %d" % num) > > When the test finishes successfuly, the counter num will be incremented > by one, will break the while condition and later will be used to print > the number of vms successfuly booted. In the end the total number of vms > booted that the test will report is the actual number of vms booted plus > 1. To fix this we can either: > > * Just subtract 1 from num at the last info logging call; > * Remove num initialization and replace the while loop by a > > for num in range(1, int(params.get("max_vms")): > > this way we don't even need to increment num manually. > > It's up to you which one you're going to implement. I have tested your > code and it works fine (aside from the minor cosmetic issue). Once you > send me an updated version, I am going to apply it. > > Thanks for your work! > > Hi Lucas, I also found the number counting problem later after sending the patch. I haven't been able to re-send the updated one since I got some other things to deal with in these days. Sorry for that... Please see attachment for updated version. Thank you so much. :) -- Yolkfull Regards, [-- Attachment #2: stress_boot.patch --] [-- Type: text/plain, Size: 4308 bytes --] diff --git a/client/tests/kvm/kvm.py b/client/tests/kvm/kvm.py index 9428162..43d7bbc 100644 --- a/client/tests/kvm/kvm.py +++ b/client/tests/kvm/kvm.py @@ -53,6 +53,7 @@ class kvm(test.test): "autotest": test_routine("kvm_tests", "run_autotest"), "kvm_install": test_routine("kvm_install", "run_kvm_install"), "linux_s3": test_routine("kvm_tests", "run_linux_s3"), + "stress_boot": test_routine("kvm_tests", "run_stress_boot"), } # Make it possible to import modules from the test's bindir diff --git a/client/tests/kvm/kvm_tests.cfg.sample b/client/tests/kvm/kvm_tests.cfg.sample index 2c0b321..7f4e9b9 100644 --- a/client/tests/kvm/kvm_tests.cfg.sample +++ b/client/tests/kvm/kvm_tests.cfg.sample @@ -82,6 +82,11 @@ variants: - linux_s3: install setup type = linux_s3 + - stress_boot: + type = stress_boot + max_vms = 5 + alive_test_cmd = ps aux + # NICs variants: - @rtl8139: @@ -292,6 +297,8 @@ variants: password = 123456 migrate: migration_test_command = ver && vol + stress_boot: + alive_test_cmd = systeminfo variants: - Win2000: diff --git a/client/tests/kvm/kvm_tests.py b/client/tests/kvm/kvm_tests.py index 4270cae..11f7bf0 100644 --- a/client/tests/kvm/kvm_tests.py +++ b/client/tests/kvm/kvm_tests.py @@ -474,3 +474,77 @@ def run_linux_s3(test, params, env): logging.info("VM resumed after S3") session.close() + + +def run_stress_boot(tests, params, env): + """ + Boots VMs until one of them becomes unresponsive, and records the maximum + number of VMs successfully started: + 1) boot the first vm + 2) boot the second vm cloned from the first vm, check whether it boots up + and all booted vms can ssh-login + 3) go on until cannot create VM anymore or cannot allocate memory for VM + + @param test: kvm test object + @param params: Dictionary with the test parameters + @param env: Dictionary with test environment. + """ + # boot the first vm + vm = kvm_utils.env_get_vm(env, params.get("main_vm")) + + if not vm: + raise error.TestError("VM object not found in environment") + if not vm.is_alive(): + raise error.TestError("VM seems to be dead; Test requires a living VM") + + logging.info("Waiting for first guest to be up...") + + session = kvm_utils.wait_for(vm.ssh_login, 240, 0, 2) + if not session: + raise error.TestFail("Could not log into first guest") + + num = 2 + vms = [] + sessions = [session] + + # boot the VMs + while num <= int(params.get("max_vms")): + try: + vm_name = "vm" + str(num) + + # clone vm according to the first one + vm_params = params.copy() + vm_params['image_snapshot'] = "yes" + vm_params['kill_vm'] = "yes" + vm_params['kill_vm_gracefully'] = "no" + curr_vm = vm.clone(vm_name, vm_params) + kvm_utils.env_register_vm(env, vm_name, curr_vm) + params['vms'] += " " + vm_name + + #vms.append(curr_vm) + logging.info("Booting guest #%d" % num) + if not curr_vm.create(): + raise error.TestFail("Cannot create VM #%d" % num) + + curr_vm_session = kvm_utils.wait_for(curr_vm.ssh_login, 240, 0, 2) + if not curr_vm_session: + raise error.TestFail("Could not log into guest #%d" % num) + + logging.info("Guest #%d boots up successfully" % num) + sessions.append(curr_vm_session) + + # check whether all previous ssh sessions are responsive + for i, vm_session in enumerate(sessions): + if vm_session.get_command_status(params.get("alive_test_cmd")): + raise error.TestFail("Session #%d is not responsive" % i) + num += 1 + + except (error.TestFail, OSError): + for se in sessions: + se.close() + logging.info("Total number booted: %d" % (num - 1)) + raise + else: + for se in sessions: + se.close() + logging.info("Total number booted: %d" % (num -1)) ^ permalink raw reply related [flat|nested] 6+ messages in thread
* Re: [KVM-AUTOTEST PATCH] stress_boot - Boot VMs until one of them becomes unresponsive - Version2 2009-06-18 9:16 ` Yolkfull Chow @ 2009-06-19 13:06 ` Lucas Meneghel Rodrigues 0 siblings, 0 replies; 6+ messages in thread From: Lucas Meneghel Rodrigues @ 2009-06-19 13:06 UTC (permalink / raw) To: Yolkfull Chow; +Cc: kvm, Michael Goldish, Uri Lublin On Thu, 2009-06-18 at 17:16 +0800, Yolkfull Chow wrote: > Hi Lucas, I also found the number counting problem later after sending > the patch. I haven't been able to re-send the updated one since I got > some other things to deal with in these days. Sorry for that... > > Please see attachment for updated version. Thank you so much. :) Ok, patch applied. Thank you very much for your work! ^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2009-06-19 13:06 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
[not found] <120253480.1747631244710010660.JavaMail.root@zmail05.collab.prod.int.phx2.redhat.com>
2009-06-11 8:53 ` [KVM-AUTOTEST PATCH] A test patch - Boot VMs until one of them becomes unresponsive Michael Goldish
2009-06-11 9:46 ` Yolkfull Chow
2009-06-12 13:27 ` [KVM-AUTOTEST PATCH] stress_boot - Boot VMs until one of them becomes unresponsive - Version2 Yolkfull Chow
2009-06-18 8:17 ` Lucas Meneghel Rodrigues
2009-06-18 9:16 ` Yolkfull Chow
2009-06-19 13:06 ` Lucas Meneghel Rodrigues
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox