Re: make check run time

[Loic Dachary <loic@dachary.org>]

[-- Attachment #1: Type: text/plain, Size: 6150 bytes --]

Hi Jason,

On 19/06/2015 13:44, Jason Dillaman wrote:
> 
> Wow, thanks for compiling this -- I had no idea the times were this slow. In a perfect world, gtest would allow us to run a subset of tests via the command-line, but that isn't possible. However, I think we can safely move the valgrind tests to the teuthology RBD suite. 
> 
> As for the other RBD unit test script, it's slower now that lockdep checking is always running. Since it runs through the same tests multiple times with the different features enables each time, we could definitely consolidate down to perhaps just 2 or 3. We can also perhaps only enable lockdep checking on the teuthology runs. 
> 

I'm glad there are easy remedies ;-)

Cheers

>> On Jun 19, 2015, at 3:41 AM, Loic Dachary <loic@dachary.org> wrote:
>>
>> Hi,
>>
>> Below is the sorted list of the longest running tests (measured by comparing the .log creation and modification times after a successfully run), in seconds. Note that when tests run in parallel, the longest running test caps the total run time: make check can't run under 1205 seconds == 20 minutes because of ./src/test/run-rbd-valgrind-unit-tests.sh. I reality, since the parallel run is not perfect, it takes about 30 minutes because src/test/run-rbd-valgrind-unit-tests.sh is not the first to run.
>>
>> I'll take a look at src/test/osd/osd-scrub-repair.sh: I'm sure it can run within 2 minutes instead of 8 and still provide the same coverage. It would be great if you could do the same with the rbd tests. Running them as part of make check has been beneficial as it revealed rare conditions because they have been run many times a day, more often than teuthology tests. Hopefully there is a way to run them faster without sacrificing coverage ?
>>
>> Cheers
>>
>> 1205 ./src/test/run-rbd-valgrind-unit-tests.sh.log
>> 1174 ./src/test/run-rbd-unit-tests.sh.log
>> 501 ./src/test/osd/osd-scrub-repair.sh.log
>> 370 ./src/unittest_erasure_code_shec_all.log
>> 297 ./src/test/cephtool-test-mon.sh.log
>> 247 ./src/test/test-ceph-helpers.sh.log
>> 162 ./qa/workunits/erasure-code/encode-decode-non-regression.sh.log
>> 145 ./src/test/ceph_objectstore_tool.py.log
>> 121 ./src/test/erasure-code/test-erasure-eio.sh.log
>> 80 ./src/test/erasure-code/test-erasure-code.sh.log
>> 78 ./src/test/cephtool-test-mds.sh.log
>> 61 ./src/unittest_erasure_code_shec_thread.log
>> 52 ./src/test/mon/osd-pool-create.sh.log
>> 49 ./src/test/osd/osd-bench.sh.log
>> 40 ./src/test/encoding/readable.sh.log
>> 38 ./src/unittest_crush.log
>> 33 ./src/test/mon/osd-erasure-code-profile.sh.log
>> 32 ./src/test/pybind/test_ceph_argparse.py.log
>> 29 ./src/test/mon/osd-crush.sh.log
>> 20 ./src/ceph-detect-init/run-tox.sh.log
>> 19 ./src/test/mon/misc.sh.log
>> 17 ./src/test/encoding/check-generated.sh.log
>> 15 ./src/test/osd/osd-config.sh.log
>> 12 ./src/unittest_crc32c.log
>> 12 ./src/test/osd/osd-copy-from.sh.log
>> 12 ./src/test/cephtool-test-osd.sh.log
>> 7 ./src/unittest_workqueue.log
>> 7 ./src/unittest_bloom_filter.log
>> 6 ./src/test/mon/mon-handle-forward.sh.log
>> 5 ./src/unittest_erasure_code_shec.log
>> 5 ./src/unittest_admin_socket.log
>> 4 ./src/unittest_crypto.log
>> 4 ./src/test/mon/mkfs.sh.log
>> 2 ./src/unittest_signals.log
>> 2 ./src/unittest_heartbeatmap.log
>> 2 ./src/unittest_erasure_code_isa.log
>> 2 ./src/unittest_bufferlist.sh.log
>> 2 ./src/unittest_bufferlist.log
>> 1 ./src/unittest_throttle.log
>> 1 ./src/unittest_osdmap.log
>> 1 ./src/unittest_osd_osdcap.log
>> 0 ./src/unittest_xlist.log
>> 0 ./src/unittest_util.log
>> 0 ./src/unittest_utf8.log
>> 0 ./src/unittest_texttable.log
>> 0 ./src/unittest_tableformatter.log
>> 0 ./src/unittest_strtol.log
>> 0 ./src/unittest_striper.log
>> 0 ./src/unittest_str_map.log
>> 0 ./src/unittest_str_list.log
>> 0 ./src/unittest_sloppy_crc_map.log
>> 0 ./src/unittest_simple_spin.log
>> 0 ./src/unittest_sharedptr_registry.log
>> 0 ./src/unittest_shared_cache.log
>> 0 ./src/unittest_safe_io.log
>> 0 ./src/unittest_run_cmd.log
>> 0 ./src/unittest_readahead.log
>> 0 ./src/unittest_rbd_replay.log
>> 0 ./src/unittest_prioritized_queue.log
>> 0 ./src/unittest_prebufferedstreambuf.log
>> 0 ./src/unittest_pglog.log
>> 0 ./src/unittest_perf_counters.log
>> 0 ./src/unittest_osdscrub.log
>> 0 ./src/unittest_osd_types.log
>> 0 ./src/unittest_on_exit.log
>> 0 ./src/unittest_mon_pgmap.log
>> 0 ./src/unittest_mon_moncap.log
>> 0 ./src/unittest_mime.log
>> 0 ./src/unittest_mds_types.log
>> 0 ./src/unittest_mds_authcap.log
>> 0 ./src/unittest_lru.log
>> 0 ./src/unittest_log.log
>> 0 ./src/unittest_librados_config.log
>> 0 ./src/unittest_librados.log
>> 0 ./src/unittest_libcephfs_config.log
>> 0 ./src/unittest_lfnindex.log
>> 0 ./src/unittest_ipaddr.log
>> 0 ./src/unittest_io_priority.log
>> 0 ./src/unittest_hitset.log
>> 0 ./src/unittest_gather.log
>> 0 ./src/unittest_formatter.log
>> 0 ./src/unittest_flatindex.log
>> 0 ./src/unittest_escape.log
>> 0 ./src/unittest_erasure_code_plugin_lrc.log
>> 0 ./src/unittest_erasure_code_plugin_jerasure.log
>> 0 ./src/unittest_erasure_code_plugin_isa.log
>> 0 ./src/unittest_erasure_code_plugin.log
>> 0 ./src/unittest_erasure_code_lrc.log
>> 0 ./src/unittest_erasure_code_jerasure.log
>> 0 ./src/unittest_erasure_code_example.log
>> 0 ./src/unittest_erasure_code.log
>> 0 ./src/unittest_encoding.log
>> 0 ./src/unittest_ecbackend.log
>> 0 ./src/unittest_daemon_config.log
>> 0 ./src/unittest_crypto_init.log
>> 0 ./src/unittest_crush_wrapper.log
>> 0 ./src/unittest_context.log
>> 0 ./src/unittest_confutils.log
>> 0 ./src/unittest_config.log
>> 0 ./src/unittest_chain_xattr.log
>> 0 ./src/unittest_ceph_crypto.log
>> 0 ./src/unittest_ceph_compatset.log
>> 0 ./src/unittest_ceph_argparse.log
>> 0 ./src/unittest_blkdev.log
>> 0 ./src/unittest_bit_vector.log
>> 0 ./src/unittest_base64.log
>> 0 ./src/unittest_arch.log
>> 0 ./src/unittest_addrs.log
>> 0 ./src/test/pybind/test_ceph_daemon.py.log
>>
>>
>> -- 
>> Loïc Dachary, Artisan Logiciel Libre
>>

-- 
Loïc Dachary, Artisan Logiciel Libre


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 198 bytes --]