Many of the Caffeine tests include a loop around a repeatable subtest that can run an arbitrary number of times. Some of these subtests could exhibit timing-dependent behaviors (especially in the presence of defects), and some even include explicitly pseudo-random behaviors where increasing iterations also potentially increases test coverage.
This enhancement request is to add some command-line arguments to the Caffeine tests, specifically enabling the user to scale-up the number of iterations in repeatable tests (e.g. to increase coverage and potentially help diagnose rare defects), or even scale-down the number of iterations (e.g. to reduce execution time when running on under-powered or under-provisioned hardware).
Many of the Caffeine tests include a loop around a repeatable subtest that can run an arbitrary number of times. Some of these subtests could exhibit timing-dependent behaviors (especially in the presence of defects), and some even include explicitly pseudo-random behaviors where increasing iterations also potentially increases test coverage.
This enhancement request is to add some command-line arguments to the Caffeine tests, specifically enabling the user to scale-up the number of iterations in repeatable tests (e.g. to increase coverage and potentially help diagnose rare defects), or even scale-down the number of iterations (e.g. to reduce execution time when running on under-powered or under-provisioned hardware).