8ce900a Give an option to increase the timeout in tests.

1 file Authored by jaruga 3 years ago, Committed by vondruch 3 years ago,
1 file changed. 4 lines added. 1 lines removed.
    Give an option to increase the timeout in tests.
    
    Because setting the option makes some tests stable that are currently randomly
    failing with error on especially s390x and aarch64.
    
    We observed the failing tests are calling `assert_in_out_err` method
    calling `invoke_ruby` calling method.
    
    Then when the `th_stdout.join(timeout)` or `th_stderr.join(timeout)` returns
    `nil` as thread timeout in `invoke_ruby` method, it causes the error. [1][2]
    
    The `test_timeout_scale` macro is to set the environment variable
    `RUBY_TEST_TIMEOUT_SCALE` to increase the timeout in `apply_timeout_scale`
    method as <new timeout> = <timeout> * <timeout scale>.
    
    As an example, `TestBugReporter#test_bug_reporter_add` test's
    maximum thread timeout was 56+ seconds for the default timeout 10 seconds. [3]
    In this case setting `RUBY_TEST_TIMEOUT_SCALE=6` (6 * 10 = 60) is good enough
    for 56+ seconds.
    
    [1] https://github.com/ruby/ruby/blob/v2_7_1/tool/lib/envutil.rb#L149
    [2] https://bugs.ruby-lang.org/issues/16492#note-8
    [3] https://bugs.ruby-lang.org/issues/16492#note-4
    
        
file modified
+4 -1