Increase timeout for zuul to settle in tests

We're seeing a lot of occurrences where a test case failed with the
message 'Timeout waiting for zuul to settle' withoutany obvious
reason. After digging into one of these logs more deeply it gets
aborted just while doing regular git stuff during job
preparation. Thus it looks like the default timeout of 30 seconds is
just not enough on some slower nodes.

[1] Log snippet
2019-02-04 06:39:57,848 zuul.AnsibleJob                  DEBUG    [build: 19a6f8c3d35e49c29f89e83b8cb1204a] Create reference refs/heads/master at 1b86034fbdea80f4973c15b72ac85a676da0c315 in /tmp/tmpljq8cb9b
/zuul-test/19a6f8c3d35e49c29f89e83b8cb1204a/work/src/review.example.com/org/project
2019-02-04 06:39:57,859 git.cmd                          DEBUG    Popen(['git', 'cat-file', '--batch-check'], cwd=/tmp/tmpljq8cb9b/zuul-test/19a6f8c3d35e49c29f89e83b8cb1204a/work/src/review.example.com/org/
project, universal_newlines=False, shell=None)
2019-02-04 06:39:57,868 zuul.test                        ERROR    Timeout waiting for Zuul to settle
2019-02-04 06:39:57,869 zuul.test                        ERROR    Queue status:
2019-02-04 06:39:57,869 zuul.test                        ERROR      <queue.Queue object at 0x7fea0c2426d8>: True
2019-02-04 06:39:57,869 zuul.test                        ERROR      <queue.Queue object at 0x7fea0c242278>: True
2019-02-04 06:39:57,869 zuul.test                        ERROR      <zuul.lib.queue.MergedQueue object at 0x7fea0c242630>: True
2019-02-04 06:39:57,869 zuul.test                        ERROR      <queue.Queue object at 0x7fea0c095eb8>: True
2019-02-04 06:39:57,869 zuul.test                        DEBUG    <Build 19a6f8c3d35e49c29f89e83b8cb1204a of project-test1 voting:True on <Worker Unknown>> has not reported start
2019-02-04 06:39:57,869 zuul.test                        ERROR    All builds waiting: False
2019-02-04 06:39:57,870 zuul.test                        ERROR    All builds reported: True
2019-02-04 06:39:57,870 zuul.test                        ERROR    All requests completed: True
2019-02-04 06:39:57,870 zuul.test                        ERROR    Merge client jobs: set()

Change-Id: I48b0e452c894e0767625465daa749837bb1bd8fd
This commit is contained in:
Tobias Henkel 2019-02-04 08:04:20 +01:00
parent b4e6247ab5
commit f08d66f81f
No known key found for this signature in database
GPG Key ID: 03750DEC158E5FA2
1 changed files with 1 additions and 1 deletions

View File

@ -2187,7 +2187,7 @@ class PostgresqlSchemaFixture(fixtures.Fixture):
class BaseTestCase(testtools.TestCase):
log = logging.getLogger("zuul.test")
wait_timeout = 30
wait_timeout = 60
def attachLogs(self, *args):
def reader():