Commit Graph

104 Commits

Author SHA1 Message Date
James E. Blair 2a5822ea8b Split job definitions into multiple files
We have too many jobs to put them all in one file; split them up
in files which mirror the documentation.

Change-Id: Ic44f18085ccf0b561a0f4aa0a4274fe8eb99402c
2019-06-27 13:36:03 -07:00
Sorin Sbarnea 1211185f3b Adds tox-molecule job
This adds job definition for running Ansible Molecule testing framework
from inside tox.

This would ease use of molecule testing for any projects that
want to use by avoiding the need to duplicate the setup code across
each repository.

It uses tox `molecule` environment.

Change-Id: I8df4df5448a78b9e21f45fac12d534eb84b29d3d
Needed-By: https://review.opendev.org/#/c/663599/
Needed-By: https://review.opendev.org/#/c/651772/
Needed-By: https://review.opendev.org/#/c/663336/
2019-06-11 16:25:24 +00:00
Zuul 03f3d226a4 Merge "Return javascript content artifact records to Zuul" 2019-06-06 06:39:39 +00:00
James E. Blair e23ece5e55 Return javascript content artifact records to Zuul
When producing javascript content tarballs, return artifact records
to Zuul.

Add a new job, build-javascript-content-tarball, which includes the
role to fetch javascript content tarballs.

Change-Id: Ia247054d0523b81916815151fd57138469f634e0
2019-06-06 06:17:47 +00:00
James E. Blair f1264e0f60 Don't use allowed-projects
If we're going to do this, we need to have a flag day where we
tell everyone to stop using git.zuul-ci.org.

Change-Id: Ieee9641537d23d538970ee15108a7c421d8c6c81
2019-06-05 07:11:56 -07:00
James E. Blair 2f2d6ce3f7 Add a registry test job
This exercises the intermediate and buildset registry roles.

Change-Id: Ic0da2d6b48a7b9f9b616033c70db471ba98181b4
2019-06-03 09:03:35 -07:00
Zuul ad16143c23 Merge "validate-zone-db : add job and make more generic" 2019-05-28 18:58:09 +00:00
Ian Wienand e6ca2e7c84 validate-zone-db : add job and make more generic
There was a request in If3dc95d1348553e5b43683f6a36d324fb978fbed to
make the role more generic so it could handle different layouts of
zone.db files.  Make it so the role can take a list of tuples (domain,
path/to/zone.db) so that we can handle any layouts, and modify the
default searching to build this from the source directory.

Reviews in https://review.opendev.org/660888 suggested making this
defined as a generic job, so a validate-zone-db job is added.

Change-Id: I56cbc027f63787f90eef283eeb2fbb81486dcaf5
2019-05-24 10:00:49 +10:00
Dirk Mueller df3a9882df Switch to TOX_CONSTRAINTS_FILE
This allows to use lower-constraints.txt more easily as input
when everyone has switched over.

Depends-On: https://review.opendev.org/660823

Change-Id: I3f957187ed4f29fcf88db99cb79fb33b21a8dd8d
2019-05-22 22:30:14 +02:00
Paul Belanger ed1323d096 Add tox-py37 job
This is helpful for people that would like to use the py37 target for
tox.

Change-Id: I03eb4a8164a8e6fe5f75bd5cacc7c95f5428adca
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-04-11 18:48:15 -04:00
David Moreau Simard ed9f1d14a0
Add parameter to upload-git-mirror to specify ssh host key
If we attempt to push a mirror to a host we've never connected to
before, it won't be in the SSH known hosts and the mirror will fail.

This makes a new host_key parameter required and the role takes care
of setting it up in the known_hosts for the duration of the job.

Change-Id: I4bd40a289003fe3e88c9af4029576236c064fc3d
Depends-On: https://review.openstack.org/#/c/649183/
2019-04-01 16:34:59 -04:00
Zuul edc6e500eb Merge "Add a job that runs the upload-git-mirror role" 2019-03-29 08:51:51 +00:00
David Moreau Simard 4e951c6af4
Add a job that runs the upload-git-mirror role
This new job can be used by projects to mirror their repository to a
remote git server.

Change-Id: I6c51a6152f546dfdad2d0bfe260e8864e1803f8c
2019-03-28 10:39:25 -04:00
Zuul 884b77472c Merge "run-test-command: support list in test_command variable" 2019-03-26 16:34:41 +00:00
Fabien Boucher 27beae943b Add the tox_install_bindep option to the tox job
If no binary deps are required by a tox run then
give the ability to not run the bindep role.

default is: true

Change-Id: Iacdf54e74126305199c17a932c001bc12c484759
2019-02-11 11:38:29 +01:00
Monty Taylor b2c5e4a132
Update playbook paths for docker image build jobs
When these were copied in from system-config, the paths to the
upload and promote playbooks weren't updated.

Change-Id: I9da5d7dfb980b2b7690652ee186723ee9ab64cd5
2019-01-26 15:42:50 +00:00
James E. Blair 2b7689ba00 Add docker image build jobs
These are generic docker image build and upload jobs which use
the recently added roles of the same names.  With the new
pass-to-parent feature, child jobs can add their own credentials
to these jobs.

Change-Id: I669a9e6616a031837adab8c5c5806431fcca2150
2019-01-22 09:02:44 -08:00
Paul Belanger f8f3050e32 Add dco-license job
This is a follow up to the previous commit, here we are adding a job
called dco-license which only runs on localhost (zuul-executor).

Change-Id: Id624160930b80b5b37a8e05b000106c16fef64e0
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2019-01-11 11:30:26 -05:00
Tristan Cacqueray 1475af7158 run-test-command: support list in test_command variable
This change enable run-test-command to use a list of commands.

Change-Id: I7727c8330593a548a1bc66765bc632abfb9df1c8
2018-11-22 01:23:40 +00:00
Zuul 8abc8c1472 Merge "Remove trigger-readthedocs job" 2018-09-06 05:38:02 +00:00
Andreas Jaeger 002956ee54 Update tox-docs to follow build-sphinx better
The build-sphinx job uses compile and test bindep profiles, update tox-docs to use the same.

tox-docs used to run tools/test_setup due to inheriting from unittests,
remove that inheritance since we do not need it.

Update role bindep to have a default for zuul_work_dir. If this role is
used without unittests, zuul_work_dir is unset.

Change-Id: I5df8b9cd90bf5e4f4c84c7b4514fb9c575898e31
2018-08-22 07:54:42 +02:00
Andreas Jaeger 80ff11f147 Build releasenotes when tox.ini changes
The releasenotes build uses tox.ini, so run the job whenever the file
changes.

Change-Id: I43c49bd255b7990d4dfdc236a5decb7b618e0302
2018-08-16 09:34:33 +02:00
Ian Wienand 8fe3ff1a7e Remove trigger-readthedocs job
This job is no longer useful as RTD requires an authenticated
end-point now.  This has been replaced by the trigger-readthedocs role
in I651efdb093df85cea3ab2eaf1a5a9256c87a2ca4.  The dependent change
removes this job from the docs-on-readthedocs template, so it is now
unused.

Change-Id: I794ab68967e8d31d5522acc7484a11d3ebc88ee9
Depends-On: https://review.openstack.org/583834
2018-07-19 13:29:05 +10:00
Zuul 0a673aa13b Merge "Add simple run-test-command job" 2018-05-09 17:54:06 +00:00
Paul Belanger 65f310e8a9
Add tox-py36 job
Ubuntu bionic (18.04) provides python3.6, lets write a tox job to also
support it.

Change-Id: I7104a2bdc1e568bf83c618bc2127f8622e6ceba9
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2018-05-02 15:32:53 -04:00
Zuul 39c90078d3 Merge "Fix typo in build-sphinx-docs docstring" 2018-04-13 00:39:24 +00:00
Doug Hellmann 6cb1982b0f document that the build-reno-releasenotes job accepts sphinx_python
The variable is defined by the ensure-sphinx role so it can be used with
the job.

Change-Id: Ieb6a96f84e64f8a377483437f754e809012762f5
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2018-04-12 16:49:41 -04:00
James E. Blair bb86be2026 Fix typo in build-sphinx-docs docstring
This causes erroneous rendering.

Change-Id: Idca63d8983227c419d51e2bb39a0866b5fcdb0bf
2018-04-12 13:41:08 -07:00
Andreas Jaeger 4342f983d1 Add simple run-test-command job
Add a simple run-test-command that can be used to run a simple
command or shell-script.

Change-Id: I00bade475b5b224768acde3ef232ca0704d3600e
Needed-By: https://review.openstack.org/548080
Needed-By: https://review.openstack.org/545712
2018-02-26 20:37:53 +01:00
Andreas Jaeger aee28f884e Add abstract attribute to base jobs
Add abstract attribute to base jobs, these should be inherited and not
used as is.

Change-Id: If43e99c0954acf776997d8399b9ea40966b362f6
2018-02-23 17:54:06 +01:00
Zuul d9bd856c59 Merge "Add tox-nodejs-npm base job for python and javascript" 2018-01-05 13:40:20 +00:00
Zuul c6eba6523f Merge "Move revoke-sudo from unittest pre to job run" 2018-01-04 18:42:37 +00:00
Tristan Cacqueray d4d2554716 python-upload-pypi: fix description typo
Change-Id: I21b0c3d9b17f0c0034651e1cdbf0575b6cc81934
2017-12-27 01:02:48 +00:00
Monty Taylor 91d1126097
Add tox-nodejs-npm base job for python and javascript
Sometimes projects are multi-language. Specifically, sometimes they need
to run both javascript and python toolchains. Support this by making a
tox-nodejs-npm job which installs both toolchains, then runs the npm
command followed by the tox command.

Most people won't need/want this, but it should make at least some folks
happy.

Change-Id: Iaedd680a548c6e8159693b7a79cd8676e805aa1f
2017-12-21 12:02:04 -06:00
Monty Taylor 6d8d1a4408
Move revoke-sudo from unittest pre to job run
Having revoke-sudo in the pre playbook of unittest has made us not able
to re-use unittest for javascript, and also means we can't use
nodejs-npm for nodejs-npm-run-test, which is a bit odd.

Instead, add the role to the run playbook for tox and npm, which allows
us to stack and combine things a bit better.

Change-Id: I0c7c508996ad2647db706d4ebf156c5dd96bf9b5
2017-12-21 11:54:54 -06:00
Monty Taylor db099a9da9
Fix build-javascript-content success-url
The content is down a directory beneath npm.

Change-Id: I206eed6c9965264747b64edf58a4339d75f0c93b
2017-12-19 20:50:14 -06:00
Monty Taylor 89f68c5ca0
Fetch built web content in javascript jobs
If a javascript job produces web content that should be deployed (such
as zuul-web or storyboard-webclient) we should collect that in the post
step of the job and put it into the html/ directory.

While in there, add a bunch of get_*: false entries for the stat calls.
Calculating the md5 and whatnot is expensive, and we should really
always set them to false unless we're *using* the hash values.

Change-Id: I9b96656aa5f225e4b069a78442cf0159cadc9009
2017-12-16 20:07:02 -06:00
Andreas Jaeger b809cc556b npm-test needs xvfb etc
The npm-test run for most projects needs the special pre-test job that
the npm changes removed. Readd it to test job.

Also, do no base on nodejs-npm since we need to override the pre script
and do not want both pre scripts to run.

Needed-By: Ibb4d38f150ab8f2029ea704cab0c9719efd57396
Change-Id: Id533690cfad380ceaa88ad08f5c97f35112c8f79
2017-12-15 18:53:26 +01:00
Zuul 09b793cc69 Merge "Revert "Revert "Add sphinx_python variable to sphinx role and job""" 2017-12-15 14:59:30 +00:00
Akihiro Motoki 9cfd8244ce Fix npm-run-test job
npm-run-test is still broken. There is neither of parent and run.

Change-Id: I2bd961e902b1fbd269fc98517e09600290e6ef50
2017-12-15 21:25:11 +09:00
Andreas Jaeger 0e36e746d5 Fix npm-run-test job
Change I5f9d420f1618e9a196b4218bca7055f377349351 updated all npm tests
but forgot to update npm-run-test, jobs now fail with
"cannot find ... playbooks/javascript/run-test.yaml".

Update job the same way as other jobs.

Change-Id: I6fdf9f9c55ce0744012d42afaa940b325669c36e
2017-12-15 11:03:06 +00:00
Monty Taylor b125b917d9
Update javascript jobs to take npm_command variable
Similar to tox, the only difference in these is the command passed to
npm. Update the base job to do that, and the child jobs to use the
variable.

Change-Id: I5f9d420f1618e9a196b4218bca7055f377349351
2017-12-14 09:42:11 -06:00
Andreas Jaeger 88279bd6cc Revert "Revert "Add sphinx_python variable to sphinx role and job""
The first version of this change was broken, fix it with updating
roles/ensure-sphinx/tasks/main.yaml to run the test-requirements check
really on the remove node.

This reverts commit 68ded2251f.

Change-Id: I481e032834fdbf674157b2c9a8fa6f95fc570ddb
2017-12-13 16:31:26 +01:00
Zuul 23c9fde929 Merge "Revert "Add sphinx_python variable to sphinx role and job"" 2017-12-08 12:31:32 +00:00
Jens Harbott (frickler) 68ded2251f Revert "Add sphinx_python variable to sphinx role and job"
This reverts commit 1f8c473765.

Change-Id: I98e7414337d58af0f4819163ee0e88702a52c051
2017-12-08 11:10:45 +00:00
Zuul d50fa12a51 Merge "Add sphinx_python variable to sphinx role and job" 2017-12-08 00:11:39 +00:00
Zuul ab60637718 Merge "Fix npm-run-test" 2017-12-07 16:33:27 +00:00
David Moreau Simard 1f8c473765
Add sphinx_python variable to sphinx role and job
Some projects, such as Zuul itself, need to use python3 to build docs.

This adds a new parameter, sphinx_python, which defines the version
of python to build documentation with. The default is python2 and
projects can choose python3 on a need basis.

Remove the comment about the need for a leading comment, since there
is now a real need for the leading comment anyway.

Replace a few direct references to {{ ansible_user_dir }}/.venv that
should have been using zuul_work_virtualenv.

Update sphinx invocation to source the virtualenv activate first.
Some sphinx modules, such as sphinxcontrib.programoutput, attempt to
execute programs and only invoking sphinx-build with the relative
path causes the paths to not be set up properly.

Co-Authored-By: David Moreau Simard <dmsimard@redhat.com>
Change-Id: Ie5e2c93f88465f4aa746827ff88a585dbaa44fd5
2017-12-05 21:10:15 -05:00
Zuul 0c5031f648 Merge "Remove old python-sdist job" 2017-11-28 09:44:01 +00:00
Zuul b8f6612955 Merge "Set success-url for sphinx-docs to html" 2017-11-22 18:34:31 +00:00