The most important thing is that the URL for glean is actually
wrong, which causes jobs to fail.
Also, change documentation while we're changing things.
Depends-On: https://review.opendev.org/655133
Change-Id: I127a33bfc4a3e33249120dcc7ef6142ce4e52a97
Infra has a mirror for Debian Buster now, add boot tests
Depends-On: https://review.openstack.org/649496
Change-Id: Ib1567b2576631c078fe11d0f250aeb4e6f9fa0b3
This installs dogpile.cache from upstream master for the -src job. We
recently saw breakage with openstacksdk and new versions of
dogpile.cache, this would help catch this in the future as both will
be installed from master.
Depends-On: https://review.openstack.org/625467
Depends-On: https://review.openstack.org/626075
Change-Id: I7ac90804504ff37b72d089cf0cd2c7c48858da19
Replace Fedora 28 with Fedora 29 functional testing.
Note this changes our Red Hat platforms to use NetworkManager for
interface configuration, rather than legacy scripts. Fedora 29 has
split the legacy scripts into a new package and it marked for future
removal. NetworkManager is the default on Centos 7 and will also be
on Centos 8, so it makes sense to use it there too.
Depends-On: https://review.openstack.org/619120
Change-Id: I640838c68a05f3b22683c1e90279725a77678526
Running a bit behind on this transition ... s/27/28/ to update to
Fedora 28. This is the default in dib now.
Change-Id: I648ab9d9ba4bba7323c432c65f3ef056703f4303
openSUSE Leap 15 is the latest version of openSUSE, bring an image
online to validate we can properly build it.
Depends-On: https://review.openstack.org/#/c/572424/
Change-Id: Ib0f48d9788aafd763e857c2d33784c4f75af4c17
Now that debian-stretch is working as expected, we can remove
debian-jessie.
Change-Id: If897757023772bb4549e40e7fcd048998175fb5b
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Increase our test coverage for debian-stretch, as this is the latesst
stable version of debian.
Change-Id: I05cbfe9735eb0b3900203fbd423f68483b1cbf5d
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Since ubuntu-bionic is the next LTS version of Ubuntu, start work to
ensure we can build DIBs for it.
We'll also need to bring online AFS mirrors.
Change-Id: I2e523eee4e99e5aea3d57d7ad224dbec39e2e4a5
Depends-On: https://review.openstack.org/485748
Depends-On: https://review.openstack.org/545611
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
We'd like to bring opensuse-tumbleweed online for openstack-infra, so
enable testing of tumbleweed to help catch things.
Change-Id: Id0a1fbf6f3c7df63402670f8c54f7fb3af652ae5
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Fedora-27 is the latest supported version, switch to it. We also have
fedora-27 DIBs live in openstack-infra.
Change-Id: Iff9e01a8aab4ba50c42e5e72fabbe8cb20bc821c
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Both fedora-25 and ubuntu-precise are nolonger tested. Remove dead
logic.
Change-Id: Ib54827bfea01cec39bd161a5a94fee350556102f
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
This implements legacy-dsvm-nodepool-[distro]-src jobs as native jobs.
This seems like the best home for them, as they are run by multiple
externals such as glean and diskimage-builder.
Previously the defaults were set such that with no arguments, the
trusty test ran for nodepool-functional-py35.
To facilitate better templating, this turns all builds off by default.
The nodepool functional test is moved to a base template, and then
nodepool-functional-py35 explicitly builds and boots Xenial now
(trusty doesn't seem very useful).
The check_devstack_plugin.sh script runs after devstack, so needs to
source the stackrc file to pull in the variables about what images are
paused or not.
Additionally, the path for the script is fixed to nodepool so we can
run the job from other projects.
The redhat, ubuntu and suse legacy tests are re-implemented for their
respective builds.
This also highlighted that the opensuse test wasn't actually doing
anything. This actually adds the configuration to build opensuse-423.
Needed-By: https://review.openstack.org/543270
Needed-By: https://review.openstack.org/543328
Needed-By: https://review.openstack.org/543329
Needed-By: https://review.openstack.org/543330
Change-Id: I203d149a1d63ac8358e1c8b878d9c2bc0ba67c02
Fedora 26 is now the latest version, so lets start supporting it for
nodepool devstack testing.
https://fedoraproject.org/wiki/Releases/26/Schedule
Change-Id: I9cde430a8cda53357851ab527446f6b32919907e
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
This reverts commit e5f5840c27.
Devstack has removed zk support from itself in favor of etcd3. We must
manage our own zk destiny.
Change-Id: Ie68d7da0c0e075826fdba77ba59e05bddb932d7b
The nodepool_id feature may need to be removed. I've kept it to simplify
merging both now and if we do it again later.
A couple of the tests are disabled and need reworking in a subsquent
commit.
Change-Id: I948f9f69ad911778fabb1c498aebd23acce8c89c
The day has come to rename nodepoold to nodepool-launcher.
Change-Id: Ic04e3cf2dbdaf914bf8f92d073acb972380708f1
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Add more test coverage for debian, due to recent issues with
system-config debian-jessie jobs failing. It also give projects like
glean and diskimage-builder more coverage.
Change-Id: If5e7fa98ee379f7339148de3ea6574bbcda2b032
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
We mistakenly skipped this setting, as a results fedora-25 images are
built by default, causing un needed churn for our nodepool project
jobs.
Change-Id: Id91991a490709f9bbac5a4f6e9847e047b83ca51
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
devstack grew the ability to install and configure zookeeper in support
of DLM and tooz. Go ahead and use it.
Change-Id: I0436abf286acc1e77d96b4df1624b8d3435ec4be
We mistakenly skipped this setting, as a results fedora-25 images are
built by default, causing un needed churn for our nodepool project
jobs.
Change-Id: Id91991a490709f9bbac5a4f6e9847e047b83ca51
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Change I1479c5ff5e548da559be6dc8eb51d9635a0e2c7e has added glean as
lib-from-git install, but we're not installing it in the plugin. Add
it.
Change-Id: I144cbef93a0831cbe21b77d499130cedc2d6cc7f
Add the ability for different jobs to control which images we build in
our dsvm job. This is needed so we can allow diskimage-builder more
control of which images to build.
Remove hardcoded apt-get for installing openssh-server, we can now use
the openssh-server element from diskimage-builder (which supports more
operating systems).
Change-Id: Ib6f48648e9ada8fd626a1811cdce262df0768c08
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
We don't have plans to support building images from snapshots in the
future. If we add it back, it will require a new builder implementation
(with zookeeper interface, etc) anyway.
In addition to removing essentially dead code, this also begins the
process of simplifying the configuration file. It removes 'base-image'
and 'setup' from the provider image attributes since they are only used
for snapshot images.
Change-Id: I68e0d2c7017cfebe35341189b5aedb0556bcd78b
Add the option to install diskimage-builder from git, rather than pip,
so we can run this test against dib changes to see if we get something
useful.
Change-Id: I480dcb201aa93bc3d208e2bf5e96bcee6dd7df09
Enable a fake statsd listener and export the variables to make
nodepool report stats. This ensures we're covering the path of having
this enabled during testing.
Change-Id: I43d6b5d6fa26df489a025f580c7edaeac2bbad4a
Add entrypoint so builders can be run on their own using the
nodepool-builder command. Also update config processing so builders do
not require things like a zmq-publisher.
Change-Id: Ied1142990ca630f22044a472db77920daa4c2e5a
Depends on a new secure.conf file to grab mysql
connection and jenkins credentials. By this way,
nodepool.yaml is just a flat file without credentials,
that can be passed externally.
Co-Authored-By: Ramy Asselin <ramy.asselin@hpe.com>
Depends-On: Ie9381740e3644feaee1f1b201499e3a253677f39
Change-Id: Ifa4d500c52974b9fd3a0b7fd9c28cf8f52899ca9
In the devstack plugin don't write the images to the config dir for
nodepool. This prevents us from copying the built qcow2 to the log
server (saves disk space and speeds up the jobs). This also provides
logical separation from the inputs (config) to nodepool and the outputs
(images) of nodepool.
Change-Id: I066ccda8a564bf9ea144a3dda9f6d506bb130a61
Use the devstack LIBS_FROM_GIT mechanism to install shade from source if
we have been asked to. This will allow us to do integration testing of
shade and nodepool using the dsvm job.
Change-Id: Ieee1225d15ba98959de5f809df240254433d5510
Depends-On: If323a7ab577c7942f4f98a42bbbb291c86d5b6f7
So that nodepoold runs with a logging configuration more like what
would be expected in production (eg, not one that logs debug messages
from all libraries).
Change-Id: I5113898bf57d1f365ad345b772606feec7c9e818
We need to run a gearman server and specify it in our config if we want
to support features which require it.
Change-Id: Ibb4d59aca2301438a30d2409e38c01b1c9a3564a
This creates a nodepool devstack plugin which can be easily enabled
through the plugin interface of:
enable_plugin nodepool git://git.openstack.org/openstack-infra/nodepool
It makes it easy to bring up a testing environment for nodepool locally.
Change-Id: Ia69412a873286c30459aa020cfb1b625590bb4ff
James E. Blair