Infra has a mirror for Debian Buster now, add boot tests
Depends-On: https://review.openstack.org/649496
Change-Id: Ib1567b2576631c078fe11d0f250aeb4e6f9fa0b3
Replace Fedora 28 with Fedora 29 functional testing.
Note this changes our Red Hat platforms to use NetworkManager for
interface configuration, rather than legacy scripts. Fedora 29 has
split the legacy scripts into a new package and it marked for future
removal. NetworkManager is the default on Centos 7 and will also be
on Centos 8, so it makes sense to use it there too.
Depends-On: https://review.openstack.org/619120
Change-Id: I640838c68a05f3b22683c1e90279725a77678526
Running a bit behind on this transition ... s/27/28/ to update to
Fedora 28. This is the default in dib now.
Change-Id: I648ab9d9ba4bba7323c432c65f3ef056703f4303
This allows us to set parameters for server boot on various images.
This is the equivalent of the "--property" flag when using "openstack
server create". Various tools on the booted servers can then query
the config-drive metadata to get this value.
Needed-By: https://review.openstack.org/604193/
Change-Id: I99c1980f089aa2971ba728b77adfc6f4200e0b77
openSUSE Leap 15 is the latest version of openSUSE, bring an image
online to validate we can properly build it.
Depends-On: https://review.openstack.org/#/c/572424/
Change-Id: Ib0f48d9788aafd763e857c2d33784c4f75af4c17
Now that debian-stretch is working as expected, we can remove
debian-jessie.
Change-Id: If897757023772bb4549e40e7fcd048998175fb5b
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
We are seeing consistent failures where the Trusty root partition is
64MiB shorter than we expect. Unfortunately we don't currently have a
concrete explanation for this but rounding due to alignment is
suspected.
Reduce the expected size to something bigger than the images, but not
so close to 5GiB. Also add a more useful failure message; currently
you have to dig back through the logs to see where it went wrong.
Change-Id: Iba1fafdb1fe0f3c1b751772af939f079c429fcf3
If a build has a systematic failure, we currently just let nodepool
run, looping builds until we hit the overall job timeout (1.5 hours).
This adds a count of output log files; if we see three failed builds,
then assume the problem won't get better and fail early.
Change-Id: Id7e163b4937dd57cc8afbf72ed795f73b46a05b1
It seems that 2MiB of fudge isn't quite enough; Trusty has been seen
to round it's root partition size down and we miss it. Increase the
fudge factor.
Change-Id: I26e3bc7b5f68ea6642b8b57119fbd286688d593e
Test that we see the root partition grow.
Increase the root disk size to 5gb, and check that the booted vm has
grown the disk to at least that. Add disk size tracking so we can
more clearly see what's being built into the images.
Change-Id: I377beffc4896e03f0c2d01c0061c5f8652e8b1d1
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Increase our test coverage for debian-stretch, as this is the latesst
stable version of debian.
Change-Id: I05cbfe9735eb0b3900203fbd423f68483b1cbf5d
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Since ubuntu-bionic is the next LTS version of Ubuntu, start work to
ensure we can build DIBs for it.
We'll also need to bring online AFS mirrors.
Change-Id: I2e523eee4e99e5aea3d57d7ad224dbec39e2e4a5
Depends-On: https://review.openstack.org/485748
Depends-On: https://review.openstack.org/545611
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
We'd like to bring opensuse-tumbleweed online for openstack-infra, so
enable testing of tumbleweed to help catch things.
Change-Id: Id0a1fbf6f3c7df63402670f8c54f7fb3af652ae5
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Validate that glean will properly use the key-name from nodepool, and
allow a root user to ssh into the node.
It seems when we merge feature/zuulv3 back into master, we lost this
logic. It is still helpful to actually SSH into a node to validate
glean and diskimage-builder worked as expected.
See: https://review.openstack.org/455770/
Change-Id: I03f7f04be6c7889f94abed2d9e0a56d7e05ad90f
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Fedora-27 is the latest supported version, switch to it. We also have
fedora-27 DIBs live in openstack-infra.
Change-Id: Iff9e01a8aab4ba50c42e5e72fabbe8cb20bc821c
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Both fedora-25 and ubuntu-precise are nolonger tested. Remove dead
logic.
Change-Id: Ib54827bfea01cec39bd161a5a94fee350556102f
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
These matches were only required for the legacy boot jobs, which are
now removed.
Change-Id: I2ab0d1172fb596d4f85481175cf754c17d406d12
Depends-On: https://review.openstack.org/543329
This implements legacy-dsvm-nodepool-[distro]-src jobs as native jobs.
This seems like the best home for them, as they are run by multiple
externals such as glean and diskimage-builder.
Previously the defaults were set such that with no arguments, the
trusty test ran for nodepool-functional-py35.
To facilitate better templating, this turns all builds off by default.
The nodepool functional test is moved to a base template, and then
nodepool-functional-py35 explicitly builds and boots Xenial now
(trusty doesn't seem very useful).
The check_devstack_plugin.sh script runs after devstack, so needs to
source the stackrc file to pull in the variables about what images are
paused or not.
Additionally, the path for the script is fixed to nodepool so we can
run the job from other projects.
The redhat, ubuntu and suse legacy tests are re-implemented for their
respective builds.
This also highlighted that the opensuse test wasn't actually doing
anything. This actually adds the configuration to build opensuse-423.
Needed-By: https://review.openstack.org/543270
Needed-By: https://review.openstack.org/543328
Needed-By: https://review.openstack.org/543329
Needed-By: https://review.openstack.org/543330
Change-Id: I203d149a1d63ac8358e1c8b878d9c2bc0ba67c02
The legacy-dsvm-nodepool-*-src jobs use this script, but don't pass
the argument added by I203d149a1d63ac8358e1c8b878d9c2bc0ba67c02.
Default it while we migrate everything.
Change-Id: I30943a3242d80ab87f6a89ec7f2bcfd3d62ad64b
Changes nodepool-functional-py35 and nodepool-functional-py35-src
to use the native devstack job and not the legacy job.
Change-Id: I3d97d83360816001da0f599d95b13eae3abb6c96
Fedora 26 is now the latest version, so lets start supporting it for
nodepool devstack testing.
https://fedoraproject.org/wiki/Releases/26/Schedule
Change-Id: I9cde430a8cda53357851ab527446f6b32919907e
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
No need to build ubuntu-precise any more, it is EOL.
Change-Id: I16ef944d01c699971a136600da8e7e3c710919a3
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
The nodepool_id feature may need to be removed. I've kept it to simplify
merging both now and if we do it again later.
A couple of the tests are disabled and need reworking in a subsquent
commit.
Change-Id: I948f9f69ad911778fabb1c498aebd23acce8c89c
Add more test coverage for debian, due to recent issues with
system-config debian-jessie jobs failing. It also give projects like
glean and diskimage-builder more coverage.
Change-Id: If5e7fa98ee379f7339148de3ea6574bbcda2b032
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Now that we have fedora 25 running in openstack-infra, update nodepool
dsvm job to start using it.
Change-Id: I3cc467a2d08486458b3f625f94ba969532f6cd04
Depends-On: Ie3529321a51b5b38ba3797a167d3deb855fb50b6
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Disables all tests that depend on a working nodepoold and removes
obsolete tests since the database and gearman are going away.
Change-Id: Ic973c8a657fbfa38523e73231bdb5fce53a81f3a
In an effort to reduce RAM usage, drop out ubuntu images to use 512 MB
of RAM.
Create a new flavor to support 512 and use nodepool name-filter to
avoid using the tiny flavor.
Fix a typo with ubuntu-xenial devstack check script.
Change-Id: I024cf9c4d6430f11267f6063e7f22f3bdf6fa9d0
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
In an effort to reduce RAM usage, drop out ubuntu images to use 512 MB
of RAM.
Create a new flavor to support 512 and use nodepool name-filter to
avoid using the tiny flavor.
Fix a typo with ubuntu-xenial devstack check script.
Change-Id: I4b831cc3f45601ae586960190d3dfed550cfe842
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Add the ability for different jobs to control which images we build in
our dsvm job. This is needed so we can allow diskimage-builder more
control of which images to build.
Remove hardcoded apt-get for installing openssh-server, we can now use
the openssh-server element from diskimage-builder (which supports more
operating systems).
Change-Id: Ib6f48648e9ada8fd626a1811cdce262df0768c08
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Lets be explicity on which DIB we are testing.
Change-Id: I56fffff74901d075e5a93526d499b90af889ab11
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
Update our devstack settings to include changes needed for zookeeper.
Currently, zookeeper is only packaged for debian, so we don't have
RPMs right now.
Additionally, remove diskimage parameter from config as it is no
longer needed. And reduce kazoo logging to INFO and have
nodepool-builder use the logging.conf file.
Remove snapshot support too, trusty-server is no longer valid.
Change-Id: I274974092e05c35a98d1430252d6916da6d54a87
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
There is a script we use to check the results of the nodepool devstack
tests. It needs to use the nodepool virtualenv.
Change-Id: I40f5165d36060643943bcb91df14e5e34cd5e3fa
We wrote shade as an extraction of the logic we had in nodepool, and
have since expanded it to support more clouds. It's time to start
using it in nodepool, since that will allow us to add more clouds
and also to handle a wider variety of them.
Making a patch series was too tricky because of the way fakes and
threading work, so this is everything in one stab.
Depends-On: I557694b3931d81a3524c781ab5dabfb5995557f5
Change-Id: I423716d619aafb2eca5c1748bc65b38603a97b6a
Co-Authored-By: James E. Blair <jeblair@linux.vnet.ibm.com>
Co-Authored-By: David Shrewsbury <shrewsbury.dave@gmail.com>
Co-Authored-By: Yolanda Robla <yolanda.robla-mota@hpe.com>
devstack now writes this file globally, so there is no need for us to
set an override location in here.
Change-Id: I33ea7f522e9b099539bf3a24587d140276412cd0
Instead of specifying all the dirty auth details in nodepool.yaml rely
on the clouds.yaml devstack cloud specification that devstack writes out
for us.
Change-Id: I95d7f8bcca3ccbd6a320fb595d1de4632615f60f
Depends on a new secure.conf file to grab mysql
connection and jenkins credentials. By this way,
nodepool.yaml is just a flat file without credentials,
that can be passed externally.
Co-Authored-By: Ramy Asselin <ramy.asselin@hpe.com>
Depends-On: Ie9381740e3644feaee1f1b201499e3a253677f39
Change-Id: Ifa4d500c52974b9fd3a0b7fd9c28cf8f52899ca9
When checking the results of the test in the devstack plugin,
wait for resources rather than assuming they will be present within
15 minutes.
Also, record the results of the resource lists so that they may be
examined after the end of the test run.
Change-Id: Ic562710059290b5c2191a005666257fdc65ab6e2
Instead of using the hard-coded version of nodepool.yaml
to start nodepoold, use the version configured in devstack/settings:
NODEPOOL_CONFIG=/etc/nodepool/nodepool.yaml
Change-Id: I28205dde1bdca7f0d68e7c9ec19ed191303c653d
James E. Blair