Manage a pool of nodes for a distributed test infrastructure

Go to file

James E. Blair 1e311031ec Zuul: add file extension to playbook path Zuul now supports including the file extension on the playbook path and omitting the extension is now deprecrated. Update references to include the extension. Change-Id: I8531a73bd80c10db0ec592f352b1a7ccc8095bda		2017-10-29 05:19:39 -07:00
devstack	Remove opensuse-42.2 and fedora-25 from nodepool dsvm jobs	2017-09-07 12:18:15 -04:00
doc	Clarify diskimage names in docs	2017-08-04 17:40:46 +10:00
nodepool	Add SSH Host Key Verifier Strategy	2017-07-13 10:50:14 -07:00
playbooks	Migrate legacy jobs	2017-10-20 11:27:10 -04:00
tools	Remove opensuse-42.2 and fedora-25 from nodepool dsvm jobs	2017-09-07 12:18:15 -04:00
.gitignore	Ignore vim editor backup and swap files.	2014-01-20 13:23:04 +13:00
.gitreview	Added .gitreview	2013-08-13 17:10:06 +00:00
.testr.conf	Add a test for subnodes	2014-03-31 09:22:00 -07:00
.zuul.yaml	Zuul: add file extension to playbook path	2017-10-29 05:19:39 -07:00
LICENSE	Add LICENSE file	2015-12-10 12:54:23 -05:00
README.rst	Update README to mention bindep	2017-01-08 08:34:20 -06:00
bindep.txt	Initial support for bindep	2016-11-25 09:51:26 +00:00
requirements.txt	Merge "Remove duplicate python-jenkins code from nodepool"	2017-07-05 14:23:02 +00:00
setup.cfg	Builders can be run on their own	2016-01-12 15:33:01 -08:00
setup.py	Bump pbr requirements to >=1.3	2015-09-14 16:19:13 -04:00
test-requirements.txt	Merge "Remove discover from test-requirements"	2016-11-16 14:33:35 +00:00
tox.ini	Initial support for bindep	2016-11-25 09:51:26 +00:00

README.rst

Nodepool

Nodepool is a service used by the OpenStack CI team to deploy and manage a pool of devstack images on a cloud server for use in OpenStack project testing.

Developer setup

Make sure you have pip installed:

wget https://bootstrap.pypa.io/get-pip.py
sudo python get-pip.py

Install dependencies:

sudo pip install bindep
sudo apt-get install $(bindep -b nodepool)

mkdir src
cd ~/src
git clone git://git.openstack.org/openstack-infra/system-config
git clone git://git.openstack.org/openstack-infra/nodepool
cd nodepool
sudo pip install -U -r requirements.txt
sudo pip install -e .

If you're testing a specific patch that is already in gerrit, you will also want to install git-review and apply that patch while in the nodepool directory, ie:

git review -x XXXXX

Create or adapt a nodepool yaml file. You can adapt an infra/system-config one, or fake.yaml as desired. Note that fake.yaml's settings won't Just Work - consult ./modules/openstack_project/templates/nodepool/nodepool.yaml.erb in the infra/system-config tree to see a production config.

If the cloud being used has no default_floating_pool defined in nova.conf, you will need to define a pool name using the nodepool yaml file to use floating ips.

Set up database for interactive testing:

mysql -u root

mysql> create database nodepool;
mysql> GRANT ALL ON nodepool.* TO 'nodepool'@'localhost';
mysql> flush privileges;

Set up database for unit tests:

mysql -u root
mysql> grant all privileges on *.* to 'openstack_citest'@'localhost' identified by 'openstack_citest' with grant option;
mysql> flush privileges;
mysql> create database openstack_citest;

Note that the script tools/test-setup.sh can be used for the step above.

Export variable for your ssh key so you can log into the created instances:

export NODEPOOL_SSH_KEY=`cat ~/.ssh/id_rsa.pub | awk '{print $2}'`

Start nodepool with a demo config file (copy or edit fake.yaml to contain your data):

export STATSD_HOST=127.0.0.1
export STATSD_PORT=8125
nodepoold -d -c tools/fake.yaml

All logging ends up in stdout.

Use the following tool to check on progress:

nodepool image-list

After each run (the fake nova provider is only in-memory):

mysql> delete from snapshot_image; delete from node;