VScaler: Add/Remove nodes from the environment with Kolla

Prereqs

Nodes to add should be pre-configured with docker etc.
- Dave has a playbook for this, but kolla has a command for this as well, which is kolla-ansible bootstrap-servers. This command will configure all the existing nodes as well, so needs more investigation to limit it to specific nodes.

Destroy a configured node

Note: Change gpu07 in the following command to any node that you want to destroy. This node has to be in the inventory file.

For the latest kolla-ansible version you can use:

kolla-ansible -i ./multinode --limit=gpu07 destroy

# or for multiple nodes
kolla-ansible -I ./multinode --limit="gpu07,gpu08" destroy

For older kolla-ansible versions the --limit option is not available, so you need to use the fill ansible-playbook command:

ansible-playbook -i vScaler/deploy/multinode --limit=gpu07 -e @/etc/kolla/globals.yml \
-e @/etc/kolla/passwords.yml -e CONFIG_DIR=/etc/kolla -e action=destroy /usr/share/kolla/ansible/destroy.yml

Add a node

Add the hostname of the node in the inventory file, under any category that you need it to be
Change gpu01 in the following command to the node you want to add and run it