PVIP networking mode can be used in VMware clusters by adding a small virtual router to each ESXi host. If the appropriate configuration has been performed in vSphere, the option to add this virtual router (vNode) is displayed when adding a compute node (ESXi host) using the Flexiant Cloud Orchestrator system control panel.
Adding PVIP support to a VMware cluster
To enable PVIP networking in your VMware cluster, follow the steps outlined below.
- Add a new host switch to vSphere:
- From the Node menu, select Configuration > Networking > Add Networking.
- Specify the following settings for the host switch:
Type: Virtual Machine
Network Access: Deselect all
Connection settings:
Network Label: Required name
VLAN ID: All
In order to enable live migration between compute nodes, ensure that the
config.migrate.test.CompatibleNetworks.VMOnVirtualIntranet
setting is present and set tofalse
in the Advanced Settings section of the vCenter Server Settings.
The default values for the switches used for communication between the vNode and the cluster control server (MANAGEMENT), between the vNode, storage, and VLANs (EXTERNAL), and to handle PVIP routing (HOST, added in step 1) are as follows:
VNODE_MANAGEMENT_SWITCH="vSwitch0" VNODE_EXTERNAL_SWITCH="vSwitch1" VNODE_HOST_SWITCH="vSwitch2"
If your configuration differs from the default, edit the above fields in
/etc/extility/local.cfg
so that they contain the correct switches. For more information about making alterations to configuration files, see Configuration Customisations.
Oncelocal.cfg
contains the required values, run the following command:build-config -a
This command will disrupt the operation of the platform; it is therefore recommended that you do this at a time when the platform is not in use by customers.
- In the Flexiant Cloud Orchestrator control panel, add the new vNode to the appropriate compute node (ESXi host):
- Show the System page by clicking the System link in the top right hand corner of the screen.
- Click on the Nodes tab.
- Do one of the following:
- To add the vNode to an existing node:
- On the Nodes widget, click the Manage button next to the appropriate node.
- Click the Edit button.
- To add the vNode to a new node, click the Create Node button on the Nodes widget.
- To add the vNode to an existing node:
Enter the IP address for the vNode in the Vnode Management IP field.
Ensure you enter the IP address for the vNode correctly; if a mistake is made you will need to migrate all VMs off the node and put it into Maintenance mode in order to modify the vNode IP.
- You can now add a PVIP IP pool to your VMware cluster. For instructions on how to do this, see Managing Clusters.
- If any billing entities do not want to use PVIP networking on VMware clusters, you can disable the option to use PVIP networking on a per billing entity basis. To do this:
- Manage the billing entity.
- Click on the Capabilities sub-tab.
- Uncheck the IP box in the networking area.
- Click the button.
Reload the configuration of the billing entity so that the changes take effect.
This will disrupt access to the platform for the billing entity's customers, and so should be performed at a time when the platform is not in use.
To add support for PVIP networks on VMware clusters with existing VDCs, run the following command:
echo "create-default-pvip-network <cluster-uuid>" > /var/run/extility/jade/service-interface
<cluster-uuid>
should be replaced with the UUID of the cluster you are adding PVIP support to.
Modifying or removing the vNode IP address
You can only modify or remove the IP address of a vNode if the node it is running on is in Maintenance mode and contains no VMs. To do this:
- Show the System page by clicking the System link in the top right hand corner of the screen.
- Click on the Nodes tab.
- On the Nodes widget, click the Manage button next to the appropriate node.
- Put the node into Maintenance mode by clicking the Put into Maintenance button.
- Migrate the node's running VMs onto other nodes. To do this, click the Migrate all VMs button.
- Click the Edit button.
- Do one of the following:
- To modify the vNode's IP address, enter the new IP address for the vNode in the Vnode Management IP field.
To remove the vNode's IP address, delete the contents of the Vnode Management IP field.
The vNode is automatically removed when a node is deleted.
- Put the node back into Running state so that it can be used to host VMs. To do this, click the Put into Running button.