From 3ff08aff8fe774accc4d4c2bc3ce8d1615380d51 Mon Sep 17 00:00:00 2001 From: Xiaohua Zhang Date: Mon, 23 Nov 2020 09:19:57 -0500 Subject: [PATCH] Update the doc/installation-guide.rst for Cherry release Issue-ID: INF-209 Signed-off-by: Xiaohua Zhang Change-Id: If509eda89ebf96349666e12ec4a6371e8aa6c370 --- docs/installation-guide.rst | 1479 +++++++++++++++++++++++++------------------ 1 file changed, 867 insertions(+), 612 deletions(-) diff --git a/docs/installation-guide.rst b/docs/installation-guide.rst index ae524a9..7d889fc 100644 --- a/docs/installation-guide.rst +++ b/docs/installation-guide.rst @@ -31,7 +31,7 @@ Version history | 2020-06-03 | 2.0.0 (Bronze) | Xiaohua Zhang | Bronze version | | | | | | +--------------------+--------------------+--------------------+--------------------+ -| | | | | +| 2020-11-23 | 3.0.0 (Cherry) | Xiaohua Zhang | Cherry version | | | | | | +--------------------+--------------------+--------------------+--------------------+ @@ -66,681 +66,936 @@ Following minimum hardware requirements must be met for installation of O-RAN IN | | | +--------------------+----------------------------------------------------+ +If want to enable the HA mode which is available in Cherry release, 2 servers are needed. -Software Installation and Deployment ------------------------------------- +ORAN INF Cherry test on Dell R740 +================================= -1. Installation from the O-RAN INF ISO image -```````````````````````````````````````````` +1. Installation for the first server from the O-RAN INF ISO image +----------------------------------------------------------------- -- Please see the README.md file for how to build the image. -- The Image is a live ISO image with CLI installer: inf-image-aio-installer-intel-corei7-64.iso +- Please see the README.md file for how to build the image. +- The Image is a live ISO image with CLI installer: + inf-image-aio-installer-intel-corei7-64.iso 1.1 Burn the image to the USB device -'''''''''''''''''''''''''''''''''''' +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ -- Assume the the usb device is /dev/sdX here +- Assume the the usb device is /dev/sdX here :: - $ sudo dd if=/path/to/inf-image-aio-installer-intel-corei7-64.iso of=/dev/sdX bs=1M + $ sudo dd if=/path/to/inf-image-aio-installer-intel-corei7-64.iso of=/dev/sdX bs=1M -1.2 Install the server -'''''''''''''''''''''' +1.2 Install the first Dell-R740 server (controller-0) +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ -- Reboot the target from the USB device. +- Reboot the target from the USB device. -- Select "Graphics console install" or "Serial console install" and press ENTER +- Select “All-in-one Graphics console” or “All-in-one Serial console + install” and press ENTER -- Remove the USB device and press ENTER to reboot +- Start the auto installation +- It will reboot aotumatically after installation 2. Configuration and initialize the bootstrap -````````````````````````````````````````````` +--------------------------------------------- + +2.1 First Login with sysadmin/sysadmin and change password +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ -2.1 First Login -''''''''''''''' -Example: +2.2 Set OAM network before bootstrap +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ :: - ifconfig eno1 128.224.180.14/24 up + export OAM_DEV=eno3 + export CONTROLLER0_OAM_CIDR=128.224.210.110/24 + export DEFAULT_OAM_GATEWAY=128.224.210.1 + sudo ip address add $CONTROLLER0_OAM_CIDR dev $OAM_DEV + sudo ip link set up dev $OAM_DEV + sudo ip route add default via $DEFAULT_OAM_GATEWAY dev $OAM_DEV - ip route add default via 128.224.180.1 +2.3 Login the server through SSH with sysadmin +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - ping 8.8.8.8 +2.4 Prepare the localhost.yml for bootstrap +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ -2.3 Login the server through SSH -'''''''''''''''''''''''''''''''' +:: -2.4 Prepare the localhost.yml for bootstrap -''''''''''''''''''''''''''''''''''''''''''' + cat << EOF > localhost.yml + system_mode: duplex + management_subnet: 192.168.18.0/24 + management_start_address: 192.168.18.2 + management_end_address: 192.168.18.50 + management_gateway_address: 192.168.18.1 + external_oam_subnet: 128.224.210.0/24 + external_oam_gateway_address: 128.224.210.1 + external_oam_floating_address: 128.224.210.110 + external_oam_node_0_address: 128.224.210.111 + external_oam_node_1_address: 128.224.210.112 + EOF + +2.5 Run the ansible bootstrap +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +:: -Example: + ansible-playbook /usr/share/ansible/stx-ansible/playbooks/bootstrap.yml -vvv + +After the bootstrap successfully finish, it will show as following: :: - system_mode: simplex + PLAY RECAP ************************************************************************************************************* + localhost : ok=257 changed=151 unreachable=0 failed=0 skipped=214 rescued=0 ignored=0 - external_oam_subnet: 128.224.180.0/24 +2.6 Congiure controller-0 +~~~~~~~~~~~~~~~~~~~~~~~~~ - external_oam_gateway_address: 128.224.180.1 +Acquire admin credentials: - external_oam_floating_address: 128.224.180.14 +:: - admin_username: admin + controller-0:~$ source /etc/platform/openrc + [sysadmin@controller-0 ~(keystone_admin)]$ + +Configure the OAM and MGMT interfaces of controller-0 and specify the +attached networks: + +:: - admin_password: Wind123! + OAM_IF=eno3 + MGMT_IF=eno1 + system host-if-modify controller-0 lo -c none + IFNET_UUIDS=$(system interface-network-list controller-0 | awk '{if ($6=="lo") print $4;}') + for UUID in $IFNET_UUIDS; do + system interface-network-remove ${UUID} + done - ansible_become_pass: Wind123! + system host-if-modify controller-0 $OAM_IF -n oam0 + system host-if-modify controller-0 $MGMT_IF -n pxeboot0 - docker_http_proxy: http://xxx.xxx.xxx.xxx:8080 + system host-if-modify controller-0 oam0 -c platform + system interface-network-assign controller-0 oam0 oam - docker_https_proxy: https://xxx.xxx.xxx.xxx:8080 + system host-if-modify controller-0 pxeboot0 -c platform + system interface-network-assign controller-0 pxeboot0 pxeboot -2.5 Run the bootstrap -''''''''''''''''''''' + system host-if-add -V 18 controller-0 mgmt0 vlan pxeboot0 + system interface-network-assign controller-0 mgmt0 mgmt -Use the following command: + system host-if-add -V 19 controller-0 cluster0 vlan pxeboot0 + system interface-network-assign controller-0 cluster0 cluster-host + +Example output: :: - ansible-playbook /usr/share/ansible/stx-ansible/playbooks/bootstrap.yml -vvv + [sysadmin@controller-0 ~(keystone_admin)]$ OAM_IF=eno3 + [sysadmin@controller-0 ~(keystone_admin)]$ MGMT_IF=eno1 + [sysadmin@controller-0 ~(keystone_admin)]$ system host-if-modify controller-0 lo -c none + +-----------------+--------------------------------------+ + | Property | Value | + +-----------------+--------------------------------------+ + | ifname | lo | + | iftype | virtual | + | ports | [] | + | imac | 00:00:00:00:00:00 | + | imtu | 1500 | + | ifclass | None | + | aemode | None | + | schedpolicy | None | + | txhashpolicy | None | + | uuid | 08c95952-892b-40b5-b17a-7d2ad46e725c | + | ihost_uuid | 16afe3a2-ba50-46b8-9fd7-09010059e8b9 | + | vlan_id | None | + | uses | [] | + | used_by | [] | + | created_at | 2020-11-17T00:30:45.265032+00:00 | + | updated_at | 2020-11-17T01:03:39.031612+00:00 | + | sriov_numvfs | 0 | + | sriov_vf_driver | None | + +-----------------+--------------------------------------+ + [sysadmin@controller-0 ~(keystone_admin)]$ IFNET_UUIDS=$(system interface-network-list controller-0 | awk '{if ($6=="lo") print $4;}') + [sysadmin@controller-0 ~(keystone_admin)]$ for UUID in $IFNET_UUIDS; do + > system interface-network-remove ${UUID} + > done + Deleted Interface Network: 0bf11f1b-4fc6-4e97-b896-3d6393a3744e + Deleted Interface Network: a62d95f6-ad4e-4779-bfc0-6a885067f8d8 + + [sysadmin@controller-0 ~(keystone_admin)]$ system host-if-modify controller-0 $OAM_IF -n oam0 + +-----------------+--------------------------------------+ + | Property | Value | + +-----------------+--------------------------------------+ + | ifname | oam0 | + | iftype | ethernet | + | ports | [u'eno3'] | + | imac | 24:6e:96:5d:0c:b2 | + | imtu | 1500 | + | ifclass | None | + | aemode | None | + | schedpolicy | None | + | txhashpolicy | None | + | uuid | d8a048fa-67ef-43ac-8166-671be93caa30 | + | ihost_uuid | 16afe3a2-ba50-46b8-9fd7-09010059e8b9 | + | vlan_id | None | + | uses | [] | + | used_by | [] | + | created_at | 2020-11-17T00:28:32.365863+00:00 | + | updated_at | 2020-11-17T01:03:45.090904+00:00 | + | sriov_numvfs | 0 | + | sriov_vf_driver | None | + | accelerated | [True] | + +-----------------+--------------------------------------+ + [sysadmin@controller-0 ~(keystone_admin)]$ system host-if-modify controller-0 $MGMT_IF -n pxeboot0 + +-----------------+--------------------------------------+ + | Property | Value | + +-----------------+--------------------------------------+ + | ifname | pxeboot0 | + | iftype | ethernet | + | ports | [u'eno1'] | + | imac | 24:6e:96:5d:0c:92 | + | imtu | 1500 | + | ifclass | None | + | aemode | None | + | schedpolicy | None | + | txhashpolicy | None | + | uuid | 23b5e923-1e53-4e70-a975-542d8380b7f2 | + | ihost_uuid | 16afe3a2-ba50-46b8-9fd7-09010059e8b9 | + | vlan_id | None | + | uses | [] | + | used_by | [] | + | created_at | 2020-11-17T00:28:32.612230+00:00 | + | updated_at | 2020-11-17T01:03:47.341003+00:00 | + | sriov_numvfs | 0 | + | sriov_vf_driver | None | + | accelerated | [True] | + +-----------------+--------------------------------------+ + [sysadmin@controller-0 ~(keystone_admin)]$ + [sysadmin@controller-0 ~(keystone_admin)]$ system host-if-modify controller-0 oam0 -c platform + +-----------------+--------------------------------------+ + | Property | Value | + +-----------------+--------------------------------------+ + | ifname | oam0 | + | iftype | ethernet | + | ports | [u'eno3'] | + | imac | 24:6e:96:5d:0c:b2 | + | imtu | 1500 | + | ifclass | platform | + | aemode | None | + | schedpolicy | None | + | txhashpolicy | None | + | uuid | d8a048fa-67ef-43ac-8166-671be93caa30 | + | ihost_uuid | 16afe3a2-ba50-46b8-9fd7-09010059e8b9 | + | vlan_id | None | + | uses | [] | + | used_by | [] | + | created_at | 2020-11-17T00:28:32.365863+00:00 | + | updated_at | 2020-11-17T01:03:49.368879+00:00 | + | sriov_numvfs | 0 | + | sriov_vf_driver | None | + | accelerated | [True] | + +-----------------+--------------------------------------+ + [sysadmin@controller-0 ~(keystone_admin)]$ system interface-network-assign controller-0 oam0 oam + +--------------+--------------------------------------+ + | Property | Value | + +--------------+--------------------------------------+ + | hostname | controller-0 | + | uuid | 3c8bd181-d3f3-4e14-8e89-75a3432db1e4 | + | ifname | oam0 | + | network_name | oam | + +--------------+--------------------------------------+ + [sysadmin@controller-0 ~(keystone_admin)]$ + [sysadmin@controller-0 ~(keystone_admin)]$ system host-if-modify controller-0 pxeboot0 -c platform + +-----------------+--------------------------------------+ + | Property | Value | + +-----------------+--------------------------------------+ + | ifname | pxeboot0 | + | iftype | ethernet | + | ports | [u'eno1'] | + | imac | 24:6e:96:5d:0c:92 | + | imtu | 1500 | + | ifclass | platform | + | aemode | None | + | schedpolicy | None | + | txhashpolicy | None | + | uuid | 23b5e923-1e53-4e70-a975-542d8380b7f2 | + | ihost_uuid | 16afe3a2-ba50-46b8-9fd7-09010059e8b9 | + | vlan_id | None | + | uses | [] | + | used_by | [] | + | created_at | 2020-11-17T00:28:32.612230+00:00 | + | updated_at | 2020-11-17T01:03:53.143795+00:00 | + | sriov_numvfs | 0 | + | sriov_vf_driver | None | + | accelerated | [True] | + +-----------------+--------------------------------------+ + [sysadmin@controller-0 ~(keystone_admin)]$ system interface-network-assign controller-0 pxeboot0 pxeboot + +--------------+--------------------------------------+ + | Property | Value | + +--------------+--------------------------------------+ + | hostname | controller-0 | + | uuid | 6c55622d-2da4-4f4e-ab5e-f8e06e03af7c | + | ifname | pxeboot0 | + | network_name | pxeboot | + +--------------+--------------------------------------+ + [sysadmin@controller-0 ~(keystone_admin)]$ + [sysadmin@controller-0 ~(keystone_admin)]$ system host-if-add -V 18 controller-0 mgmt0 vlan pxeboot0 + +-----------------+--------------------------------------+ + | Property | Value | + +-----------------+--------------------------------------+ + | ifname | mgmt0 | + | iftype | vlan | + | ports | [] | + | imac | 24:6e:96:5d:0c:92 | + | imtu | 1500 | + | ifclass | None | + | aemode | None | + | schedpolicy | None | + | txhashpolicy | None | + | uuid | 119bdb85-1e24-44ff-b527-fe8f167b0ad3 | + | ihost_uuid | 16afe3a2-ba50-46b8-9fd7-09010059e8b9 | + | vlan_id | 18 | + | uses | [u'pxeboot0'] | + | used_by | [] | + | created_at | 2020-11-17T01:03:57.303000+00:00 | + | updated_at | None | + | sriov_numvfs | 0 | + | sriov_vf_driver | None | + | accelerated | [True] | + +-----------------+--------------------------------------+ + [sysadmin@controller-0 ~(keystone_admin)]$ system interface-network-assign controller-0 mgmt0 mgmt + +--------------+--------------------------------------+ + | Property | Value | + +--------------+--------------------------------------+ + | hostname | controller-0 | + | uuid | 2e93ef03-e9ee-457a-8667-05b52b7109a5 | + | ifname | mgmt0 | + | network_name | mgmt | + +--------------+--------------------------------------+ + [sysadmin@controller-0 ~(keystone_admin)]$ + [sysadmin@controller-0 ~(keystone_admin)]$ system host-if-add -V 19 controller-0 cluster0 vlan pxeboot0 + +-----------------+--------------------------------------+ + | Property | Value | + +-----------------+--------------------------------------+ + | ifname | cluster0 | + | iftype | vlan | + | ports | [] | + | imac | 24:6e:96:5d:0c:92 | + | imtu | 1500 | + | ifclass | None | + | aemode | None | + | schedpolicy | None | + | txhashpolicy | None | + | uuid | 6a620c8e-4f7b-4f74-a9f4-2a91d3ae9756 | + | ihost_uuid | 16afe3a2-ba50-46b8-9fd7-09010059e8b9 | + | vlan_id | 19 | + | uses | [u'pxeboot0'] | + | used_by | [] | + | created_at | 2020-11-17T01:04:02.613518+00:00 | + | updated_at | None | + | sriov_numvfs | 0 | + | sriov_vf_driver | None | + | accelerated | [True] | + +-----------------+--------------------------------------+ + [sysadmin@controller-0 ~(keystone_admin)]$ system interface-network-assign controller-0 cluster0 cluster-host + +--------------+--------------------------------------+ + | Property | Value | + +--------------+--------------------------------------+ + | hostname | controller-0 | + | uuid | fb8b6be6-1618-4662-b063-b1e8d340aa48 | + | ifname | cluster0 | + | network_name | cluster-host | + +--------------+--------------------------------------+ + [sysadmin@controller-0 ~(keystone_admin)]$ system host-if-list controller-0 + +--------------------------------------+----------+----------+----------+---------+-----------+---------------+-------------------------+------------+ + | uuid | name | class | type | vlan id | ports | uses i/f | used by i/f | attributes | + +--------------------------------------+----------+----------+----------+---------+-----------+---------------+-------------------------+------------+ + | 119bdb85-1e24-44ff-b527-fe8f167b0ad3 | mgmt0 | platform | vlan | 18 | [] | [u'pxeboot0'] | [] | MTU=1500 | + | 23b5e923-1e53-4e70-a975-542d8380b7f2 | pxeboot0 | platform | ethernet | None | [u'eno1'] | [] | [u'mgmt0', u'cluster0'] | MTU=1500 | + | 6a620c8e-4f7b-4f74-a9f4-2a91d3ae9756 | cluster0 | platform | vlan | 19 | [] | [u'pxeboot0'] | [] | MTU=1500 | + | d8a048fa-67ef-43ac-8166-671be93caa30 | oam0 | platform | ethernet | None | [u'eno3'] | [] | [] | MTU=1500 | + +--------------------------------------+----------+----------+----------+---------+-----------+---------------+-------------------------+------------+ + +Configure NTP Servers for network time synchronization: -After the bootstrap successfully finish, it will show as following: +:: + + system ntp-modify ntpservers=0.pool.ntp.org,1.pool.ntp.org + +Output :: - PLAY RECAP ****************************************************************************************************************************************** - localhost : ok=256 changed=135 unreachable=0 failed=0 skipped=220 rescued=0 ignored=0 + [sysadmin@controller-0 ~(keystone_admin)]$ system ntp-modify ntpservers=0.pool.ntp.org,1.pool.ntp.org + +--------------+--------------------------------------+ + | Property | Value | + +--------------+--------------------------------------+ + | uuid | 3206cf01-c64a-457e-ac66-b8224c9684c3 | + | ntpservers | 0.pool.ntp.org,1.pool.ntp.org | + | isystem_uuid | cc79b616-d24e-4432-a953-85c9b242cb3a | + | created_at | 2020-11-17T00:27:23.529571+00:00 | + | updated_at | None | + +--------------+--------------------------------------+ -2.6 Configure the OAM network -''''''''''''''''''''''''''''' +Add an OSD on controller-0 for Ceph: -Example: +:: + + system host-disk-list controller-0 + system host-disk-list controller-0 | awk '/\/dev\/sdb/{print $2}' | xargs -i system host-stor-add controller-0 {} + system host-disk-list controller-0 | awk '/\/dev\/sdc/{print $2}' | xargs -i system host-stor-add controller-0 {} + system host-stor-list controller-0 + +Output :: - controller-0:~$ source /etc/platform/openrc - - [sysadmin@controller-0 ~(keystone_admin)]$ OAM_IF=eno1 - - [sysadmin@controller-0 ~(keystone_admin)]$ system host-if-modify controller-0 $OAM_IF -c platform - - +-----------------+--------------------------------------+ - | Property | Value | - +-----------------+--------------------------------------+ - | ifname | eno1 | - +-----------------+--------------------------------------+ - | iftype | ethernet | - +-----------------+--------------------------------------+ - | ports | [u'eno1'] | - +-----------------+--------------------------------------+ - | imac | 3c:a8:2a:1d:31:d0 | - +-----------------+--------------------------------------+ - | imtu | 1500 | - +-----------------+--------------------------------------+ - | ifclass | platform | - +-----------------+--------------------------------------+ - | aemode | None | - +-----------------+--------------------------------------+ - | schedpolicy | None | - +-----------------+--------------------------------------+ - | txhashpolicy | None | - +-----------------+--------------------------------------+ - | uuid | 95a32d13-01fc-43d2-90ab-801970fb3859 | - +-----------------+--------------------------------------+ - | ihost_uuid | 08c23843-afa4-4b80-a285-be126365276e | - +-----------------+--------------------------------------+ - | vlan_id | None | - +-----------------+--------------------------------------+ - | uses | [] | - +-----------------+--------------------------------------+ - | used_by | [] | - +-----------------+--------------------------------------+ - | created_at | 2020-06-03T08:21:17.526303+00:00 | - +-----------------+--------------------------------------+ - | updated_at | 2020-06-03T10:02:54.682501+00:00 | - +-----------------+--------------------------------------+ - | sriov_numvfs | 0 | - +-----------------+--------------------------------------+ - | sriov_vf_driver | None | - +-----------------+--------------------------------------+ - | accelerated | [False] | - +-----------------+--------------------------------------+ - - [sysadmin@controller-0 ~(keystone_admin)]$ system interface-network-assign controller-0 $OAM_IF oam - - +--------------+--------------------------------------+ - | Property | Value | - +--------------+--------------------------------------+ - | hostname | controller-0 | - +--------------+--------------------------------------+ - | uuid | 32592cc3-9d66-4961-a51e-23686da00290 | - +--------------+--------------------------------------+ - | ifname | eno1 | - +--------------+--------------------------------------+ - | network_name | oam | - +--------------+--------------------------------------+ - - - [sysadmin@controller-0 ~(keystone_admin)]$ - [sysadmin@controller-0 ~(keystone_admin)]$ system interface-network-list controller-0 - - +--------------+--------------------------------------+--------+--------------+ - | hostname | uuid | ifname | network_name | - +--------------+--------------------------------------+--------+--------------+ - | controller-0 | 2478f4c0-a7b4-4656-aa2a-97a0e8891955 | lo | mgmt | - +--------------+--------------------------------------+--------+--------------+ - | controller-0 | 32592cc3-9d66-4961-a51e-23686da00290 | eno1 | oam | - +--------------+--------------------------------------+--------+--------------+ - | controller-0 | 43721e4d-4f52-4b4b-bd02-0efa00ef2124 | lo | cluster-host | - +--------------+--------------------------------------+--------+--------------+ - -2.7 Configure the NTP server -'''''''''''''''''''''''''''' + [sysadmin@controller-0 ~(keystone_admin)]$ system host-disk-list controller-0 + +--------------------------------------+-----------+---------+---------+-------+------------+--------------+----------------------------------+-------------------------------------------------+ + | uuid | device_no | device_ | device_ | size_ | available_ | rpm | serial_id | device_path | + | | de | num | type | gib | gib | | | | + +--------------------------------------+-----------+---------+---------+-------+------------+--------------+----------------------------------+-------------------------------------------------+ + | 8e2a719a-fa5a-4c25-89af-70a23fb7b238 | /dev/sda | 2048 | HDD | 893. | 644.726 | Undetermined | 00c66a07604fa8de2500151b14604609 | /dev/disk/by-path/pci-0000:86:00.0-scsi-0:2:0:0 | + | | | | | 75 | | | | | + | | | | | | | | | | + | 61b6f262-a51f-4310-aeac-373b1c1bbbc2 | /dev/sdb | 2064 | HDD | 1117. | 1117.247 | Undetermined | 00c6b9139b76a8de2500151b14604609 | /dev/disk/by-path/pci-0000:86:00.0-scsi-0:2:1:0 | + | | | | | 25 | | | | | + | | | | | | | | | | + | 81a7f4f9-dd3a-49b5-80d9-e1953aa43c79 | /dev/sdc | 2080 | HDD | 1117. | 1117.247 | Undetermined | 0053be63c794a8de2500151b14604609 | /dev/disk/by-path/pci-0000:86:00.0-scsi-0:2:2:0 | + | | | | | 25 | | | | | + | | | | | | | | | | + | 4879b381-8e9f-48f3-84e2-f9c6a94bbfe0 | /dev/sdd | 2096 | HDD | 1117. | 0.0 | Undetermined | 0065482503bca8de2500151b14604609 | /dev/disk/by-path/pci-0000:86:00.0-scsi-0:2:3:0 | + | | | | | 25 | | | | | + | | | | | | | | | | + +--------------------------------------+-----------+---------+---------+-------+------------+--------------+----------------------------------+-------------------------------------------------+ + [sysadmin@controller-0 ~(keystone_admin)]$ system host-disk-list controller-0 | awk '/\/dev\/sdb/{print $2}' | xargs -i system host-stor-add controller-0 {} + +------------------+-------------------------------------------------------+ + | Property | Value | + +------------------+-------------------------------------------------------+ + | osdid | 0 | + | function | osd | + | state | configuring-on-unlock | + | journal_location | 0816c72f-a4f0-49ea-9a95-0f02c880717c | + | journal_size_gib | 1024 | + | journal_path | /dev/disk/by-path/pci-0000:86:00.0-scsi-0:2:1:0-part2 | + | journal_node | /dev/sdb2 | + | uuid | 0816c72f-a4f0-49ea-9a95-0f02c880717c | + | ihost_uuid | 16afe3a2-ba50-46b8-9fd7-09010059e8b9 | + | idisk_uuid | 61b6f262-a51f-4310-aeac-373b1c1bbbc2 | + | tier_uuid | 3af8c893-9dd4-40af-afc6-30bb79048448 | + | tier_name | storage | + | created_at | 2020-11-17T01:05:04.063823+00:00 | + | updated_at | None | + +------------------+-------------------------------------------------------+ + [sysadmin@controller-0 ~(keystone_admin)]$ system host-disk-list controller-0 | awk '/\/dev\/sdc/{print $2}' | xargs -i system host-stor-add controller-0 {} + +------------------+-------------------------------------------------------+ + | Property | Value | + +------------------+-------------------------------------------------------+ + | osdid | 1 | + | function | osd | + | state | configuring-on-unlock | + | journal_location | 7a0b3727-0e3f-4582-9415-56e44bb8f1e5 | + | journal_size_gib | 1024 | + | journal_path | /dev/disk/by-path/pci-0000:86:00.0-scsi-0:2:2:0-part2 | + | journal_node | /dev/sdc2 | + | uuid | 7a0b3727-0e3f-4582-9415-56e44bb8f1e5 | + | ihost_uuid | 16afe3a2-ba50-46b8-9fd7-09010059e8b9 | + | idisk_uuid | 81a7f4f9-dd3a-49b5-80d9-e1953aa43c79 | + | tier_uuid | 3af8c893-9dd4-40af-afc6-30bb79048448 | + | tier_name | storage | + | created_at | 2020-11-17T01:05:06.939798+00:00 | + | updated_at | None | + +------------------+-------------------------------------------------------+ + [sysadmin@controller-0 ~(keystone_admin)]$ system host-stor-list controller-0 + +--------------------------------------+----------+-------+-----------------------+--------------------------------------+-------------------------------------------------------+--------------+------------------+-----------+ + | uuid | function | osdid | state | idisk_uuid | journal_path | journal_node | journal_size_gib | tier_name | + +--------------------------------------+----------+-------+-----------------------+--------------------------------------+-------------------------------------------------------+--------------+------------------+-----------+ + | 0816c72f-a4f0-49ea-9a95-0f02c880717c | osd | 0 | configuring-on-unlock | 61b6f262-a51f-4310-aeac-373b1c1bbbc2 | /dev/disk/by-path/pci-0000:86:00.0-scsi-0:2:1:0-part2 | /dev/sdb2 | 1 | storage | + | 7a0b3727-0e3f-4582-9415-56e44bb8f1e5 | osd | 1 | configuring-on-unlock | 81a7f4f9-dd3a-49b5-80d9-e1953aa43c79 | /dev/disk/by-path/pci-0000:86:00.0-scsi-0:2:2:0-part2 | /dev/sdc2 | 1 | storage | + +--------------------------------------+----------+-------+-----------------------+--------------------------------------+-------------------------------------------------------+--------------+------------------+-----------+ + +2.7 Unlock controller-0 +~~~~~~~~~~~~~~~~~~~~~~~ + +:: -Example: + system host-unlock controller-0 + +Output: :: - - [sysadmin@controller-0 ~(keystone_admin)]$ - [sysadmin@controller-0 ~(keystone_admin)]$ system ntp-modify ntpservers=0.pool.ntp.org,1.pool.ntp.org - - +--------------+--------------------------------------+ - | Property | Value | - +--------------+--------------------------------------+ - | uuid | 8fbe5712-6ba0-4e61-b174-ed60f152f616 | - +--------------+--------------------------------------+ - | ntpservers | 0.pool.ntp.org,1.pool.ntp.org | - +--------------+--------------------------------------+ - | isystem_uuid | 802ee0be-3728-4df4-b9f7-1533c67fd960 | - +--------------+--------------------------------------+ - | created_at | 2020-06-03T08:19:47.812249+00:00 | - +--------------+--------------------------------------+ - | updated_at | None | - +--------------+--------------------------------------+ - -2.8 Configure the Storage by using the second hard drive as ceph backend -'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''' -Example: + [sysadmin@controller-0 ~(keystone_admin)]$ system host-unlock controller-0 + +-----------------------+-------------------------------------------------+ + | Property | Value | + +-----------------------+-------------------------------------------------+ + | action | none | + | administrative | locked | + | availability | online | + | bm_ip | None | + | bm_type | none | + | bm_username | None | + | boot_device | /dev/disk/by-path/pci-0000:86:00.0-scsi-0:2:0:0 | + | capabilities | {u'stor_function': u'monitor'} | + | clock_synchronization | ntp | + | config_applied | 6aa15fb4-8cb3-494e-b94e-95f85b560f22 | + | config_status | None | + | config_target | c6ae9b2d-a3c4-4751-a79e-5487ba81ed82 | + | console | ttyS0,115200 | + | created_at | 2020-11-17T00:28:01.983673+00:00 | + | hostname | controller-0 | + | id | 1 | + | install_output | graphical | + | install_state | None | + | install_state_info | None | + | inv_state | inventoried | + | invprovision | provisioning | + | location | {} | + | mgmt_ip | 192.168.18.3 | + | mgmt_mac | 24:6e:96:5d:0c:92 | + | operational | disabled | + | personality | controller | + | reserved | False | + | rootfs_device | /dev/disk/by-path/pci-0000:86:00.0-scsi-0:2:0:0 | + | serialid | None | + | software_load | 19.12 | + | subfunction_avail | online | + | subfunction_oper | disabled | + | subfunctions | controller,worker,lowlatency | + | task | Unlocking | + | tboot | false | + | ttys_dcd | None | + | updated_at | 2020-11-17T01:05:07.015414+00:00 | + | uptime | 3496 | + | uuid | 16afe3a2-ba50-46b8-9fd7-09010059e8b9 | + | vim_progress_status | None | + +-----------------------+-------------------------------------------------+ + +Controller-0 will reboot to apply configuration changes and come into +service. This can take 5-10 minutes, depending on the performance of the +host machine. + +Once the controller comes back up, check the status of controller-0 :: - [sysadmin@controller-0 ~(keystone_admin)]$ - - [sysadmin@controller-0 ~(keystone_admin)]$ system host-disk-list controller-0 - - +--------------------------------------+-----------+---------+---------+-------+------------+--------------+---------+-----------------------------+ - | uuid | device_no | device_ | device_ | size_ | available_ | rpm | serial_ | device_path | - | | de | num | type | gib | gib | | id | | - +--------------------------------------+-----------+---------+---------+-------+------------+--------------+---------+-----------------------------+ - | 3884f906-cb9b-4052-bcb8-8be70e599b9f | /dev/sda | 2048 | HDD | 1117. | 868.759 | Undetermined | PDNLH0B | /dev/disk/by-path/pci-0000: | - +--------------------------------------+-----------+---------+---------+-------+------------+--------------+---------+-----------------------------+ - | | | | | 782 | | | RH8W4QQ | 03:00.0-scsi-0:1:0:0 | - +--------------------------------------+-----------+---------+---------+-------+------------+--------------+---------+-----------------------------+ - | | | | | | | | | | - | 4e6c4b16-11e6-40b7-a2ff-751b14b8f0e9 | /dev/sdb | 2064 | HDD | 1117. | 0.0 | Undetermined | PDNLH0B | /dev/disk/by-path/pci-0000: | - +--------------------------------------+-----------+---------+---------+-------+------------+--------------+---------+-----------------------------+ - | | | | | 782 | | | RH8W4QQ | 03:00.0-scsi-0:1:0:1 | - +--------------------------------------+-----------+---------+---------+-------+------------+--------------+---------+-----------------------------+ - | | | | | | | | | | - +--------------------------------------+-----------+---------+---------+-------+------------+--------------+---------+-----------------------------+ - - [sysadmin@controller-0 ~(keystone_admin)]$ system host-disk-list controller-0 | awk '/\/dev\/sdb/{print $2}' | xargs -i system host-stor-add controller-0 {} - - +------------------+-------------------------------------------------------+ - | Property | Value | - +------------------+-------------------------------------------------------+ - | osdid | 0 | - +------------------+-------------------------------------------------------+ - | function | osd | - +------------------+-------------------------------------------------------+ - | state | configuring-on-unlock | - +------------------+-------------------------------------------------------+ - | journal_location | 71a9d508-06f6-4f5a-84f2-4723e70b1ecf | - +------------------+-------------------------------------------------------+ - | journal_size_gib | 1024 | - +------------------+-------------------------------------------------------+ - | journal_path | /dev/disk/by-path/pci-0000:03:00.0-scsi-0:1:0:1-part2 | - +------------------+-------------------------------------------------------+ - | journal_node | /dev/sdb2 | - +------------------+-------------------------------------------------------+ - | uuid | 71a9d508-06f6-4f5a-84f2-4723e70b1ecf | - +------------------+-------------------------------------------------------+ - | ihost_uuid | 08c23843-afa4-4b80-a285-be126365276e | - +------------------+-------------------------------------------------------+ - | idisk_uuid | 4e6c4b16-11e6-40b7-a2ff-751b14b8f0e9 | - +------------------+-------------------------------------------------------+ - | tier_uuid | db6eabf9-9922-4d8e-9740-c0f9878e692d | - +------------------+-------------------------------------------------------+ - | tier_name | storage | - +------------------+-------------------------------------------------------+ - | created_at | 2020-06-03T10:03:55.645744+00:00 | - +------------------+-------------------------------------------------------+ - | updated_at | None | - +------------------+-------------------------------------------------------+ - - [sysadmin@controller-0 ~(keystone_admin)]$ system host-stor-list controller-0 - - +--------------------------------------+----------+-------+-----------------------+--------------------------------------+-------------------------------------------------------+--------------+------------------+-----------+ - | uuid | function | osdid | state | idisk_uuid | journal_path | journal_node | journal_size_gib | tier_name | - +--------------------------------------+----------+-------+-----------------------+--------------------------------------+-------------------------------------------------------+--------------+------------------+-----------+ - | 71a9d508-06f6-4f5a-84f2-4723e70b1ecf | osd | 0 | configuring-on-unlock | 4e6c4b16-11e6-40b7-a2ff-751b14b8f0e9 | /dev/disk/by-path/pci-0000:03:00.0-scsi-0:1:0:1-part2 | /dev/sdb2 | 1 | storage | - +--------------------------------------+----------+-------+-----------------------+--------------------------------------+-------------------------------------------------------+--------------+------------------+-----------+ - -2.9 Configure the SR-IOV enabled network -'''''''''''''''''''''''''''''''''''''''' - -It needs : - - assign the label of SR-IOV - - change the CPU policy to static - - change the hugepage setting - - create the data network - - assign the SR-IOV interface to data network - -Example: + controller-0:~$ source /etc/platform/openrc + [sysadmin@controller-0 ~(keystone_admin)]$ system host-list + +----+--------------+-------------+----------------+-------------+--------------+ + | id | hostname | personality | administrative | operational | availability | + +----+--------------+-------------+----------------+-------------+--------------+ + | 1 | controller-0 | controller | unlocked | enabled | available | + +----+--------------+-------------+----------------+-------------+--------------+ + +2. Installation for the second server (controller-1) +---------------------------------------------------- + +2.1 Power on the controller-1 server and force it to network boot +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +2.2 As controller-1 boots, a message appears on its console instructing you to configure the personality of the node +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +2.3 On the console of controller-0, list hosts to see newly discovered controller-1 host (hostname=None) +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ :: - [sysadmin@controller-0 ~(keystone_admin)]$ WORKER=controller-0 - - [sysadmin@controller-0 ~(keystone_admin)]$ - - [sysadmin@controller-0 ~(keystone_admin)]$ system host-label-assign $WORKER sriovdp=enabled - - +-------------+--------------------------------------+ - | Property | Value | - +-------------+--------------------------------------+ - | uuid | 7101010d-1897-4cc8-8c87-7dffaebf848b | - +-------------+--------------------------------------+ - | host_uuid | 08c23843-afa4-4b80-a285-be126365276e | - +-------------+--------------------------------------+ - | label_key | sriovdp | - +-------------+--------------------------------------+ - | label_value | enabled | - +-------------+--------------------------------------+ - - [sysadmin@controller-0 ~(keystone_admin)]$ system host-label-assign $WORKER kube-cpu-mgr-policy=static - - +-------------+--------------------------------------+ - | Property | Value | - +-------------+--------------------------------------+ - | uuid | 4936f32b-6939-4115-b643-846bd50e7738 | - +-------------+--------------------------------------+ - | host_uuid | 08c23843-afa4-4b80-a285-be126365276e | - +-------------+--------------------------------------+ - | label_key | kube-cpu-mgr-policy | - +-------------+--------------------------------------+ - | label_value | static | - +-------------+--------------------------------------+ - - - [sysadmin@controller-0 ~(keystone_admin)]$ system host-memory-modify $WORKER -1G 7 0 - - +-------------------------------------+--------------------------------------+ - | Property | Value | - +-------------------------------------+--------------------------------------+ - | Memory: Usable Total (MiB) | 0 | - +-------------------------------------+--------------------------------------+ - | Platform (MiB) | 7000 | - +-------------------------------------+--------------------------------------+ - | Available (MiB) | 0 | - +-------------------------------------+--------------------------------------+ - | Huge Pages Configured | True | - +-------------------------------------+--------------------------------------+ - | vSwitch Huge Pages: Size (MiB) | 1024 | - +-------------------------------------+--------------------------------------+ - | Total | 0 | - +-------------------------------------+--------------------------------------+ - | Available | 0 | - +-------------------------------------+--------------------------------------+ - | Required | None | - +-------------------------------------+--------------------------------------+ - | Application Pages (4K): Total | None | - +-------------------------------------+--------------------------------------+ - | Application Huge Pages (2M): Total | 0 | - +-------------------------------------+--------------------------------------+ - | Available | 0 | - +-------------------------------------+--------------------------------------+ - | Application Huge Pages (1G): Total | 0 | - +-------------------------------------+--------------------------------------+ - | Total Pending | 7 | - +-------------------------------------+--------------------------------------+ - | Available | 0 | - +-------------------------------------+--------------------------------------+ - | uuid | 15702f44-2281-41f3-8c83-a1e9a300ad01 | - +-------------------------------------+--------------------------------------+ - | ihost_uuid | 08c23843-afa4-4b80-a285-be126365276e | - +-------------------------------------+--------------------------------------+ - | inode_uuid | d52648bc-dfa6-4214-afa3-5d2148ee4180 | - +-------------------------------------+--------------------------------------+ - | created_at | 2020-06-03T08:21:27.468357+00:00 | - +-------------------------------------+--------------------------------------+ - | updated_at | 2020-06-03T10:10:49.159080+00:00 | - +-------------------------------------+--------------------------------------+ - - - [sysadmin@controller-0 ~(keystone_admin)]$ system host-memory-modify $WORKER -1G 7 1 - - +-------------------------------------+--------------------------------------+ - | Property | Value | - +-------------------------------------+--------------------------------------+ - | Memory: Usable Total (MiB) | 0 | - +-------------------------------------+--------------------------------------+ - | Platform (MiB) | 1000 | - +-------------------------------------+--------------------------------------+ - | Available (MiB) | 0 | - +-------------------------------------+--------------------------------------+ - | Huge Pages Configured | True | - +-------------------------------------+--------------------------------------+ - | vSwitch Huge Pages: Size (MiB) | 1024 | - +-------------------------------------+--------------------------------------+ - | Total | 0 | - +-------------------------------------+--------------------------------------+ - | Available | 0 | - +-------------------------------------+--------------------------------------+ - | Required | None | - +-------------------------------------+--------------------------------------+ - | Application Pages (4K): Total | None | - +-------------------------------------+--------------------------------------+ - | Application Huge Pages (2M): Total | 0 | - +-------------------------------------+--------------------------------------+ - | Available | 0 | - +-------------------------------------+--------------------------------------+ - | Application Huge Pages (1G): Total | 0 | - +-------------------------------------+--------------------------------------+ - | Total Pending | 7 | - +-------------------------------------+--------------------------------------+ - | Available | 0 | - +-------------------------------------+--------------------------------------+ - | uuid | 544580b9-0f2a-41a1-b4e3-90fdf5c8f7e0 | - +-------------------------------------+--------------------------------------+ - | ihost_uuid | 08c23843-afa4-4b80-a285-be126365276e | - +-------------------------------------+--------------------------------------+ - | inode_uuid | e02c3c41-03b7-4f49-8244-bca851fa2d2f | - +-------------------------------------+--------------------------------------+ - | created_at | 2020-06-03T08:21:27.566279+00:00 | - +-------------------------------------+--------------------------------------+ - | updated_at | 2020-06-03T10:10:49.220907+00:00 | - +-------------------------------------+--------------------------------------+ - - - [sysadmin@controller-0 ~(keystone_admin)]$ PHYSNET0='physnet0' - - [sysadmin@controller-0 ~(keystone_admin)]$ PHYSNET1='physnet1' - - [sysadmin@controller-0 ~(keystone_admin)]$ WORKER=controller-0 - - [sysadmin@controller-0 ~(keystone_admin)]$ - - [sysadmin@controller-0 ~(keystone_admin)]$ system datanetwork-add ${PHYSNET0} flat - - +--------------+--------------------------------------+ - | Property | Value | - +--------------+--------------------------------------+ - | id | 1 | - +--------------+--------------------------------------+ - | uuid | 0ffe0b0a-35ff-45b2-9a62-63a494d2d18b | - +--------------+--------------------------------------+ - | name | physnet0 | - +--------------+--------------------------------------+ - | network_type | flat | - +--------------+--------------------------------------+ - | mtu | 1500 | - +--------------+--------------------------------------+ - | description | None | - +--------------+--------------------------------------+ - - [sysadmin@controller-0 ~(keystone_admin)]$ system datanetwork-add ${PHYSNET1} flat - - +--------------+--------------------------------------+ - | Property | Value | - +--------------+--------------------------------------+ - | id | 2 | - +--------------+--------------------------------------+ - | uuid | 899ca8ba-6800-4d62-aed4-3770878da738 | - +--------------+--------------------------------------+ - | name | physnet1 | - +--------------+--------------------------------------+ - | network_type | flat | - +--------------+--------------------------------------+ - | mtu | 1500 | - +--------------+--------------------------------------+ - | description | None | - +--------------+--------------------------------------+ - - - [sysadmin@controller-0 ~(keystone_admin)]$ system host-port-list controller-0 - - +--------------------------------------+--------+----------+--------------+--------+-----------+-------------+-------------------------------------------------------+ - | uuid | name | type | pci address | device | processor | accelerated | device type | - +--------------------------------------+--------+----------+--------------+--------+-----------+-------------+-------------------------------------------------------+ - | 7007dfb1-ea55-4355-9d27-3ed4c6696283 | eno1 | ethernet | 0000:02:00.0 | 0 | 0 | False | NetXtreme BCM5719 Gigabit Ethernet PCIe [1657] | - +--------------------------------------+--------+----------+--------------+--------+-----------+-------------+-------------------------------------------------------+ - | 51f62ecf-7897-43e3-beb8-46ae5550ef05 | eno2 | ethernet | 0000:02:00.1 | 0 | 0 | False | NetXtreme BCM5719 Gigabit Ethernet PCIe [1657] | - +--------------------------------------+--------+----------+--------------+--------+-----------+-------------+-------------------------------------------------------+ - | e987725e-ab45-4151-b53d-94ba21706eb4 | eno3 | ethernet | 0000:02:00.2 | 0 | 0 | False | NetXtreme BCM5719 Gigabit Ethernet PCIe [1657] | - +--------------------------------------+--------+----------+--------------+--------+-----------+-------------+-------------------------------------------------------+ - | f4a8115a-ca0b-4336-a634-2cad77c5a88c | eno4 | ethernet | 0000:02:00.3 | 0 | 0 | False | NetXtreme BCM5719 Gigabit Ethernet PCIe [1657] | - +--------------------------------------+--------+----------+--------------+--------+-----------+-------------+-------------------------------------------------------+ - | 88965882-c816-42e8-ba0e-d3ff6f9f553e | eno49 | ethernet | 0000:04:00.0 | 0 | 0 | False | OneConnect NIC (Skyhawk) [0720] | - +--------------------------------------+--------+----------+--------------+--------+-----------+-------------+-------------------------------------------------------+ - | 98e2cedc-9ef8-4ca0-b3e0-db3a2bd0273a | eno50 | ethernet | 0000:04:00.1 | 0 | 0 | False | OneConnect NIC (Skyhawk) [0720] | - +--------------------------------------+--------+----------+--------------+--------+-----------+-------------+-------------------------------------------------------+ - | e75d7aa6-7832-4ec4-9dd4-ea8300773fd8 | ens2f0 | ethernet | 0000:05:00.0 | 0 | 0 | True | 82599ES 10-Gigabit SFI/SFP+ Network Connection [10fb] | - +--------------------------------------+--------+----------+--------------+--------+-----------+-------------+-------------------------------------------------------+ - | 8ac4ffca-4a61-4b47-8e17-171f2e6cea66 | ens2f1 | ethernet | 0000:05:00.1 | 0 | 0 | True | 82599ES 10-Gigabit SFI/SFP+ Network Connection [10fb] | - +--------------------------------------+--------+----------+--------------+--------+-----------+-------------+-------------------------------------------------------+ - - - [sysadmin@controller-0 ~(keystone_admin)]$ INTL_IF=ens2f0 - - [sysadmin@controller-0 ~(keystone_admin)]$ system host-if-modify -m 1500 -n sriov0 -c pci-sriov -N 6 --vf-driver=vfio $WORKER $INTL_IF - - +-----------------+--------------------------------------+ - | Property | Value | - +-----------------+--------------------------------------+ - | ifname | sriov0 | - +-----------------+--------------------------------------+ - | iftype | ethernet | - +-----------------+--------------------------------------+ - | ports | [u'ens2f0'] | - +-----------------+--------------------------------------+ - | imac | 00:1b:21:b3:46:2c | - +-----------------+--------------------------------------+ - | imtu | 1500 | - +-----------------+--------------------------------------+ - | ifclass | pci-sriov | - +-----------------+--------------------------------------+ - | aemode | None | - +-----------------+--------------------------------------+ - | schedpolicy | None | - +-----------------+--------------------------------------+ - | txhashpolicy | None | - +-----------------+--------------------------------------+ - | uuid | 9450b1ae-d1a1-4ecb-811a-fa3cb1cdf362 | - +-----------------+--------------------------------------+ - | ihost_uuid | 08c23843-afa4-4b80-a285-be126365276e | - +-----------------+--------------------------------------+ - | vlan_id | None | - +-----------------+--------------------------------------+ - | uses | [] | - +-----------------+--------------------------------------+ - | used_by | [] | - +-----------------+--------------------------------------+ - | created_at | 2020-06-03T12:34:11.633254+00:00 | - +-----------------+--------------------------------------+ - | updated_at | 2020-06-04T02:01:28.168127+00:00 | - +-----------------+--------------------------------------+ - | sriov_numvfs | 6 | - +-----------------+--------------------------------------+ - | sriov_vf_driver | vfio | - +-----------------+--------------------------------------+ - | accelerated | [True] | - +-----------------+--------------------------------------+ - - [sysadmin@controller-0 ~(keystone_admin)]$ system interface-datanetwork-assign ${WORKER} sriov0 ${PHYSNET0} - - +------------------+--------------------------------------+ - | Property | Value | - +------------------+--------------------------------------+ - | hostname | controller-0 | - +------------------+--------------------------------------+ - | uuid | 1d35219d-3258-42e7-8f0e-41d865710d58 | - +------------------+--------------------------------------+ - | ifname | sriov0 | - +------------------+--------------------------------------+ - | datanetwork_name | physnet0 | - +------------------+--------------------------------------+ - - - - [sysadmin@controller-0 ~(keystone_admin)]$ INTL_IF=ens2f1 - - [sysadmin@controller-0 ~(keystone_admin)]$ system host-if-modify -m 1500 -n sriov1 -c pci-sriov -N 6 --vf-driver=vfio $WORKER $INTL_IF - - +-----------------+--------------------------------------+ - | Property | Value | - +-----------------+--------------------------------------+ - | ifname | sriov1 | - +-----------------+--------------------------------------+ - | iftype | ethernet | - +-----------------+--------------------------------------+ - | ports | [u'ens2f1'] | - +-----------------+--------------------------------------+ - | imac | 00:1b:21:b3:46:2d | - +-----------------+--------------------------------------+ - | imtu | 1500 | - +-----------------+--------------------------------------+ - | ifclass | pci-sriov | - +-----------------+--------------------------------------+ - | aemode | None | - +-----------------+--------------------------------------+ - | schedpolicy | None | - +-----------------+--------------------------------------+ - | txhashpolicy | None | - +-----------------+--------------------------------------+ - | uuid | 13d5ee99-0399-4b6b-a359-0f96660afdc4 | - | ihost_uuid | 08c23843-afa4-4b80-a285-be126365276e | - | vlan_id | None | - | uses | [] | - | used_by | [] | - | created_at | 2020-06-03T12:34:12.072624+00:00 | - | updated_at | 2020-06-04T02:03:51.405322+00:00 | - | sriov_numvfs | 6 | - | sriov_vf_driver | vfio | - | accelerated | [True] | - +-----------------+--------------------------------------+ - - [sysadmin@controller-0 ~(keystone_admin)]$ system interface-datanetwork-assign ${WORKER} sriov1 ${PHYSNET1} - - +------------------+--------------------------------------+ - | Property | Value | - +------------------+--------------------------------------+ - | hostname | controller-0 | - +------------------+--------------------------------------+ - | uuid | a87c6a5f-0c53-4ebf-9a32-38366700426f | - +------------------+--------------------------------------+ - | ifname | sriov1 | - +------------------+--------------------------------------+ - | datanetwork_name | physnet1 | - +------------------+--------------------------------------+ - -2.10 Unlock the server -'''''''''''''''''''''' + [sysadmin@controller-0 ~(keystone_admin)]$ system host-list + +----+--------------+-------------+----------------+-------------+--------------+ + | id | hostname | personality | administrative | operational | availability | + +----+--------------+-------------+----------------+-------------+--------------+ + | 1 | controller-0 | controller | unlocked | enabled | degraded | + | 2 | None | None | locked | disabled | offline | + +----+--------------+-------------+----------------+-------------+--------------+ -Example: +2.4 Using the host id, set the personality of this host to 'controller’: +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ :: - - [sysadmin@controller-0 ~(keystone_admin)]$ system host-unlock controller-0 - - +-----------------------+-------------------------------------------------+ - | Property | Value | - +-----------------------+-------------------------------------------------+ - | action | none | - +-----------------------+-------------------------------------------------+ - | administrative | locked | - +-----------------------+-------------------------------------------------+ - | availability | online | - +-----------------------+-------------------------------------------------+ - | bm_ip | None | - +-----------------------+-------------------------------------------------+ - | bm_type | none | - +-----------------------+-------------------------------------------------+ - | bm_username | None | - +-----------------------+-------------------------------------------------+ - | boot_device | /dev/disk/by-path/pci-0000:03:00.0-scsi-0:1:0:0 | - +-----------------------+-------------------------------------------------+ - | capabilities | {u'stor_function': u'monitor'} | - +-----------------------+-------------------------------------------------+ - | clock_synchronization | ntp | - +-----------------------+-------------------------------------------------+ - | config_applied | 3daf20c7-c032-4aa2-839d-93da92051bea | - +-----------------------+-------------------------------------------------+ - | config_status | Config out-of-date | - +-----------------------+-------------------------------------------------+ - | config_target | bdaf20c7-c032-4aa2-839d-93da92051bea | - +-----------------------+-------------------------------------------------+ - | console | tty0 | - +-----------------------+-------------------------------------------------+ - | created_at | 2020-06-03T08:20:59.372602+00:00 | - +-----------------------+-------------------------------------------------+ - | hostname | controller-0 | - +-----------------------+-------------------------------------------------+ - | id | 1 | - +-----------------------+-------------------------------------------------+ - | install_output | graphical | - +-----------------------+-------------------------------------------------+ - | install_state | None | - +-----------------------+-------------------------------------------------+ - | install_state_info | None | - +-----------------------+-------------------------------------------------+ - | inv_state | inventoried | - +-----------------------+-------------------------------------------------+ - | invprovision | provisioning | - +-----------------------+-------------------------------------------------+ - | location | {} | - +-----------------------+-------------------------------------------------+ - | mgmt_ip | 192.168.204.2 | - +-----------------------+-------------------------------------------------+ - | mgmt_mac | 00:00:00:00:00:00 | - +-----------------------+-------------------------------------------------+ - | operational | disabled | - +-----------------------+-------------------------------------------------+ - | personality | controller | - +-----------------------+-------------------------------------------------+ - | reserved | False | - +-----------------------+-------------------------------------------------+ - | rootfs_device | /dev/disk/by-path/pci-0000:03:00.0-scsi-0:1:0:0 | - +-----------------------+-------------------------------------------------+ - | serialid | None | - +-----------------------+-------------------------------------------------+ - | software_load | 19.12 | - +-----------------------+-------------------------------------------------+ - | subfunction_avail | online | - +-----------------------+-------------------------------------------------+ - | subfunction_oper | disabled | - +-----------------------+-------------------------------------------------+ - | subfunctions | controller,worker | - +-----------------------+-------------------------------------------------+ - | task | Unlocking | - +-----------------------+-------------------------------------------------+ - | tboot | false | - +-----------------------+-------------------------------------------------+ - | ttys_dcd | None | - +-----------------------+-------------------------------------------------+ - | updated_at | 2020-06-04T02:04:59.514854+00:00 | - +-----------------------+-------------------------------------------------+ - | uptime | 49475 | - +-----------------------+-------------------------------------------------+ - | uuid | 08c23843-afa4-4b80-a285-be126365276e | - +-----------------------+-------------------------------------------------+ - | vim_progress_status | None | - +-----------------------+-------------------------------------------------+ + + [sysadmin@controller-0 ~(keystone_admin)]$ system host-update 2 personality=controller + +-----------------------+--------------------------------------+ + | Property | Value | + +-----------------------+--------------------------------------+ + | action | none | + | administrative | locked | + | availability | offline | + | bm_ip | None | + | bm_type | None | + | bm_username | None | + | boot_device | /dev/sda | + | capabilities | {} | + | clock_synchronization | ntp | + | config_applied | None | + | config_status | None | + | config_target | None | + | console | ttyS0,115200 | + | created_at | 2020-11-17T10:17:44.387813+00:00 | + | hostname | controller-1 | + | id | 2 | + | install_output | text | + | install_state | None | + | install_state_info | None | + | inv_state | None | + | invprovision | None | + | location | {} | + | mgmt_ip | 192.168.18.4 | + | mgmt_mac | 24:6e:96:5d:38:ee | + | operational | disabled | + | personality | controller | + | reserved | False | + | rootfs_device | /dev/sda | + | serialid | None | + | software_load | 19.12 | + | subfunction_avail | not-installed | + | subfunction_oper | disabled | + | subfunctions | controller,worker,lowlatency | + | task | None | + | tboot | false | + | ttys_dcd | None | + | updated_at | None | + | uptime | 0 | + | uuid | f069381d-9743-49cc-bf8b-eb4bd3972203 | + | vim_progress_status | None | + +-----------------------+--------------------------------------+ + +2.5 Wait for the software installation on controller-1 to complete, for controller-1 to reboot, and for controller-1 to show as locked/disabled/online in 'system host-list'. +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +This can take 5-10 minutes, depending on the performance of the host +machine. + +:: + + [root@controller-0 hieradata(keystone_admin)]$ system host-list + +----+--------------+-------------+----------------+-------------+--------------+ + | id | hostname | personality | administrative | operational | availability | + +----+--------------+-------------+----------------+-------------+--------------+ + | 1 | controller-0 | controller | unlocked | enabled | available | + | 2 | controller-1 | controller | locked | disabled | online | + +----+--------------+-------------+----------------+-------------+--------------+ + +2.6 Configure controller-1 +~~~~~~~~~~~~~~~~~~~~~~~~~~ + +:: + + OAM_IF=eno3 + MGMT_IF=eno1 + system host-if-modify controller-1 $OAM_IF -n oam0 + system host-if-modify controller-1 oam0 -c platform + system interface-network-assign controller-1 oam0 oam + + system host-if-add -V 19 controller-1 cluster0 vlan pxeboot0 + system interface-network-assign controller-1 cluster0 cluster-host + + system host-if-list controller-1 + + system host-disk-list controller-1 + system host-disk-list controller-1 | awk '/\/dev\/sdb/{print $2}' | xargs -i system host-stor-add controller-1 {} + system host-disk-list controller-1 | awk '/\/dev\/sdc/{print $2}' | xargs -i system host-stor-add controller-1 {} + system host-stor-list controller-1 + +Output: + +:: + + [sysadmin@controller-0 ~(keystone_admin)]$ OAM_IF=eno3 + [sysadmin@controller-0 ~(keystone_admin)]$ MGMT_IF=eno1 + [sysadmin@controller-0 ~(keystone_admin)]$ system host-if-modify controller-1 $OAM_IF -n oam0 + +-----------------+--------------------------------------+ + | Property | Value | + +-----------------+--------------------------------------+ + | ifname | oam0 | + | iftype | ethernet | + | ports | [u'eno3'] | + | imac | 24:6e:96:5d:39:0e | + | imtu | 1500 | + | ifclass | None | + | aemode | None | + | schedpolicy | None | + | txhashpolicy | None | + | uuid | c2473511-d0d6-445d-9739-4d43dc029de9 | + | ihost_uuid | 63c930c7-2195-4d5a-870c-be610fd6b4fc | + | vlan_id | None | + | uses | [] | + | used_by | [] | + | created_at | 2020-11-22T14:01:32.365863+00:00 | + | updated_at | 2020-11-22T15:04:45.090904+00:00 | + | sriov_numvfs | 0 | + | sriov_vf_driver | None | + | accelerated | [True] | + +-----------------+--------------------------------------+ + [sysadmin@controller-0 ~(keystone_admin)]$ system host-if-modify controller-1 oam0 -c platform + +-----------------+--------------------------------------+ + | Property | Value | + +-----------------+--------------------------------------+ + | ifname | oam0 | + | iftype | ethernet | + | ports | [u'eno3'] | + | imac | 24:6e:96:5d:39:0e | + | imtu | 1500 | + | ifclass | platform | + | aemode | None | + | schedpolicy | None | + | txhashpolicy | None | + | uuid | c2473511-d0d6-445d-9739-4d43dc029de9 | + | ihost_uuid | 63c930c7-2195-4d5a-870c-be610fd6b4fc | + | vlan_id | None | + | uses | [] | + | used_by | [] | + | created_at | 2020-11-22T14:05:16.052229+00:00 | + | updated_at | 2020-11-22T15:08:35.324634+00:00 | + | sriov_numvfs | 0 | + | sriov_vf_driver | None | + | accelerated | [True] | + +-----------------+--------------------------------------+ + [sysadmin@controller-0 ~(keystone_admin)]$ system interface-network-assign controller-1 oam0 oam + +--------------+--------------------------------------+ + | Property | Value | + +--------------+--------------------------------------+ + | hostname | controller-1 | + | uuid | f2e7f088-0dd0-4adc-8348-4e3cef23bc47 | + | ifname | oam0 | + | network_name | oam | + +--------------+--------------------------------------+ + [sysadmin@controller-0 ~(keystone_admin)]$ + + [sysadmin@controller-0 ~(keystone_admin)]$ system host-if-add -V 19 controller-1 cluster0 vlan pxeboot0 + +-----------------+--------------------------------------+ + | Property | Value | + +-----------------+--------------------------------------+ + | ifname | cluster0 | + | iftype | vlan | + | ports | [] | + | imac | 24:6e:96:5d:38:ee | + | imtu | 1500 | + | ifclass | None | + | aemode | None | + | schedpolicy | None | + | txhashpolicy | None | + | uuid | b6783682-b2aa-4135-90d2-676e1db41ae8 | + | ihost_uuid | 63c930c7-2195-4d5a-870c-be610fd6b4fc | + | vlan_id | 19 | + | uses | [u'pxeboot0'] | + | used_by | [] | + | created_at | 2020-11-22T15:08:43.932209+00:00 | + | updated_at | None | + | sriov_numvfs | 0 | + | sriov_vf_driver | None | + | accelerated | [True] | + +-----------------+--------------------------------------+ + + [sysadmin@controller-0 ~(keystone_admin)]$ system interface-network-assign controller-1 cluster0 cluster-host + +--------------+--------------------------------------+ + | Property | Value | + +--------------+--------------------------------------+ + | hostname | controller-1 | + | uuid | 8fc64805-b54b-45a4-b88a-e13b236abfe8 | + | ifname | cluster0 | + | network_name | cluster-host | + +--------------+--------------------------------------+ + [sysadmin@controller-0 ~(keystone_admin)]$ + [sysadmin@controller-0 ~(keystone_admin)]$ system host-if-list controller-1 + +--------------------------------------+----------+----------+----------+---------+-----------+---------------+-------------------------+------------+ + | uuid | name | class | type | vlan id | ports | uses i/f | used by i/f | attributes | + +--------------------------------------+----------+----------+----------+---------+-----------+---------------+-------------------------+------------+ + | b6783682-b2aa-4135-90d2-676e1db41ae8 | cluster0 | platform | vlan | 19 | [] | [u'pxeboot0'] | [] | MTU=1500 | + | b8921960-fde5-44c3-960d-2aebf42ea400 | pxeboot0 | platform | ethernet | None | [u'eno1'] | [] | [u'mgmt0', u'cluster0'] | MTU=1500 | + | c103275b-2b75-4568-865f-ac6be32ecb2d | mgmt0 | platform | vlan | 18 | [] | [u'pxeboot0'] | [] | MTU=1500 | + | c2473511-d0d6-445d-9739-4d43dc029de9 | oam0 | platform | ethernet | None | [u'eno3'] | [] | [] | MTU=1500 | + +--------------------------------------+----------+----------+----------+---------+-----------+---------------+-------------------------+------------+ + [sysadmin@controller-0 ~(keystone_admin)]$ system host-disk-list controller-1 + +--------------------------------------+-----------+---------+---------+-------+------------+--------------+----------------------------------+-------------------------------------------------+ + | uuid | device_no | device_ | device_ | size_ | available_ | rpm | serial_id | device_path | + | | de | num | type | gib | gib | | | | + +--------------------------------------+-----------+---------+---------+-------+------------+--------------+----------------------------------+-------------------------------------------------+ + | 5b8fade4-b048-48fa-b906-9dcbdbed8e96 | /dev/sda | 2048 | HDD | 893. | 644.726 | Undetermined | 00cbd97f3e36ccfa2500561b14604609 | /dev/disk/by-path/pci-0000:86:00.0-scsi-0:2:0:0 | + | | | | | 75 | | | | | + | | | | | | | | | | + | 1a3f0a36-5961-42e5-a271-e71db1c25d42 | /dev/sdb | 2064 | HDD | 1117. | 1117.247 | Undetermined | 006d0e977b5fccfa2500561b14604609 | /dev/disk/by-path/pci-0000:86:00.0-scsi-0:2:1:0 | + | | | | | 25 | | | | | + | | | | | | | | | | + | eddd732f-2cea-49b3-86db-b722c0b1a1ae | /dev/sdc | 2080 | HDD | 1117. | 1117.247 | Undetermined | 003a2377ac7fccfa2500561b14604609 | /dev/disk/by-path/pci-0000:86:00.0-scsi-0:2:2:0 | + | | | | | 25 | | | | | + | | | | | | | | | | + | 774c3cd0-1178-4145-9573-f0d6dee2ba06 | /dev/sdd | 2096 | HDD | 1117. | 1117.247 | Undetermined | 00d7093ef0adccfa2500561b14604609 | /dev/disk/by-path/pci-0000:86:00.0-scsi-0:2:3:0 | + | | | | | 25 | | | | | + | | | | | | | | | | + | 00361302-8d55-4730-855c-b0098c73ab7e | /dev/sde | 2112 | SSD | 223. | 223.568 | N/A | PHDW730104QM240E | /dev/disk/by-path/pci-0000:d8:00.0-ata-1 | + | | | | | 57 | | | | | + | | | | | | | | | | + | 7ce735e6-920f-4424-a890-a7a7f48d7632 | /dev/sdf | 2128 | SSD | 223. | 223.568 | N/A | PHDW730104LL240E | /dev/disk/by-path/pci-0000:d8:00.0-ata-2 | + | | | | | 57 | | | | | + | | | | | | | | | | + +--------------------------------------+-----------+---------+---------+-------+------------+--------------+----------------------------------+-------------------------------------------------+ + [sysadmin@controller-0 ~(keystone_admin)]$ system host-disk-list controller-1 | awk '/\/dev\/sdb/{print $2}' | xargs -i system host-stor-add controller-1 {} + +------------------+-------------------------------------------------------+ + | Property | Value | + +------------------+-------------------------------------------------------+ + | osdid | 2 | + | function | osd | + | state | configuring-on-unlock | + | journal_location | 54a218d8-0466-4366-9ef0-3ec5a952fde7 | + | journal_size_gib | 1024 | + | journal_path | /dev/disk/by-path/pci-0000:86:00.0-scsi-0:2:1:0-part2 | + | journal_node | /dev/sdb2 | + | uuid | 54a218d8-0466-4366-9ef0-3ec5a952fde7 | + | ihost_uuid | 63c930c7-2195-4d5a-870c-be610fd6b4fc | + | idisk_uuid | 1a3f0a36-5961-42e5-a271-e71db1c25d42 | + | tier_uuid | 06b4740e-29db-4896-9600-03ee40fe0d6c | + | tier_name | storage | + | created_at | 2020-11-22T15:11:55.641193+00:00 | + | updated_at | None | + +------------------+-------------------------------------------------------+ + + [sysadmin@controller-0 ~(keystone_admin)]$ system host-disk-list controller-1 | awk '/\/dev\/sdc/{print $2}' | xargs -i system host-stor-add controller-1 {} + +------------------+-------------------------------------------------------+ + | Property | Value | + +------------------+-------------------------------------------------------+ + | osdid | 3 | + | function | osd | + | state | configuring-on-unlock | + | journal_location | 5be88c7a-3a94-4b97-9da5-b247bb89406c | + | journal_size_gib | 1024 | + | journal_path | /dev/disk/by-path/pci-0000:86:00.0-scsi-0:2:2:0-part2 | + | journal_node | /dev/sdc2 | + | uuid | 5be88c7a-3a94-4b97-9da5-b247bb89406c | + | ihost_uuid | 63c930c7-2195-4d5a-870c-be610fd6b4fc | + | idisk_uuid | eddd732f-2cea-49b3-86db-b722c0b1a1ae | + | tier_uuid | 06b4740e-29db-4896-9600-03ee40fe0d6c | + | tier_name | storage | + | created_at | 2020-11-22T15:12:04.274839+00:00 | + | updated_at | None | + +------------------+-------------------------------------------------------+ + + [sysadmin@controller-0 ~(keystone_admin)]$ system host-stor-list controller-1 + +--------------------------------------+----------+-------+-----------------------+--------------------------------------+-------------------------------------------------------+--------------+------------------+-----------+ + | uuid | function | osdid | state | idisk_uuid | journal_path | journal_node | journal_size_gib | tier_name | + +--------------------------------------+----------+-------+-----------------------+--------------------------------------+-------------------------------------------------------+--------------+------------------+-----------+ + | 54a218d8-0466-4366-9ef0-3ec5a952fde7 | osd | 2 | configuring-on-unlock | 1a3f0a36-5961-42e5-a271-e71db1c25d42 | /dev/disk/by-path/pci-0000:86:00.0-scsi-0:2:1:0-part2 | /dev/sdb2 | 1 | storage | + | 5be88c7a-3a94-4b97-9da5-b247bb89406c | osd | 3 | configuring-on-unlock | eddd732f-2cea-49b3-86db-b722c0b1a1ae | /dev/disk/by-path/pci-0000:86:00.0-scsi-0:2:2:0-part2 | /dev/sdc2 | 1 | storage | + +--------------------------------------+----------+-------+-----------------------+--------------------------------------+-------------------------------------------------------+--------------+------------------+-----------+ + +2.7 Unlock controller-1 +~~~~~~~~~~~~~~~~~~~~~~~ + +Unlock controller-1 in order to bring it into service: + +:: + + [sysadmin@controller-0 ~(keystone_admin)]$ system host-unlock controller-1 + +-----------------------+--------------------------------------+ + | Property | Value | + +-----------------------+--------------------------------------+ + | action | none | + | administrative | locked | + | availability | online | + | bm_ip | None | + | bm_type | None | + | bm_username | None | + | boot_device | /dev/sda | + | capabilities | {u'stor_function': u'monitor'} | + | clock_synchronization | ntp | + | config_applied | None | + | config_status | Config out-of-date | + | config_target | 9747e0ce-2319-409d-b75c-2475bc5065ac | + | console | ttyS0,115200 | + | created_at | 2020-11-22T12:58:11.630526+00:00 | + | hostname | controller-1 | + | id | 3 | + | install_output | text | + | install_state | None | + | install_state_info | None | + | inv_state | inventoried | + | invprovision | unprovisioned | + | location | {} | + | mgmt_ip | 192.168.18.4 | + | mgmt_mac | 24:6e:96:5d:38:ee | + | operational | disabled | + | personality | controller | + | reserved | False | + | rootfs_device | /dev/sda | + | serialid | None | + | software_load | 19.12 | + | subfunction_avail | online | + | subfunction_oper | disabled | + | subfunctions | controller,worker,lowlatency | + | task | Unlocking | + | tboot | false | + | ttys_dcd | None | + | updated_at | 2020-11-22T15:13:09.716324+00:00 | + | uptime | 752 | + | uuid | 63c930c7-2195-4d5a-870c-be610fd6b4fc | + | vim_progress_status | None | + +-----------------------+--------------------------------------+ + +Controller-1 will reboot in order to apply configuration changes and +come into service. This can take 5-10 minutes, depending on the +performance of the host machine. + +:: + + [root@controller-0 hieradata(keystone_admin)]$ system host-list + +----+--------------+-------------+----------------+-------------+--------------+ + | id | hostname | personality | administrative | operational | availability | + +----+--------------+-------------+----------------+-------------+--------------+ + | 1 | controller-0 | controller | unlocked | enabled | available | + | 2 | controller-1 | controller | unlocked | enabled | available | + +----+--------------+-------------+----------------+-------------+--------------+ + + [sysadmin@controller-0 ~(keystone_admin)]$ system host-show controller-1 + +-----------------------+-----------------------------------------------------------------------+ + | Property | Value | + +-----------------------+-----------------------------------------------------------------------+ + | action | none | + | administrative | unlocked | + | availability | available | + | bm_ip | None | + | bm_type | None | + | bm_username | None | + | boot_device | /dev/sda | + | capabilities | {u'stor_function': u'monitor', u'Personality': u'Controller-Standby'} | + | clock_synchronization | ntp | + | config_applied | 9747e0ce-2319-409d-b75c-2475bc5065ac | + | config_status | None | + | config_target | 9747e0ce-2319-409d-b75c-2475bc5065ac | + | console | ttyS0,115200 | + | created_at | 2020-11-22T12:58:11.630526+00:00 | + | hostname | controller-1 | + | id | 2 | + | install_output | text | + | install_state | None | + | install_state_info | None | + | inv_state | inventoried | + | invprovision | provisioned | + | location | {} | + | mgmt_ip | 192.168.18.4 | + | mgmt_mac | 24:6e:96:5d:38:ee | + | operational | enabled | + | personality | controller | + | reserved | False | + | rootfs_device | /dev/sda | + | serialid | None | + | software_load | 19.12 | + | subfunction_avail | available | + | subfunction_oper | enabled | + | subfunctions | controller,worker,lowlatency | + | task | | + | tboot | false | + | ttys_dcd | None | + | updated_at | 2020-11-22T23:59:07.787759+00:00 | + | uptime | 31008 | + | uuid | 63c930c7-2195-4d5a-870c-be610fd6b4fc | + | vim_progress_status | services-enabled | + +-----------------------+-----------------------------------------------------------------------+ + 3. Simple use case for sriov ```````````````````````````` -- 2.16.6