Huawei OSC - shawfdong/hyades GitHub Wiki
There are six Object Storage service Controllers (OSC) in the Huawei Universal Distributed Storage. Each server is a 2U Huawei RH2288 V2 server, equipped with 2x quad-core Intel Xeon E5-2609 CPUs (2.40GHz), 64 GB memory, and 2x 1TB SATA HDDs configured into a RAID-1 group (managed by an LSI SAS2208 RAID controller). There are 4x Gigabit Network Interfaces and 2x 10-Gigabit Network Interfaces on each server.
The 4x Gigabit Network Interfaces, eth0 – eth3, are unused on each OMS.
The 2x 10GbE NICs, eth4 & eth5, are bonded together into a channel bonding interface bond5. The IP addresses of bond5 are 172.16.1.11 – 13 & 172.16.2.11 – 13, on OSC01 – OSC06 respectively:
OSC01:~ # cat /etc/sysconfig/network/ifcfg-bond5 BONDING_MASTER='yes' BONDING_MODULE_OPTS='mode=balance-xor miimon=100 xmit_hash_policy=layer3+4' BONDING_SLAVE0='eth4' BONDING_SLAVE1='eth5' BOOTPROTO='static' BROADCAST='' IPADDR='172.16.1.11' NETMASK='255.255.255.0' STARTMODE='auto' USERCONTROL='no' OSC01:~ # cat /etc/sysconfig/network/ifcfg-eth4 STARTMODE='hotplug' BOOTPROTO='none' ETHTOOL_OPTIONS='-K eth4 lro off' OSC01:~ # cat /etc/sysconfig/network/ifcfg-eth5 STARTMODE='hotplug' BOOTPROTO='none' ETHTOOL_OPTIONS='-K eth5 lro off'
Two VLAN interfaces, vlan3076 & vlan3078, are then created on bond5:
# cat /etc/sysconfig/network/ifcfg-vlan3076 BOOTPROTO='static' ETHERDEVICE='bond0' STARTMODE='auto' USERCONTROL='no' # cat /etc/sysconfig/network/ifcfg-vlan3078 BOOTPROTO='static' ETHERDEVICE='bond0' STARTMODE='auto' USERCONTROL='no'
A bridge interface br1 is created on vlan3078. The IP addresses of br1 are 128.114.126.244 – 249, on OSC01 – OSC06 respectively:
OSC01:~ # cat /etc/sysconfig/network/ifcfg-br1 BOOTPROTO='static' BRIDGE='yes' BRIDGE_FORWARDDELAY='0' BRIDGE_PORTS='vlan3078' BRIDGE_STP='off' IPADDR='128.114.126.244' NETMASK='255.255.255.224' STARTMODE='auto' USERCONTROL='no'
A bridge interface br2 is created on vlan3076. The IP addresses of br2 are 172.16.6.5 – 10, on OSC01 – OSC06 respectively:
OSC01:~ # cat /etc/sysconfig/network/ifcfg-br2 BOOTPROTO='static' BRIDGE='yes' BRIDGE_FORWARDDELAY='0' BRIDGE_PORTS='vlan3076' BRIDGE_STP='off' IPADDR='172.16.6.5' NETMASK='255.255.255.0' STARTMODE='auto' USERCONTROL='no'
NOTE the setup (by Huawei) is unnecessarily convoluted! The 2 bridge interfaces, br1 & br2, are superfluous. One can simply assign an IP address to a VLAN interface. See:
# man ifcfg-vlan