Hyades - shawfdong/hyades GitHub Wiki

Hyades is the Master Node of the Hyades cluster. It is a Dell PowerEdge R820 server, equipped with four (4x) 8-core Intel Sandy Bridge Xeon E5-4620 processors at 2.20GHz, and 128 GB memory.

Storage

Dell OpenManage Server Administrator (OMSA) reports that the RAID controller is a PERC H710P (see also Dell OpenManage):

# /opt/dell/srvadmin/bin/omreport storage controller
 Controller  PERC H710P Adapter(Slot 7)
but is actually a rebranded LSI MegaRAID SAS 2208:
# lspci | grep RAID
02:00.0 RAID bus controller: LSI Logic / Symbios Logic MegaRAID SAS 2208 [Thunderbolt] (rev 01)

Dell OpenManage Server Administrator (OMSA) reports that there are eight (8x) 1TB SATA drives (Seagate Constellation.2 ST91000640NS 1TB 7200 RPM 64MB Cache SATA 6.0Gb/s 2.5" Enterprise-class Internal Hard Drives) on the RAID controller:

# /opt/dell/srvadmin/bin/omreport storage pdisk controller=0

A RAID-1 virtual disk (volume) is created on the first 2 physical disks:

# /opt/dell/srvadmin/bin/omreport storage vdisk controller=0 vdisk=0
Virtual Disk 0 on Controller PERC H710P Adapter (Slot 7)

Controller PERC H710P Adapter (Slot 7)
ID                                : 0
Status                            : Ok
Name                              : VD0
State                             : Ready
Hot Spare Policy violated         : Not Assigned
Encrypted                         : No
Layout                            : RAID-1
Size                              : 931.00 GB (999653638144 bytes)
T10 Protection Information Status : No
Associated Fluid Cache State      : Not Applicable
Device Name                       : /dev/sda
Bus Protocol                      : SATA
Media                             : HDD
Read Policy                       : Adaptive Read Ahead
Write Policy                      : Write Back
Cache Policy                      : Not Applicable
Stripe Element Size               : 64 KB
Disk Cache Policy                 : Enabled

and a RAID-6 virtual disk (volume) is created on the remaining 6 physical disks (mounted at /scratch):

# /opt/dell/srvadmin/bin/omreport storage vdisk controller=0 vdisk=1
Virtual Disk 1 on Controller PERC H710P Adapter (Slot 7)

Controller PERC H710P Adapter (Slot 7)
ID                                : 1
Status                            : Ok
Name                              : VD1
State                             : Ready
Hot Spare Policy violated         : Not Assigned
Encrypted                         : No
Layout                            : RAID-6
Size                              : 3,724.00 GB (3998614552576 bytes)
T10 Protection Information Status : No
Associated Fluid Cache State      : Not Applicable
Device Name                       : /dev/sdb
Bus Protocol                      : SATA
Media                             : HDD
Read Policy                       : Adaptive Read Ahead
Write Policy                      : Write Back
Cache Policy                      : Not Applicable
Stripe Element Size               : 64 KB
Disk Cache Policy                 : Enabled

Network

There are 4 on-board Broadcom Ethernet interfaces:

# lspci | grep Ethernet
01:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM57800 1/10 Gigabit Ethernet (rev 10)
01:00.1 Ethernet controller: Broadcom Corporation NetXtreme II BCM57800 1/10 Gigabit Ethernet (rev 10)
01:00.2 Ethernet controller: Broadcom Corporation NetXtreme II BCM57800 1/10 Gigabit Ethernet (rev 10)
01:00.3 Ethernet controller: Broadcom Corporation NetXtreme II BCM57800 1/10 Gigabit Ethernet (rev 10)
The first 2 (em1 & em2) are 10GbE interfaces; and remaining 2 (em3 & em4) are GbE interfaces.

There is a Mellanox ConnectX-2 VPI single-port adapter:

# lspci | grep Mellanox
41:00.0 InfiniBand: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE] (rev b0)
which can be configured either as QDR InfiniBand or 10 GbE. Since the interface is InfiniBand by default, there is no need to modify /etc/rdma/mlx4.conf, which can be left blank (see also Pleiades).

The IP addresses of the network interfaces are (see also Hyades Networks):

Interface IP Address Network Subnet Netmask
em1 128.114.126.225 Public 10GbE 128.114.126.224 255.255.255.224
em2 10.7.8.1 Private 10GbE 10.7.0.0 255.255.0.0
em3 10.6.8.1 Private GbE 10.6.0.0 255.255.0.0
em4 10.9.8.11 IPMI 10.9.0.0 255.255.0.0
ib0 10.8.8.1 IPoIB 10.8.0.0 255.255.0.0
ipmi0 10.9.8.1 IPMI 10.9.0.0 255.255.0.0
⚠️ **GitHub.com Fallback** ⚠️