Hyades - shawfdong/hyades GitHub Wiki
Hyades is the Master Node of the Hyades cluster. It is a Dell PowerEdge R820 server, equipped with four (4x) 8-core Intel Sandy Bridge Xeon E5-4620 processors at 2.20GHz, and 128 GB memory.
Dell OpenManage Server Administrator (OMSA) reports that the RAID controller is a PERC H710P (see also Dell OpenManage):
# /opt/dell/srvadmin/bin/omreport storage controller Controller PERC H710P Adapter(Slot 7)but is actually a rebranded LSI MegaRAID SAS 2208:
# lspci | grep RAID 02:00.0 RAID bus controller: LSI Logic / Symbios Logic MegaRAID SAS 2208 [Thunderbolt] (rev 01)
Dell OpenManage Server Administrator (OMSA) reports that there are eight (8x) 1TB SATA drives (Seagate Constellation.2 ST91000640NS 1TB 7200 RPM 64MB Cache SATA 6.0Gb/s 2.5" Enterprise-class Internal Hard Drives) on the RAID controller:
# /opt/dell/srvadmin/bin/omreport storage pdisk controller=0
A RAID-1 virtual disk (volume) is created on the first 2 physical disks:
# /opt/dell/srvadmin/bin/omreport storage vdisk controller=0 vdisk=0 Virtual Disk 0 on Controller PERC H710P Adapter (Slot 7) Controller PERC H710P Adapter (Slot 7) ID : 0 Status : Ok Name : VD0 State : Ready Hot Spare Policy violated : Not Assigned Encrypted : No Layout : RAID-1 Size : 931.00 GB (999653638144 bytes) T10 Protection Information Status : No Associated Fluid Cache State : Not Applicable Device Name : /dev/sda Bus Protocol : SATA Media : HDD Read Policy : Adaptive Read Ahead Write Policy : Write Back Cache Policy : Not Applicable Stripe Element Size : 64 KB Disk Cache Policy : Enabled
and a RAID-6 virtual disk (volume) is created on the remaining 6 physical disks (mounted at /scratch):
# /opt/dell/srvadmin/bin/omreport storage vdisk controller=0 vdisk=1 Virtual Disk 1 on Controller PERC H710P Adapter (Slot 7) Controller PERC H710P Adapter (Slot 7) ID : 1 Status : Ok Name : VD1 State : Ready Hot Spare Policy violated : Not Assigned Encrypted : No Layout : RAID-6 Size : 3,724.00 GB (3998614552576 bytes) T10 Protection Information Status : No Associated Fluid Cache State : Not Applicable Device Name : /dev/sdb Bus Protocol : SATA Media : HDD Read Policy : Adaptive Read Ahead Write Policy : Write Back Cache Policy : Not Applicable Stripe Element Size : 64 KB Disk Cache Policy : Enabled
There are 4 on-board Broadcom Ethernet interfaces:
# lspci | grep Ethernet 01:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM57800 1/10 Gigabit Ethernet (rev 10) 01:00.1 Ethernet controller: Broadcom Corporation NetXtreme II BCM57800 1/10 Gigabit Ethernet (rev 10) 01:00.2 Ethernet controller: Broadcom Corporation NetXtreme II BCM57800 1/10 Gigabit Ethernet (rev 10) 01:00.3 Ethernet controller: Broadcom Corporation NetXtreme II BCM57800 1/10 Gigabit Ethernet (rev 10)The first 2 (em1 & em2) are 10GbE interfaces; and remaining 2 (em3 & em4) are GbE interfaces.
There is a Mellanox ConnectX-2 VPI single-port adapter:
# lspci | grep Mellanox 41:00.0 InfiniBand: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE] (rev b0)which can be configured either as QDR InfiniBand or 10 GbE. Since the interface is InfiniBand by default, there is no need to modify /etc/rdma/mlx4.conf, which can be left blank (see also Pleiades).
The IP addresses of the network interfaces are (see also Hyades Networks):
| Interface | IP Address | Network | Subnet | Netmask |
|---|---|---|---|---|
| em1 | 128.114.126.225 | Public 10GbE | 128.114.126.224 | 255.255.255.224 |
| em2 | 10.7.8.1 | Private 10GbE | 10.7.0.0 | 255.255.0.0 |
| em3 | 10.6.8.1 | Private GbE | 10.6.0.0 | 255.255.0.0 |
| em4 | 10.9.8.11 | IPMI | 10.9.0.0 | 255.255.0.0 |
| ib0 | 10.8.8.1 | IPoIB | 10.8.0.0 | 255.255.0.0 |
| ipmi0 | 10.9.8.1 | IPMI | 10.9.0.0 | 255.255.0.0 |