Terascala Lustre Storage - shawfdong/hyades GitHub Wiki

Table of Contents

Hardware Components

Service Tag Item Description
 
67TZPW1 PowerEdge R210II Management Server
 
5FJRTS1 PowerConnect 5448 GbE Switch
 
5BMZPW1 PowerEdge R710 Metadata Server
5BN0QW1 PowerEdge R710 Metadata Server
B0DZPW1 PowerVault MD3220 Metadata Storage Target
 
5BNYPW1 PowerEdge R710 Object Storage Server
5BPYPW1 PowerEdge R710 Object Storage Server
B0C1QW1 PowerVault MD3220 Object Storage
B0BZPW1 PowerVault MD3220 Object Storage
9ZHZPW1 PowerVault MD1200 Object Storage Expansion
9ZH0QW1 PowerVault MD1200 Object Storage Expansion
 
5BP0QW1 PowerEdge R710 Object Storage Server
5BNZPW1 PowerEdge R710 Object Storage Server
B0CYPW1 PowerVault MD3220 Object Storage
87WBRW1 PowerVault MD3220 Object Storage
9ZH1QW1 PowerVault MD1200 Object Storage Expansion
9ZHYPW1 PowerVault MD1200 Object Storage Expansion

Networks

Network Subnet Netmask
Hyades Private GbE 10.6.0.0 255.255.0.0
Hyades Private 10GbE 10.7.0.0 255.255.0.0
Hyades IPoIB 10.8.0.0 255.255.0.0
Management #1 192.168.3.0 255.255.255.0
Management #2 192.168.4.0 255.255.255.0
Heartbeat 192.168.199.0 255.255.255.0

IP Addresses

node Description Hyades Private 10GbE Hyades IPoIB Management #1 Management #2 Heartbeat IPMI
tms Management Server (PE R210II)     192.168.3.1 192.168.4.1   10.9.8.2
mds-01 Meta Data Server #1 (PE R710) 10.7.8.142 10.8.8.142 192.168.3.142 192.168.4.142 192.168.199.1 192.168.3.11
mds-02 Meta Data Server #2 (PE R710) 10.7.8.143 10.8.8.143 192.168.3.143 192.168.4.143 192.168.199.2 192.168.4.12
mdt Meta Data Target (MD3220)     192.168.3.201 192.168.4.201    
oss-01 Object Storage Server #1 (PE R710) 10.7.8.144 10.8.8.144 192.168.3.144 192.168.4.144 192.168.199.3 192.168.3.13
oss-02 Object Storage Server #2 (PE R710) 10.7.8.145 10.8.8.145 192.168.3.145 192.168.4.145 192.168.199.4 192.168.4.14
osts-01-a Object Storage Target #1a (MD3220)     192.168.3.202 192.168.4.202    
osts-01-b Object Storage Target #1b (MD3220)     192.168.3.203 192.168.4.203    
oss-03 Object Storage Server #3 (PE R710) 10.7.8.146 10.8.8.146 192.168.3.146 192.168.4.146 192.168.199.5 192.168.3.15
oss-04 Object Storage Server #4 (PE R710) 10.7.8.147 10.8.8.147 192.168.3.147 192.168.4.147 192.168.199.6 192.168.4.16
osts-02-a Object Storage Target #2a (MD3220)     192.168.3.204 192.168.4.204    
osts-02-b Object Storage Target #2b (MD3220)     192.168.3.205 192.168.4.205    

Additionally, tms, the Terascala Management Server, has the IP address 10.6.8.2 in the Hyades Private GbE subnet.

Diagrams of Network & SAS Interconnects

1. Management Network

2. MDS SAS Interconnects

3. OSS SAS Interconnects

4. MD3200 to MD1200 SAS Interconnects

Lustre Versions

Initially, the Terascala Lustre Storage ran Lustre server 1.8.8 on top of Linux kernel 2.6.18-308.4.1.el5_lustre.1.8.8_1.3.4. In May 2014, the Terascala Lustre Storage was upgrade to run Lustre server 2.1.5 on top of Linux kernel 2.6.32-279.19.1.el6_lustre.2.1.5_1.0.7.

Further Readings

⚠️ **GitHub.com Fallback** ⚠️