IT: OpenStack Servers - feralcoder/shared GitHub Wiki
Up Links
Public
feralcoder public Home feralcoder IT IT: My Private Cloud Living Room Data Center
Private
(private) Top Level Wiki (private) Feralcoder IT (private) OpenStack on OpenStack (private) Server Details (private) Server Management
Networking
(private) OpenStack Networks (private) feralcoder Network (private) Network: HP ProCurve 2910al
All HP All Day
Because Dell sucks and Supermicro is trash.
Proliant DL380p G8
For the resource nodes and undercloud. For now, the controllers live here, also. HP Proliant DL380p Gen8 (private) HP Proliant DL380p Gen8 Management HP Proliant DL380p Gen8 Firmware and Utilities
Proliant BL460c G6 Blades
For the secondary controller nodes. HP Proliant BL460c Gen6 (private) HP Proliant BL460c G6 Management HP Proliant BL460c Gen6 Firmware and Utilities
Proliant BL460c G8 Blades
For the primary controller nodes. HP Proliant BL460c Gen8 (private) HP Proliant BL460c G8 Management HP Proliant BL460c Gen8 Firmware and Utilities
BLC7000 Blade Enclosure
This is where the Blades live. HP BLC7000 Blade Enclosure HP BLC7000 Blade Enclosure Specs (private) HP BLC7000 Management HP BLC7000 Firmware and Utilities
Standardized Design
Compute Nodes
All compute servers use the same Flex-LOM module and NIC expansions, with identical cabinet cabling. All have same SAS controller in same slot on same riser: a perc H310 crossflashed into HBA mode.
(private) perc H310 (private) crossflashed into HBA mode.
Controller Nodes
Currently the same as compute nodes, but will be moving to Proliant BL460c Gen6 blades.
Server Platforms
Currently all Proliant DL380p Gen8's, and soon also Proliant BL460c Gen6 blades. I also tried:
Supermicro X9DRx-xx - This was a mistake, Supermicro is a total fraud. All other misrepresentations and failures aside, the physical build quality on their "server" boards is lower than on any home-grade crap I've ever used. For example, wafer-thin VGA ports snap and die when cats step on cables.
Undercloud Server Design
The first solution (HP Elitedesk 800 G3) was insufficient - I started getting corruption, most likely due to memory, but possibly disk.
A Proliant server solves all problems and more, at the cost of noise.
Storage
Only HP drives will be attached to the Proliants' i410/i420 controllers, in the interest of quietude. These will be kept to a minimum, in the interest of power.
EDIT - The Seagate 3TB ST3000NM0023 and 6TB STXXXXXXXX seems to be noise-neutral in the Proliants, WRT fans.
Each dl380p server has a SAS controller on the PCI-E riser, a perc h310 crossflashed into HBA mode.
Physical Infrastructure
Server Cabinets
Sealed with front fans for positive pressure. Filtered air for non-degrading cooling. Exhaust vented with barrel fan for improved cooling.
HP BLC7000 Blade Enclosure
This beast is the best bang-for-buck I've ever seen in IT. The networking power and ease of management alone justify the learning curve and noise management issues.