The Interfacial Phenomena Lab (IPHEL) operates in collaboration with the Institute for Cyber Science (ICS) at Penn State.
The ICS-operates over 23,000 Basic, Standard and High Memory cores to support Penn State research. The server architecture is dual 10- or 12-core Xeon E5-2680 processors for Basic and Standard memory configurations, and quad 10-core Xeon E7-4830 processors for High Memory. The Basic, Standard, and High-memory configurations are 128 GB, 256 GB, and 1 TB respectively.
The ICS provides a High Performance Storage Archive (ACI-HPSA) capability that supports users’ processing and research needs for data storage. The ACI-HPSA infrastructure includes GPFS, CNFS, and CIFS clustered files systems that interconnect across high speed Ethernet, Infiniband, and Fibre Channel network fabrics. The ACI-HPSA architecture consists of:
Active storage pools that provide access to Home, Work, Group, and Scratch directories;
Near-line storage pools that provide a long-term and archive storage repository for files that are not needed real-time to support ongoing research efforts;
Data management nodes that enable users to move data between the storage pools. Users have access to data that is stored in the Active storage pools and the Near-line storage pools without requiring administrative support.
The ICS network architecture utilizes high performance Ethernet fabric, Infiniband, and Fibre Channel network protocols to complement specific data processing and storage capabilities.
The high-performance Ethernet network is built on Brocade VCS Fabric Technology and supports connectivity for all processing nodes that are within the ICS-ACI system boundary. A VCS “fabric” provides a flexible interconnecting network between individual switches, creating a virtual cluster of physical switches. The current ICS-ACI VCS network fabric includes:
Brocade VDX 6940 switches that provide Layer 3 routing and are configured with 10/40/100 Gb network link capacity
Brocade VDX 8770-8 Enterprise-level switches that are configured with 10/40/100 Gb network link capacity
Brocade VDX 6740 switches that provide 10 Gb link capacity
Dell N2024 switches for host iDRAC (integrated DELL Remote Access Controller) remote management over Gb link capacity
ICS-ACI uses Mellanox® FDR (Fourteen Data Rate) Infiniband interconnects for high performance compute and storage network connectivity. FDR Infiniband provides high-bandwidth, low-latency connections for all Standard and High-memory-processor nodes and their associated storage systems.