Mellanox Technologies InfiniScale MTS3600Q-1BNC Manual de usuario

Mellanox Technologies

InfiniScale®IV 36-Port QSFP

InfiniBand Switch User Manual

P/N: MTS3600Q-1BNC, MTS3600Q-2BNC,

MTS3600Q-1UNC, MTS3600Q-2UNC, MTS3600R-1BNC,

MTS3600R-2BNC, MTS3600R-1UNC, MTS3600R-2UNC

Rev 2.0.0

Rev 2.0.0 MellanoxTechnologies

Mellanox Technologies ConnectX, InfiniBlast, InfiniBridge, InfiniHost, InfiniRISC, InfiniScale, and

InfiniPCI are registered trademarks of Mellanox Technologies, Ltd. Virtual Protocol Interconnect is a trade-

mark of Mellanox Technologies, Ltd. All other trademarks are property of their respective owners.

InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual

Document Number: 2983

Mellanox Technologies, Inc.

350 Oakmead Parkway

Sunnyvale, CA 94085

U.S.A.

www.mellanox.com

Tel: (408) 970-3400

Fax: (408) 970-3403

Mellanox Technologies Ltd

PO Box 586 Hermon Building

Yokneam 20692

Israel

Tel: +972-4-909-7200

Fax: +972-4-959-3245

NOTE:

THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT (“PRODUCT(S)”) AND ITS RELATED

DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES “AS-IS” WITH ALL

FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TEST-

ING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS. THE CUS-

TOMER'S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY

MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCTO(S) AND/OR THE SYSTEM

USING IT. THEREFORE, MELLANOX TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE

OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST QUALITY. ANY

EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WAR-

RANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONIN-

FRINGEMENT ARE DISCLAIMED. IN NO EVENT SHALL MELLANOX BE LIABLE TO

CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT, INDIRECT, SPECIAL, EXEMPLARY, OR

CONSEQUENTIAL DAMAGES OF ANY KIND (INCLUDING, BUT NOT LIMITED TO, PAYMENT

FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROF-

ITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY,

WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTH-

ERWISE) ARISING IN ANY WAY FROM THE USE OF THE PRODUCT(S) AND RELATED DOCU-

MENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual

MellanoxTechnologies Rev 2.0.0

Table of Contents

Table of Contents 3

Revision History 4

About this Manual 5

Intended Audience 5

Related Documentation

Additional Documentation available from Mellanox:

Conventions

Throughout this manual, the name MTS3600 and the term switch are used to describe both the 36-port

40Gb/s InfiniBand Switch and the 36-port QSFP 20Gb/s InfiniBand Switch, unless explicitly indicated oth-

erwise.

Table 2 - Reference Documents

Switch Firmware and Firm-

ware Update Tools See

http://www.mellanox.com > Downloads > Firmware Tools.

Note that the Switch System described in this manual is based on Mellanox Technologies’ InfiniScale®

IV switch device.

Mellanox OFED Stack for

Linux User’s Manual See

http://www.mellanox.com > Downloads > InfiniBand SW/Drivers,

Click “Mellanox OpenFabrics Enterprise Distribution for Linux (MLNX_OFED)”

Select the Linux User’s Manual

The embedded OS and tools on the CPU in the management module is a subset of the Mellanox OFED

stack.

FabricIT Enterprise Fabric

Management Software CLI

User’s Manual

Talk to your Mellanox representative for information regarding licensing and implementation of the

FabricIT Enterprise Fabric Management Software System.

Mellanox Firmware Tools

(MFT)

User’s Manual

Document # 2329

The MFT (Mellanox Firmware Tools) package is a set of firmware tools. The manual supplied with this

package provides an overview of the firmware its installation and replacement. The MFT can be down-

loaded with its documentation at:

http://www.mellanox.com > Downloads > Firmware Tools.

Rev 2.0.0 MellanoxTechnologies

Switch Products Covered in this User’s Manual

Mellanox Part Numbering Legend

Table 3 - Switch Products Covered by this User Manual

Product Number Description

MTS3600Q-1BNC 36-port Managed QSFP 40Gb/s InfiniBand switch with one power supply

MTS3600R-1BNC 36-port Managed QSFP 20Gb/s InfiniBand switch with one power supply

MTS3600Q-1UNC 36-port Unmanaged QSFP 40Gb/s InfiniBand switch with one power supply

MTS3600Q-2UNC 36-port Unmanaged QSFP 40Gb/s InfiniBand switch with two power supplies

MTS3600R-1UNC 36-port Unmanaged QSFP 20Gb/s InfiniBand switch with one power supply

MTS3600R-2UNC 36-port Unmanaged QSFP 20Gb/s InfiniBand switch with two power supplies

Table 4 - Part Numbering Legend

Place Field Decoder

MT Mellanox Technologies

SSystem Type S = Switch

MM Model 36 = InfiniScale IV

FF Form factor 00 = Rack mounted switch, 10 = Chassis

CInfiniBand Port Config. G = CX4 DDR, J = CX4 QDR, Q = QSFP QDR, R = QSFP DDR,

-Separator

P# Power Supplies 0 = 0, 1 = 1, 2 = 2

MManagement U = Unmanaged, A = Managed (Celeron), B = Managed (Freescale)

YModule Config. N = IB modules

RRoHS C = RoHS w/ Exemption, R = RoHS Lead-Free

InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual

MellanoxTechnologies Rev 2.0.0

1 Overview

Mellanox MTS3600 switch systems provide the highest performing fabric solution by delivering high band-

width and low latency to Enterprise Data Centers, High-Performance Computing and Embedded environ-

ments. Networks built with MTS3600 systems can carry converged traffic with the combination of assured

bandwidth and granular quality of service. Built with Mellanox’s 4th generation InfiniScale® IV InfiniBand

switch device, MTS3600 systems provide up to 40Gb/s full bidirectional bandwidth per port. With 36 ports,

these systems are among the densest switching systems available. These stand-alone switches are an ideal

choice for top of-rack leaf connectivity or for building small to medium size clusters.

The switch comes pre-installed with all necessary firmware and is configured for standard operation within

an InfiniBand fabric. This switch requires an InfiniBand compliant Subnet Manager running from one of the

hosts. All that is required for normal operation is to follow the usual precautions for installation and to con-

nect the switch to the HCAs. Once connected, the Subnet Management software automatically configures

and begins utilizing the switch.

It is recommended that Mellanox OpenFabrics software package be installed on all nodes connected to the

MTS3600. The software package provides a subnet manager and network management tools as well as con-

nectivity software for servers and storage, and is available on the Mellanox web site. See Chapter 3 for more

information.

Basic installation, hot-swapping components and hardware maintenance is covered in “Installation and

Basic Operation” on page 8.

1.1 Serial Number and Product Version Information

The serial number and product version information are found on the label seen in the figure below.

Figure 1: Generic Product label

Also on this label is the GUID identifier for the switch. There is also a label with the MAC for the manage-

ment module?

Figure 2: Management Module Label

Rev 2.0.0 MellanoxTechnologies

2 Installation and Basic Operation

2.1 Switch Platform Hardware Overview

Figure 3 shows the power side panel and connector side panel views of the QSFP switch. The figure shows

port configurations for the switch systems, including the dual hot-swap power supplies, and hot-swap fan

module, I2C connector, RJ45 connector, USB connectors, VGA port connector, and various status LEDs.

Figure 3: QSFP Switch System Front and Back Panels

All InfiniBand connectivity is via the connector side panel. All connectors can support active cables.

2.1.1 Status LEDs

2.1.1.1 System Status Indicators

The System Status Indicators are located just to the left of the primary power supply unit, and labeled “Sys.”.

The system status indicators should be as follows:

When the switch is plugged in, within a few seconds the STATUS LED should light up green.

The PSU 1 LED should light up green.

The PSU 2 LED should light up green only if a second PSU is installed in the switch for redundancy

and Hot-Swap ability. If only one PSU is installed in the switch, the PSU 2 LED will be off.

The FAN LED should light up green.

If the STATUS LED shows red unplug the switch and call your Mellanox representative for assistance.

If the FAN LED shows yellow, trouble shoot the fan module.

Note: Do not run the switch for more than 2 minutes should the FAN LED show yellow.

If the PSU LEDs are not green, this indicates a problem with the power supplies. Do not run the switch if the

PSU LEDs are not green.

Front panel

Rear panel

InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual

MellanoxTechnologies Rev 2.0.0

Figure 4: Power and System LEDs

Table 5 - System Status LED/ Configurations

2.1.1.2 Power Supply Status Indicators

The MTS3600 36 Port Switch is available with one or two factory installed Power Supply Units. For

switches with only one unit installed, a second Power Supply Unit can be added to increase security, hot-

swap ability and to add redundancy.

Figure 5: MTS3600 QSFP Front Panel

LED Configuration Status

OK – The system is up and running.

Error –A fault in the system.

Off – The system has no power.

DC output from

the PSU is OK

Latch release mechanism Handle

There is a fault

in the PSU

Input AC voltage

is good

PSU Status

Indicators

Switch Fan

Status

Indicators

System

Status

Indicators

Primary Power

Supply Unit

Place for secondary

Power Supply Unit Fan Unit

Rev 2.0.0 MellanoxTechnologies

The primary power supply unit (PSU1) is located on the right side of the front panel, with PSU2 on the left

side. Status indicators are located just to the left of where the primary power supply unit is located. Each

PSU also has three status LEDs on the right side of the PSU, that indicate the internal status of the unit.

~AC– This LED when lit indicates input voltage between 90 and 264 Volts.

–This LED when lit indicates a fault in the power supply.

OK – This LED when lit indicates that the output from the power supply is +12VDC.

The PSU status indicators are located just to the left of the primary power supply unit, and labeled “PSU1”

and “PSU2”. The following status conditions are possible:

2.1.1.3 Fan Status Indicators

The indicator labeled “Fans” is located just to the left of the primary power supply unit, next to PSU 1. The

following fan status conditions are possible:

Table 6 - Fan Status LED Configurations

2.1.2 I2C Connector

The MTS3600 supports an I2C compatible interface on the front panel.This interface is used to program

firmware into the Flash Memory. Firmware can also be programmed in-band over the InfiniBand network.

See Section 3 for more details.

2.1.3 Internal Management

Internal management refers to a switch that has an internal PPC management board. Switches without this

management board can be managed using an external management system. The following interfaces allow

access to the internal management module. These interfaces have no function in externally managed sys-

tems.

LED Configuration Status

OK – All fans are operating.

Error – One or more fans is not operating. Repair

or replace the fan unit.

Off – The fan unit is not receiving any power.

Check that the fan unit is properly and com-

pletely inserted.

All fans must be operating while the power supply is plugged in. Power must be

removed within one minute of the fans failing, to prevent damage to the switch.

Otros manuales para InfiniScale MTS3600Q-1BNC

Este manual sirve para los siguientes modelos

Tabla de contenidos

Otros manuales de Cambiar de Mellanox Technologies

Mellanox Technologies

Mellanox Technologies TX6000 Instrucciones de uso

Mellanox Technologies

Mellanox Technologies Spectrum SN2700 Instrucciones de uso

Mellanox Technologies

Mellanox Technologies SX1710 Manual de usuario

Mellanox Technologies

Mellanox Technologies Grid Director 4036 Manual de usuario

Mellanox Technologies

Mellanox Technologies MSX6512-4R Manual

Mellanox Technologies

Mellanox Technologies Mellanox SX1018 Manual de funcionamiento

Mellanox Technologies

Mellanox Technologies SB7700 Manual de usuario

Mellanox Technologies

Mellanox Technologies 1G Switch Air Duct Rail Kit Manual de usuario

Mellanox Technologies

Mellanox Technologies SwitchX-2 MSX6018F-1SFS Instrucciones de uso

Mellanox Technologies

Mellanox Technologies MSX6536-10R Manual

Mellanox Technologies

Mellanox Technologies InfiniScale III Manual de usuario

Mellanox Technologies

Mellanox Technologies SB7700 Manual de usuario

Mellanox Technologies

Mellanox Technologies Switch-IB Manual de usuario

Mellanox Technologies

Mellanox Technologies MSX6506-3R Manual

Mellanox Technologies

Mellanox Technologies InfiniScale MTS3600Q-1UNC Manual de usuario

Mellanox Technologies

Mellanox Technologies MSX6512-NR Manual

Mellanox Technologies

Mellanox Technologies Grid Director 4036E Manual de usuario

Mellanox Technologies

Mellanox Technologies SwitchX-2 MSX1012B-1BFS Manual de usuario

Mellanox Technologies

Mellanox Technologies SX6015 Manual de usuario

Mellanox Technologies

Mellanox Technologies Vantage 8500 Manual de usuario

Mellanox Technologies

Mellanox Technologies SX67X0 Instrucciones de uso

Mellanox Technologies

Mellanox Technologies InfiniScale MTS3600Q-1BNC Manual de usuario

Mellanox Technologies

Mellanox Technologies MTS3600 Manual de usuario

Mellanox Technologies

Mellanox Technologies M2401G Manual de usuario

Manuales populares de Cambiar de otras marcas

URC

URC Total Control MFS-8 Manual de usuario

Azbil

Azbil HPQ-D11 Manual de usuario

Sony

Sony DFS-900M Manual de usuario

SICK

SICK i17S Manual de usuario

F&F

F&F SZR-277 Manual de usuario

Shure

Shure UAMS/BK Manual de usuario

Dräger

Dräger X-zone Switch Off Manual de usuario

Asco

Asco Joucomatic 349 Series Manual de usuario

BT Mini Hub Manual de usuario

D-Link

D-Link DES-1226G Manual de usuario

Johnson Controls

Johnson Controls FS80-C Manual de usuario

Alcatel-Lucent

Alcatel-Lucent 7450 ESS-12 Manual de usuario

MicroNet

MicroNet SP1200A Manual de usuario

Ruijie

Ruijie RG-PF2920 Series Manual de instalación y funcionamiento

Altinex

Altinex DA1914SX Manual de usuario

MiLAN

MiLAN MIL-SM2401M Manual de usuario

RJM

RJM MASTERMIND PBC/6X Manual de usuario

Atlas

Atlas MMK-KVM8 Manual de usuario