Brocade Communications Systems FastIron SuperX Manual

53-1001723-02

18 March 10

Brocade FastIron X Series

Chassis

Hardware Installation Guide

Supporting Release 07.0.01b

Brocade, the B-wing symbol, BigIron, DCX, Fabric OS, FastIron, IronPoint, IronShield, IronView, IronWare, JetCore, NetIron,

SecureIron, ServerIron, StorageX, and TurboIron are registered trademarks, and DCFM, Extraordinary Networks, and SAN Health

are trademarks of Brocade Communications Systems, Inc., in the United States and/or in other countries. All other brands,

products, or service names are or may be trademarks or service marks of, and are used to identify, products or services of their

respective owners.

Notice: This document is for informational purposes only and does not set forth any warranty, expressed or implied, concerning

any equipment, equipment feature, or service offered or to be offered by Brocade. Brocade reserves the right to make changes to

this document at any time, without notice, and assumes no responsibility for its use. This informational document describes

features that may not be currently available. Contact a Brocade sales office for information on feature and product availability.

Export of technical data contained in this document may require an export license from the United States government.

The authors and Brocade Communications Systems, Inc. shall have no liability or responsibility to any person or entity with

respect to any loss, cost, liability, or damages arising from the information contained in this book or the computer programs that

accompany it.

The product described by this document may contain “open source” software covered by the GNU General Public License or other

open source license agreements. To find-out which open source software is included in Brocade products, view the licensing

terms applicable to the open source software, and obtain a copy of the programming source code, please visit

http://www.brocade.com/support/oscd.

Brocade Communications Systems, Incorporated

Document History

Corporate and Latin American Headquarters

Brocade Communications Systems, Inc.

1745 Technology Drive

San Jose, CA 95110

Tel: 1-408-333-8000

Fax: 1-408-333-8101

E-mail: inf[email protected]

Asia-Pacific Headquarters

Brocade Communications Systems China HK, Ltd.

No. 1 Guanghua Road

Chao Yang District

Units 2718 and 2818

Beijing 100020, China

Tel: +8610 6588 8888

Fax: +8610 6588 9999

E-mail: [email protected]

European Headquarters

Brocade Communications Switzerland Sàrl

Centre Swissair

Tour B - 4ème étage

29, Route de l'Aéroport

Case Postale 105

CH-1215 Genève 15

Switzerland

Tel: +41 22 799 5640

Fax: +41 22 799 5641

E-mail: emea-info@brocade.com

Asia-Pacific Headquarters

Brocade Communications Systems Co., Ltd. (Shenzhen WFOE)

Citic Plaza

No. 233 Tian He Road North

Unit 1308 – 13th Floor

Guangzhou, China

Tel: +8620 3891 2000

Fax: +8620 3891 2111

E-mail: [email protected]

Title Publication number Summary of changes Date

Brocade FastIron X Series Chassis

Hardware Installation Guide supporting

release 07.0.01b

53-1001723-02 Updated release version Mar 2010

Brocade FastIron X Series Chassis

Hardware Installation Guide supporting

release 07.0.01a

53-1001723-01 New document Feb 2010

Brocade FastIron X Series Chassis Hardware Installation Guide iii

53-1001723-02

Contents

About This Document

Audience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix

Supported hardware and software . . . . . . . . . . . . . . . . . . . . . . . . . . . ix

Document conventions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix

Text formatting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . x

Command syntax conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . x

Notes, cautions, and danger notices . . . . . . . . . . . . . . . . . . . . . . x

Notice to the reader . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi

Related publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi

Getting technical help or reporting errors . . . . . . . . . . . . . . . . . . . . . . xi

Web access . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii

E-mail access . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii

Telephone access . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii

Chapter 1 Product Overview

Product overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1

Hardware benefits . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1

POE port density. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

Supported configurations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

Software features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

POE applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

Support for IPv6 modules. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

IPv6 hardware support guidelines . . . . . . . . . . . . . . . . . . . . . . . . 3

Hardware features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4

FSX chassis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4

FSX 800 chassis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

FSX 1600 chassis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

FSX 1600-ANR chassis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12

Management modules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

Switch fabric modules (FSX 800 and FSX 1600 only) . . . . . . . 22

Interface modules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23

Network interfaces. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30

Power supplies . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31

Cooling system . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .38

Built-in mounting brackets . . . . . . . . . . . . . . . . . . . . . . . . . . . . .39

Layer 3 routing protocol table sizes . . . . . . . . . . . . . . . . . . . . . . . . . . 39

iv Brocade FastIron X Series Chassis Hardware Installation Guide

53-1001723-02

Chapter 2 Installing the Chassis

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41

Summary of installation tasks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41

Unpacking a system . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .42

Installation precautions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .43

General precautions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .43

Lifting precautions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .44

Power precautions and warnings . . . . . . . . . . . . . . . . . . . . . . . .44

Preparing the installation site . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47

Cabling infrastructure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47

Installation location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47

Removing extra shipment screws (FSX and FSX 800 only) . . . . . . . 47

Installing a chassis in a rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .48

Installing mounting brackets on the FSX 1600 chassis . . . . . . 50

Removing the slot panels . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .50

Installing the management and interface modules . . . . . . . . . . . . . 51

Attaching a management station. . . . . . . . . . . . . . . . . . . . . . . . . . . .56

Attaching a PC or terminal to the console port or 10/100/1000

copper port. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57

Attaching a switch to an Ethernet port . . . . . . . . . . . . . . . . . . . . 57

Powering on the system . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .58

Connecting AC power to the chassis. . . . . . . . . . . . . . . . . . . . . .58

Connecting DC power to the chassis . . . . . . . . . . . . . . . . . . . . .60

Verifying proper operation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .63

Observing the LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .64

Displaying the module status . . . . . . . . . . . . . . . . . . . . . . . . . . .66

Chapter 3 Connecting Network Devices and Checking Connectivity

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .69

Assigning permanent passwords . . . . . . . . . . . . . . . . . . . . . . . . . . . .69

Recovering from a lost password . . . . . . . . . . . . . . . . . . . . . . . .70

Configuring IP addresses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71

IPv4 devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71

IPv6 devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .73

Connecting network devices. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76

Cable specifications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76

Connecting to Ethernet or fast Ethernet hubs . . . . . . . . . . . . . . 76

Connecting to workstations, servers, or routers . . . . . . . . . . . .78

Connecting a network device to a fiber port on the Brocade device

Automatic MDI or MDIX detection. . . . . . . . . . . . . . . . . . . . . . . .80

Using a CX4 transceiver. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .80

Testing network connectivity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81

Observing LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81

Brocade FastIron X Series Chassis Hardware Installation Guide v

53-1001723-02

Troubleshooting network connections. . . . . . . . . . . . . . . . . . . . . . . .82

Support for digital optical monitoring. . . . . . . . . . . . . . . . . . . . .83

Chapter 4 Managing the Chassis and Modules

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .85

Displaying chassis status and temperature readings . . . . . . . . . . .85

Managing the cooling system. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .90

Configuring the cooling system. . . . . . . . . . . . . . . . . . . . . . . . . .90

Monitoring the cooling system . . . . . . . . . . . . . . . . . . . . . . . . . .96

Displaying the Syslog configuration and static and dynamic buffers98

Syslog messages for PCI (hardware) errors. . . . . . . . . . . . . . . . . . . .99

Managing the switch fabric modules (FSX 800 and FSX 1600 only)99

Displaying management module CPU usage . . . . . . . . . . . . . . . . .100

Removing MAC address entries . . . . . . . . . . . . . . . . . . . . . . . . . . . .101

Chapter 5 Using a Redundant Management Module

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .103

How Management module redundancy works . . . . . . . . . . . . . . . .103

Management module redundancy overview . . . . . . . . . . . . . .103

Management module switchover . . . . . . . . . . . . . . . . . . . . . . .104

Switchover implications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .105

Management module redundancy configuration . . . . . . . . . . . . . .106

Changing the default active chassis slot . . . . . . . . . . . . . . . . .106

Managing management module redundancy. . . . . . . . . . . . . . . . .107

File synchronization between the active and standby management

modules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .107

Manually switching over to the standby management module108

Rebooting the active and standby management modules . . .109

Hitless management support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . .109

What happens during a Hitless OS upgrade and Hitless switchover

110

How a Hitless OS upgrade and Hitless switchover impacts system

functions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .110

Syslog message for Hitless OS upgrade and Hitless switchover111

Layer 2 Hitless switchover. . . . . . . . . . . . . . . . . . . . . . . . . . . . .111

Monitoring management module redundancy . . . . . . . . . . . . . . . .114

Determining management module status . . . . . . . . . . . . . . . .114

Displaying temperature information. . . . . . . . . . . . . . . . . . . . .115

Displaying switchover information . . . . . . . . . . . . . . . . . . . . . .116

Chapter 6 Maintaining the Hardware

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .117

Hardware maintenance schedule . . . . . . . . . . . . . . . . . . . . . . . . . .117

Cleaning the fiber optic connectors. . . . . . . . . . . . . . . . . . . . . . . . .117

vi Brocade FastIron X Series Chassis Hardware Installation Guide

53-1001723-02

Replacing a management module. . . . . . . . . . . . . . . . . . . . . . . . . .118

Installation precautions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .118

Removing a management module . . . . . . . . . . . . . . . . . . . . . .118

Installing a new management module . . . . . . . . . . . . . . . . . . .119

Replacing a switch fabric module (FSX 800 and FSX 1600 only) .121

Removing a switch fabric module. . . . . . . . . . . . . . . . . . . . . . .122

Installing a new switch fabric module . . . . . . . . . . . . . . . . . . .122

Replacing an interface module . . . . . . . . . . . . . . . . . . . . . . . . . . . .124

Precautions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .125

Before removing an interface module . . . . . . . . . . . . . . . . . . .125

Removing an interface module. . . . . . . . . . . . . . . . . . . . . . . . .126

Installing a new interface module. . . . . . . . . . . . . . . . . . . . . . .126

Configuring a LAN or WAN Phy interface module . . . . . . . . . .129

Disabling and re-enabling an interface module. . . . . . . . . . . .130

Installing or replacing a POE daughter card . . . . . . . . . . . . . . . . . .131

Replacing a copper or fiber optic module . . . . . . . . . . . . . . . . . . . .134

Removing a copper or fiber optic module . . . . . . . . . . . . . . . .134

Installing a new copper or fiber optic module . . . . . . . . . . . . .135

Cabling a fiber optic module . . . . . . . . . . . . . . . . . . . . . . . . . . .135

Installing or replacing a power supply . . . . . . . . . . . . . . . . . . . . . . .136

Determining which power supply failed . . . . . . . . . . . . . . . . . .136

Removing an AC power supply . . . . . . . . . . . . . . . . . . . . . . . . .137

Removing a DC power supply . . . . . . . . . . . . . . . . . . . . . . . . . .139

Installing a new power supply . . . . . . . . . . . . . . . . . . . . . . . . . . 141

Connecting AC power to the chassis. . . . . . . . . . . . . . . . . . . . .145

Connecting DC power to the chassis . . . . . . . . . . . . . . . . . . . .147

Verifying proper operation. . . . . . . . . . . . . . . . . . . . . . . . . . . . .149

Displaying the status of the power supplies . . . . . . . . . . . . . .151

Replacing the FSX and FSX 800 fan tray. . . . . . . . . . . . . . . . . . . . .151

Replacing the FSX 1600 fan assemblies . . . . . . . . . . . . . . . . . . . .154

Replacing the FSX 1600-ANR fan assemblies . . . . . . . . . . . . . . . .155

Replacing the air filter in the FastIron SX-1600 . . . . . . . . . . . . . . .157

Upgrading the device to run Layer 3 software . . . . . . . . . . . . . . . .158

Chapter 7 Hardware Specifications

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .159

Chassis specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .159

Physical dimensions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .159

Environmental considerations . . . . . . . . . . . . . . . . . . . . . . . . .159

Cooling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .160

Regulatory compliance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .163

Maximum power consumption . . . . . . . . . . . . . . . . . . . . . . . . .164

Power source interruptions . . . . . . . . . . . . . . . . . . . . . . . . . . . .165

Pinouts and signalling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .165

Cable specifications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .168

Power cords . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .169

Brocade FastIron X Series Chassis Hardware Installation Guide vii

53-1001723-02

Power supply specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .170

Physical dimensions and weight. . . . . . . . . . . . . . . . . . . . . . . .170

Environmental considerations . . . . . . . . . . . . . . . . . . . . . . . . .170

Electrical specifications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 171

Input connector and plug . . . . . . . . . . . . . . . . . . . . . . . . . . . . .172

Regulatory compliance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 174

Safety warnings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 174

Appendix A Layer 3 Upgrade Procedures

Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .175

Upgrade kit contents. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .175

Installation overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .183

Detailed procedure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .184

Hardware installation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .184

Software installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .186

Appendix B Regulatory Statements

U.S.A. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .189

Industry Canada statement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .189

Europe and Australia. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .189

Japan VCCI statement. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .189

Japan Denan power cord statement . . . . . . . . . . . . . . . . . . . . . . . .190

Korea . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .190

Russia . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .190

Appendix C Caution and Danger Notices

Cautions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .193

Dangers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .200

viii Brocade FastIron X Series Chassis Hardware Installation Guide

53-1001723-02

Brocade FastIron X Series Chassis Hardware Installation Guide ix

53-1001723-02

About This Document

Audience

This document is designed for system administrators with a working knowledge of Layer 2 and

Layer 3 switching and routing.

If you are using a Brocade Layer 3 Switch, you should be familiar with the following protocols if

applicable to your network – IP, RIP, OSPF, BGP, IGMP, PIM, DVMRP, and VRRP.

Supported hardware and software

The following hardware platforms are supported by this release of this guide:

•FastIron SuperX® (FSX)

•FastIron SX 800® (FSX 800)

•FastIron SX 1600® (FSX 1600)

•FastIron SX 1600-ANR® (FSX 1600-ANR) Layer 2 or Layer 3 switches

NOTE

This document describes software release 07.0.01b only. Refer to earlier releases of this guide for

information about software releases prior to 07.0.01b.

Document conventions

This section describes text formatting conventions and important notice formats used in this

document.

xBrocade FastIron X Series Chassis Hardware Installation Guide

53-1001723-02

Text formatting

The following narrative-text formatting conventions are used in this guide.

For readability, command names in the narrative portions of this guide are presented in bold: for

example, show version.

Command syntax conventions

The following conventions for command syntax are used in this guide.

Notes, cautions, and danger notices

The following notices and statements are used in this manual. They are listed below in order of

increasing severity of potential hazards.

NOTE

A note provides a tip, guidance or advice, emphasizes important information, or provides a reference

to related information.

bold text Identifies command names

Identifies the names of user-manipulated GUI elements

Identifies keywords

Identifies text to enter at the GUI or CLI

italic text Provides emphasis

Identifies variables

Identifies document titles

code text Identifies CLI output

command and

parameters

Commands and parameters are printed in bold.

[ ] Optional parameter.

variable Variables are printed in italics enclosed in angled brackets < >.

... Repeat the previous element, for example “member[;member...]”

| Choose from one of the parameters.

Este manual sirve para los siguientes modelos

Tabla de contenidos

Otros manuales de Cambiar de Brocade Communications Systems