Dell POWEREDGE M1000E: Configuring the I/O Modules

book.book Page 48 Wednesday, March 9, 2011 3:11 PM

Fabric A

Fabric A is a redundant Gb Ethernet fabric, supporting I/O module slots A1

and A2. The integrated Ethernet controllers in each blade dictate Fabric A as

an Ethernet-only fabric.

NOTE: Fabric A supports KR (10 Gbps standard) if the midplane version in the

enclosure is 1.1 or later. To identify the midplane version, see "Identifying Midplane

Version" on page 49.

NOTE: Modules designed specifically for Fabric B or Fabric C cannot be installed in

slots A1 or A2, as indicated by the color-coded label on the faceplate of each module.

Fabric B

Fabric B is a 1 to 40 Gb/sec redundant fabric, supporting I/O module slots B1

and B2. Fabric B currently supports 1 Gb or 10 Gb Ethernet, DDR/QDR

Infiniband, and 4 Gbps or 8 Gbps Fibre Channel modules. Additional fabric

types may be supported in the future.

NOTE: Fabric B supports up to 16 Gbps Fibre Channel, Infiniband FDR (14 Gbps

standard), and KR (10 Gbps standard) if the midplane version in the enclosure is 1.1

or later. To identify the midplane version, see "Identifying Midplane Version" on

page 49.

To communicate with an I/O module in the Fabric B slots, a blade must have

a matching mezzanine card installed in a Fabric B mezzanine card location.

Modules designed for Fabric A may also be installed in the Fabric B slots.

Fabric C

Fabric C is a 1 to 40 Gb/sec redundant fabric, supporting I/O module slots C1

and C2. Fabric C currently supports 1 Gb or 10 Gb Ethernet, DDR/QDR

Infiniband, and 4 Gbps or 8 Gbps Fibre Channel modules. Additional fabric

types may be supported in the future.

NOTE: Fabric C supports up to 16 Gbps Fibre Channel, Infiniband FDR (14 Gbps

standard), and KR (10 Gbps standard) if the midplane version in the enclosure is 1.1

or later. To identify the midplane version, see "Identifying Midplane Version" on

page 49.

To communicate with an I/O module in the Fabric C slots, a blade must have

a matching mezzanine card installed in a Fabric C mezzanine card location.

Modules designed for Fabric A may also be installed in the Fabric C slots.

48 Configuring the I/O Modules

book.book Page 49 Wednesday, March 9, 2011 3:11 PM

For more information about I/O module installation guidelines, see your

Hardware Owner’s Manual.

Identifying Midplane Version

The version of the midplane installed in the enclosure is displayed in the

Midplane Revision field under the Summary tab of the CMC web-based

interface.

You can also view the icons at the back of the enclosure to identify the version

of the midplane. See Table 3-1.

Table 3-1. Identifying Midplane Version

Marking Description Midplane Version

I/O module slots A1, A2 1.1

I/O module slots B1, B2, C1,

1.1

and C2

I/O module slots A1, A2 1.0

I/O module slots B1, B2, C1,

1.0

and C2

See Figure 3-2 and Figure 3-3 to locate the midplane identification labels on

the enclosure.

Configuring the I/O Modules 49

Figure 3-2. Identifying Midplane Version 1.1

1 midplane identification labels (2)

50 Configuring the I/O Modules

book.book Page 50 Wednesday, March 9, 2011 3:11 PM

Figure 3-3. Identifying Midplane Version 1.0

1 midplane identification labels (2)

Configuring the I/O Modules 51

book.book Page 51 Wednesday, March 9, 2011 3:11 PM

book.book Page 52 Wednesday, March 9, 2011 3:11 PM

Before You Begin

Network Information

You can configure your I/O switch modules using:

• The CMC (see "Configuring a Switch Module Network Ethernet Port

Using the Web-Based Interface" on page 52).

NOTE: The default IP address for the CMC is 192.168.0.120.

• The CMC CLI using serial console redirection.

• Direct access to the I/O module’s serial port (if supported).

• The I/O module’s default IP address (if supported).

Switch Modules

Configuring a Switch Module Network Ethernet Port Using the

Web-Based Interface

You can use the CMC Web-based interface to configure an I/O module’s

Ethernet port.

NOTE: Use this procedure to configure the switch’s out-of-band Ethernet port. The

switch’s in-band management IP address is configured through the switch’s

external ports. These two IP addresses must be different, and on different

networks.

NOTE: To change settings on the I/O module configuration page, you must have

Fabric Administrator privileges for the particular Fabric in which the module is

installed.

NOTE: The network IP address set on the I/O module by the CMC is not saved to a

configuration file. To save the IP address configuration permanently, use the

connect switch-n RACADM command, or use a direct interface to the I/O

module GUI.

NOTE: Do not attempt to configure I/O module network settings for Ethernet pass-

through or Infiniband switches.

1

Log in to the CMC’s Web-based interface. See "Logging in to the CMC

Using the Web-Based Interface" on page 31.

2

Select

I/O Modules

in the

Chassis

menu in the system tree.

52 Configuring the I/O Modules

book.book Page 53 Wednesday, March 9, 2011 3:11 PM

3

Select the

Setup

tab. The

Configuring

I/O Modules Network Settings

page is displayed.

4

Configure the switch for integration into your network.

– Select

DHCP Mode Enabled

if your network uses a DHCP server to

assign IP addresses.

– If your network uses static IP addressing, enter an IP address, subnet

mask and gateway.

5

When you have finished, click

Apply

.

6

Click the

Deploy

sub-tab.

After all I/O modules have been configured and connected, the enclosure’s

blades can be inserted and booted with full network communication.

Dell PowerConnect-KR 8024-k Switch

The PowerConnect M8024-k switch provides 16 internal 10 GbE ports, four

external 10 GbE SFP+ ports, and one 10 GbE expansion slot for 10 GbE

external uplinks. The expansion slot on the front panel can support:

• A 10 Gb Ethernet module with four optical SFP+ connectors

• A 10 Gb Ethernet module with three copper CX4 uplinks

• A 10 Gb Ethernet module with two copper 10GBASE-T uplinks

This module is hot-swappable and may be installed in Fabric A, B, or C.

Configuring the I/O Modules 53

Figure 3-4. Dell PowerConnect-KR 8024-k Switch

1 SFP+ ports (4) 2 console management connector

3 status/identification indicator 4 power indicator

5 expansion slot

54 Configuring the I/O Modules

book.book Page 54 Wednesday, March 9, 2011 3:11 PM

book.book Page 55 Wednesday, March 9, 2011 3:11 PM

Dell M8428-k 10 Gb Converged Network Switch

The Dell M8428-k 10 Gb Converged Network switch module supports FCoE

protocols and allows Fibre Channel traffic to travel over 10 Gbps Enhanced

Ethernet (DCB) networks. This module consists of:

• Four 8 Gbps external autosensing Fibre Channel ports.

• Eight 10 Gb Enhanced Ethernet (DCB) optical SFP+ port connectors.

• Sixteen internal 10 Gb Enhanced Ethernet (DCB/FCoE) ports that link to

the blades in the enclosure.

• One serial port with an RJ-45 connector.

NOTE: This switch module includes Short Wave Small Form Factor Pluggable (SFP)

optical transceivers in the Fibre Channel ports. To ensure proper Fibre Channel

functionality, use only SFPs provided with this module.

This module can be installed in Fabric A, B, or C.

Configuring the I/O Modules 55

Figure 3-5. Dell M8428-k 10 Gb Converged Network Switch

1 LED status indicators (12) 2 serial port (RJ-45 connector)

3 module status indicator 4 status indicator

5 power indicator 6 8 Gb Fibre Channel ports

(ports 25–27 and port 0)

7 10 GbEE ports (ports 17–24)

56 Configuring the I/O Modules

book.book Page 56 Wednesday, March 9, 2011 3:11 PM

Mellanox M2401G DDR Infiniband Switch I/O Module

The Mellanox M2401G Infiniband switch I/O module includes 24 4x DDR

Infiniband ports. Eight ports are external uplink ports, while 16 internal ports

provide connectivity to the blades in the enclosure.

Figure 3-6. Mellanox M2401G Infiniband Switch Module

1 Infiniband ports (8) 2 port link status indicators (8)

3 port activity indicators (8) 4 module diagnostic power indicator

5 module status indicator

Configuring the I/O Modules 57

book.book Page 57 Wednesday, March 9, 2011 3:11 PM

Figure 3-10. PowerConnect M6220 Ethernet Switch Module Features

1 optional module (2) (dual 10 Gb

2 standard 10/100/1000 Mb Ethernet

Ethernet uplink module shown)

connectors (4)

3 serial connector (USB type-A form

4 power indicator

factor)

5 status/identification indicator

64 Configuring the I/O Modules

book.book Page 64 Wednesday, March 9, 2011 3:11 PM

book.book Page 65 Wednesday, March 9, 2011 3:11 PM

PowerConnect M6348 1 Gb Ethernet Switch I/O Module

The PowerConnect M6348 is a hot-swappable 48-port 1 Gb Ethernet switch.

While 16 ports are external uplink ports, the remaining 32 internal ports

provide connectivity to the blades within the enclosure with a maximum

bandwidth of 1 Gbps each. The PowerConnect M6348 switch also supports:

• Two integrated 10 Gb Ethernet SFP+ connectors

• Two integrated CX4 connectors for stacking or 10 Gb uplinks

• One console management connector

It is recommended that you use the PowerConnect M6348 switch with

quad-port mezzanine cards for maximum functionality. The quad-port

mezzanine cards and the PowerConnect M6348 Ethernet switch enable an

increased bandwidth (two 1 Gbps lanes), higher port density, and server

module consolidation.

Configuring the I/O Modules 65

Figure 3-11. PowerConnect M6348 Switch Module

1 standard 10/100/1000 Mb

2 SFP+ connectors (2)

Ethernet connectors (16)

3 CX4 stacking connectors (2) 4 console management connector

5 power indicator 6 status/identification indicator

66 Configuring the I/O Modules

book.book Page 66 Wednesday, March 9, 2011 3:11 PM

book.book Page 67 Wednesday, March 9, 2011 3:11 PM

PowerConnect M8024 10 Gb Ethernet Switch I/O Module

The PowerConnect M8024 switch module incorporates two optional bays

that support the following modules:

• A 10 Gb Ethernet module with four optical SFP+ connectors

• A 10 Gb Ethernet module with three copper CX4 uplinks

• A 10 Gb Ethernet module with two copper 10GBASE-T uplinks

The modules can be used in any combination and are sold separately.

You can initially configure the switch using either of two methods:

• Connect an external management system to the switch using an optional

USB type-A form factor serial cable, and configure the switch using a

terminal application.

• Use the iKVM CMC console (“17th blade”) and the

connect switch-

n

CMC CLI command. For more information, see the CMC

User’s Guide

.

Once an IP address is assigned to the management VLAN or interface and the

switch is connected to a management network, both Telnet and http are

available through the network.

Configuring the I/O Modules 67

Figure 3-12. PowerConnect M8024 Switch Module

1 optional module with four SFP+

2 optional module with three CX4

ports

ports

3 serial connector for optional USB

4 power indicator

type-A form-factor cable

5 status/identification indicator

68 Configuring the I/O Modules

book.book Page 68 Wednesday, March 9, 2011 3:11 PM

book.book Page 69 Wednesday, March 9, 2011 3:11 PM

Brocade M4424 SAN I/O Module

The Brocade M4424 SAN I/O module includes eight external autosensing

Fibre Channel ports (four ports are enabled in the standard configuration and

four additional ports may be enabled as an optional upgrade), 16 internal

ports, and one serial port with an RJ-45 connector. The external Fibre

Channel ports operate at 1 Gb/sec, 2 Gb/sec, or 4 Gb/sec. The Fibre Channel

switch module is hot-swappable, and may be installed in Fabric B or Fabric C.

NOTE: The Fibre Channel switch module includes Short Wave Small Form Factor

Pluggable (SFP) optical transceivers. To ensure proper functionality, use only SFPs

provided with this module.

Configuring the I/O Modules 69

Figure 3-13. Brocade M4424 SAN I/O Module

1 Fibre Channel port (8) 2 Fibre Channel port status

indicator (8)

3 Fibre Channel port speed

4 serial port (RJ-45 connector)

indicator (8)

5 module status indicator 6 power indicator

7 status/identification indicator

70 Configuring the I/O Modules

book.book Page 70 Wednesday, March 9, 2011 3:11 PM

book.book Page 71 Wednesday, March 9, 2011 3:11 PM

Brocade M5424 FC8 I/O Module

The Brocade M5424 I/O module includes eight external autosensing Fibre

Channel ports (four ports are enabled in the standard configuration and four

additional ports may be enabled as an optional upgrade), 16 internal ports,

and one serial port with an RJ-45 connector. The external Fibre Channel ports

operate at 8 Gb/sec, 4 Gb/sec, or 2 Gb/sec.

NOTE: CMC firmware version 1.3 is required to support FC8 mezzanine cards and

I/O modules.

NOTE: This Fibre Channel switch module includes Short Wave Small Form Factor

Pluggable (SFP) optical transceivers. To ensure proper functionality, use only SFPs

provided with this module.

Configuring the I/O Modules 71

Figure 3-14. Brocade M5424 FC8 I/O Module

1 Fibre Channel port (8) 2 Fibre Channel port status

indicator (8)

3 Fibre Channel port speed

4 serial port (RJ-45 connector)

indicator (8)

5 module status indicator 6 power indicator

7 status/identification indicator

72 Configuring the I/O Modules

book.book Page 72 Wednesday, March 9, 2011 3:11 PM

book.book Page 73 Wednesday, March 9, 2011 3:11 PM

Dell 8/4 Gbps FC SAN Module

The Dell 8/4 Gbps FC SAN module (see Figure 3-15) includes 24 total

autosensing Fibre Channel ports (12 ports are enabled in the standard

configuration and 12 additional ports may be enabled as an optional upgrade)

and one serial port with an RJ-45 connector. The internal Fibre Channel ports

operate at 8 Gb/sec or 4 Gb/sec. The external Fibre Channel ports operate at

8 Gb/sec, 4 Gb/sec, or 2 Gb/sec.

NOTE: CMC firmware version 1.3 is required to support FC8 mezzanine cards and

I/O modules.

NOTE: This Fibre Channel switch module includes Short Wave Small Form Factor

Pluggable (SFP) optical transceivers. To ensure proper functionality, use only SFPs

provided with this module.

Configuring the I/O Modules 73

Figure 3-18. 10 Gb Ethernet Pass-Through Module II

1 SFP+ cages (16) 2 green/amber indicators (two per

port)

3 status/identification indicator 4 power indicator

80 Configuring the I/O Modules

book.book Page 80 Wednesday, March 9, 2011 3:11 PM

book.book Page 81 Wednesday, March 9, 2011 3:11 PM

10 Gb Ethernet Pass-Through I/O Module

The 10 Gb Ethernet pass-through module supports 10 Gb connections

and provides a direct connection between the optional internal Ethernet

mezzanine card in the blade and an external Ethernet device. The Ethernet

pass-through modules are hot-swappable and may be installed in Fabric B or

Fabric C.

The 10 Gb Ethernet pass-through I/O module enables you to use optical SFP,

SFP+, and direct-attached copper (DCA) SFP+ modules. To operate the I/O

module and the SFP+ modules at 10 Gbps,

you must use either optical SFP+

short reach (SR), long reach multimode (LRM), or DCA SFP+ modules.

This

module does not support 1G mezzanine or network daughter cards in blades.

Configuring the I/O Modules 81

Figure 3-19. 10 Gb Ethernet Pass-Through I/O Module

1 SFP+ cages (16) 2 green/amber indicators (two per

port)

3 power indicator 4 status/identification indicator

82 Configuring the I/O Modules

book.book Page 82 Wednesday, March 9, 2011 3:11 PM

book.book Page 83 Wednesday, March 9, 2011 3:11 PM

10/100/1000 Mb Ethernet Pass-Through I/O Module

The Ethernet pass-through module supports 10/100/1000 Mb connections

and provides a direct connection between the optional internal Ethernet

mezzanine card in the blade and an external Ethernet device. The Ethernet

pass-through modules are hot-swappable and may be installed in any of the

three Fabrics.

Configuring the I/O Modules 83

Figure 3-20. Ethernet Pass-Through Module

1 link indicator (16) 2 RJ45 Ethernet connector (16)

3 power indicator 4 status/identification indicator

5 activity indicator (16)

NOTE: Connectors on the Ethernet pass-through module correspond directly to the

blade number. For example, blade 5 is connected to port 5 on the Ethernet pass-

through module. Integrated network adapter 1 maps to I/O slot A1. Integrated

network adapter 2 maps to I/O slot A2.

84 Configuring the I/O Modules

book.book Page 84 Wednesday, March 9, 2011 3:11 PM

book.book Page 85 Wednesday, March 9, 2011 3:11 PM

4G Fibre Channel Pass-Through I/O Module

The 4G Fibre Channel pass-through module provides a bypass connection

between a Fibre Channel mezzanine card in the blade and optical transceivers.

The bypass connection enables a direct connection to a Fibre Channel switch

or a storage array. The 16 pass-through ports on this module can negotiate

speeds of 1, 2, or 4 Gbps. The 4G Fibre Channel pass-through module is

hot-swappable, and may be installed in Fabric B or Fabric C.

NOTE: To ensure proper functionality, use only the Short Wave Small Form Factor

Pluggable (SFP) transceivers provided with this module.

Configuring the I/O Modules 85

Figure 3-21. 4G Fibre Channel Pass-Through Module

1 SFP Fibre Channel connector (16) 2 Fibre Channel green/amber

indicators (two per port)

3 power indicator 4 status/identification indicator

86 Configuring the I/O Modules

book.book Page 86 Wednesday, March 9, 2011 3:11 PM