Compaq StorageWorks™
RAID Array 3000 Pedestal Storage
Subsystem Hardware
User’s Guide
Third Edition (January 2001)
Part Number EK-SMCPO-UG. C01
Compaq Computer Corporation
Contents
About This Guide
Purpose and Scope.......................................................................................................ix
Intended Audience.......................................................................................................ix
Document Structure.....................................................................................................ix
Related Documents......................................................................................................xi
Text Conventions........................................................................................................xii
Symbols in Text........................................................................................................ xiii
Symbols on Equipment............................................................................................. xiii
Rack Stability..............................................................................................................xv
Getting Help................................................................................................................xv
Compaq Technical Support .................................................................................xv
Compaq Website.................................................................................................xvi
Compaq Authorized Reseller .............................................................................xvi
Chapter 1
Product Overview
Product Description .................................................................................................. 1-1
Pedestal Features....................................................................................................... 1-4
Pedestal Cabinet........................................................................................................ 1-5
Pedestal Components................................................................................................ 1-7
StorageWorks Building Blocks (SBBs) ............................................................ 1-7
RAID Array Controller...................................................................................... 1-7
Pedestal Power Supplies.................................................................................... 1-8
UPS.................................................................................................................... 1-8
Environmental Monitor Unit (EMU)................................................................. 1-9
UltraSCSI Buses.............................................................................................. 1-11
Connecting the Pedestal to a Host System ............................................................. 1-14
Specifications.......................................................................................................... 1-19
iv RAID Array 3000 Pedestal Storage Subsystem Hardware User's Guide
Chapter 2
RAID Array Controller
Controller Overview..................................................................................................2-1
Controller Features ....................................................................................................2-3
Controller Reset and LED Indicators ........................................................................2-8
Flexible RAID Set Configuration..............................................................................2-9
Performance Enhancements ....................................................................................2-10
Custom Components ........................................................................................2-10
Efficient Write and Read Algorithms...............................................................2-11
RAID Levels Supported ..........................................................................................2-13
RAID 0 .............................................................................................................2-14
RAID 1 .............................................................................................................2-16
RAID 0+1.........................................................................................................2-16
RAID 4 .............................................................................................................2-18
RAID 5 .............................................................................................................2-19
Just a Bunch of Drives (JBOD)........................................................................2-21
Redundant Operation...............................................................................................2-21
Initialization......................................................................................................2-21
Message Passing...............................................................................................2-22
Failover.............................................................................................................2-22
Environmental..........................................................................................................2-22
Backup Power Management.............................................................................2-22
Voltage Monitoring ..........................................................................................2-24
Temperature Monitoring ..................................................................................2-26
Chapter 3
Maintenance
Pedestal Status and Power LEDs...............................................................................3-2
SBB Status LEDs.......................................................................................................3-3
Controller LEDs.........................................................................................................3-4
EMU Error Reporting................................................................................................3-5
EMU Error Conditions .......................................................................................3-6
Replacing Components (FRUs).................................................................................3-7
Removing the Pedestal Door..............................................................................3-8
Replacing an SBB ..............................................................................................3-9
Replacing a Power Supply ...............................................................................3-10
Replacing the RAID Array Controller .............................................................3-12
Replacing the EMU Board ...............................................................................3-13
Replacing the UPS............................................................................................3-15
Differential/Wide UltraSCSI Bus............................................................................3-15
Reconfiguring the SCSI Bus ............................................................................3-16
Replacing the Controller Memory Cache Modules.................................................3-20
Contents
v
Chapter 4
Expansion Pedestal Option
Product Description .................................................................................................. 4-1
Expansion Pedestal Cabinet...................................................................................... 4-2
Expansion Pedestal Components.............................................................................. 4-4
Reconfiguring Base Pedestal UltraSCSI Bus ........................................................... 4-6
Chapter 5
Second Controller Option
Second Controller Option Kit................................................................................... 5-2
Installing the Upgrade............................................................................................... 5-3
Saving Existing Configuration .......................................................................... 5-3
Updating Firmware............................................................................................ 5-4
Shutting Down the RA3000 .............................................................................. 5-6
Installing Two SIMMs into Second Controller................................................. 5-7
Replacing Existing Controller........................................................................... 5-8
Restoring the Configuration .............................................................................. 5-9
Updating Firmware on Second Controller ...................................................... 5-10
Installing Original Controller .......................................................................... 5-11
Configuring a Dual Controller Installation for a Single Serial Port....................... 5-11
Configuring the RA3000 for the Active Mode of Operation.......................... 5-12
Configuring the Dual Controllers.................................................................... 5-13
Connecting to Your Dual Controller Storage System..................................... 5-14
Verifying the Controller Operating Parameters .............................................. 5-15
List of -igures
Figure 1-1. RAID Array 3000 pedestal enclosure (drives optional) ....................... 1-2
Figure 1-2. Pedestal front panel major components................................................ 1-6
Figure 1-3. Pedestal rear panel power supplies ....................................................... 1-6
Figure 1-4. EMU circuit board location ................................................................ 1-10
Figure 1-5. Pedestal rear panel components.......................................................... 1-11
Figure 1-6. UltraSCSI bus port and default SCSI ID assignments........................ 1-12
Figure 1-7. UltraSCSI bus configuration switch ................................................... 1-13
Figure 1-8. Slot locations and SCSI ID addresses................................................. 1-13
Figure 1-9. Single host, single adapter cabling diagram ....................................... 1-15
Figure 1-10. Single host, dual adapter/dual controller cabling diagram ............... 1-16
Figure 1-11. Single host, single adapter/dual controller (y-cable
connection) cabling diagram ........................................................... 1-17
Figure 1-12. Dual host, single adapter/single controller cabling diagram ............ 1-18
Figure 2-1. Bridging the gap between the host and the pedestal............................. 2-3
Figure 2-2. Units created from storagesets, partitions, and disk drives .................. 2-4
Figure 2-3. Controller front panel............................................................................ 2-9
vi RAID Array 3000 Pedestal Storage Subsystem Hardware User's Guide
Figure 2-4. RAID 0 write .......................................................................................2-15
Figure 2-5. Diagram of a RAID 1 write .................................................................2-16
Figure 2-6. Diagram of RAID 0+1 write................................................................2-17
Figure 2-7. Diagram of a RAID 4 write .................................................................2-18
Figure 2-8. Diagram of a RAID 5 write .................................................................2-20
Figure 3-1. Pedestal status LEDs..............................................................................3-3
Figure 3-2. Disk drive status LEDs ..........................................................................3-4
Figure 3-3. Removing pedestal door ........................................................................3-8
Figure 3-4. Replacing an SBB................................................................................3-10
Figure 3-5. Replacing a power supply....................................................................3-11
Figure 3-6. Removing the controller from the pedestal .........................................3-12
Figure 3-7. Remove standoffs from UPS and external fault connectors................3-14
Figure 3-8. Remove screw and panel .....................................................................3-18
Figure 3-9. Location of SCSI bus configuration switch.........................................3-19
Figure 3-10. Configuration switch .........................................................................3-19
Figure 3-11. Remove controller..............................................................................3-20
Figure 3-12. Release locking clips .........................................................................3-21
Figure 13. Remove installed SIMM modules.........................................................3-21
Figure 3-14. Install replacement SIMM .................................................................3-22
Figure 3-15. Pivot SIMM down to secure..............................................................3-23
Figure 4-1. Expansion pedestal ................................................................................4-2
Figure 4-2. Expansion pedestal slot locations and ID addresses..............................4-3
Figure 4-3. Rear panel power supplies.....................................................................4-4
Figure 4-4. EMU circuit board location ...................................................................4-5
Figure 4-5. Remove side cover from base pedestal..................................................4-7
Figure 4-6. Remove SCSI bus terminator ................................................................4-7
Figure 4-7. Disconnect SCSI cable ..........................................................................4-8
Figure 4-8. Connect SCSI jumper ............................................................................4-9
Figure 4-9. Remove connector knockout plate.......................................................4-10
Figure 4-10. Connect SCSI cable ...........................................................................4-11
Figure 4-11. Set configuration switch to 7.............................................................4-12
Figure 4-12. Configuration switch .........................................................................4-12
Figure 4-13. Reconfigured SCSI bus addresses .....................................................4-13
Figure 4-14. Connect SCSI cable between pedestals.............................................4-14
Figure 4-15. Power cable connections....................................................................4-15
Figure 4-16. Transfer drives from base to expansion pedestal...............................4-16
Figure 5-1. Second controller pedestal slot location ................................................5-2
Figure 5-2. Saving the existing configuration..........................................................5-3
Figure 5-3. Saved configuration...............................................................................5-4
Figure 5-4. Update firmware command ...................................................................5-4
Figure 5-5. Firmware update dialog box ..................................................................5-5
Figure 5-6. Insert SIMM into connector...................................................................5-7
Figure 5-7. Pivot SIMM down to seat......................................................................5-7
Figure 5-8 Remove controller from top slot.............................................................5-8
Figure 5-9. Restoring configuration to new controller.............................................5-9
Figure 5-10. Restored configuration example........................................................5-10
Contents vii
List of Tables
Table 1 Related Documents.........................................................................................xi
Table 1-1 RAID Array 3000 Pedestal Part Numbers and Model
Descriptions .............................................................................................. 1-3
Table 1-2 Single Host, Single Adapter Cabling ..................................................... 1-15
Table 1-3 Single Host, Dual Adapter/Dual Controller Cabling ............................. 1-16
Table 1-4 Single Host, Single Adapter/Dual Controller (Y-cable connection
cabling) ................................................................................................... 1-17
Table 1-5 Dual Host, Single Adapter/Single Controller Cabling........................... 1-18
Table 1-6 Pedestal Technical Specifications.......................................................... 1-19
Table 1-7 Pedestal Physical and Power Specification............................................ 1-20
Table 2-1 Controller Specifications.......................................................................... 2-5
Table 2-2 LED/Reset Switch Interface..................................................................... 2-8
Table 2-3 RAID Levels Supported......................................................................... 2-13
Table 2-4 Pedestal RAID Set Restrictions ............................................................. 2-13
Table 2-5 RAID 0+1 Example................................................................................ 2-17
Table 2-6 Response to Various AC Power Conditions .......................................... 2-23
Table 2-7 Acceptable System Voltage Levels........................................................ 2-24
Table 2-8 Acceptable Termination Voltage Levels................................................ 2-25
Table 2-9 Acceptable 12 Volt Levels..................................................................... 2-25
Table 2-10 Acceptable External Temperature Levels............................................ 2-26
Table 2-11 Acceptable Board Temperature Levels................................................ 2-26
Table 3-1 Disk Drive SBB Status LEDs................................................................... 3-4
Table 3-2 SCSI Bus Length and External Cables................................................... 3-16
Table 3-3 Assigned Slot Device Addresses in the Pedestal ................................... 3-16
About This Guide
Purpose and Scope
This guide is designed to for installers and operators of Compaq
StorageWorksTM RAID Array 3000 Pedestal Storage Subsystem Hardware
User’s Guide.
Intended Audience
This document is written for installers and operators.
Document Structure
This guide contains the following information:
Chapter 1: Product Overview
n
n
n
n
n
n
Product Description
Pedestal Features
Pedestal Cabinet
Pedestal Components
Connecting the Pedestal to a Host System
Specifications
x
RAID Array 3000 Pedestal Storage Subsystem Hardware User's Guide
Chapter 2: RAID Array Controller
n
n
n
n
n
n
n
n
Controller Overview
Controller Features
Controller Reset and LED Indicators
Flexible RAID Set Configuration
Performance Enhancements
RAID Levels Supported
Redundant Operation
Environmental
Chapter 3: Maintenance
n
n
n
n
n
n
n
Pedestal Status and Power LEDs
SBB Status LEDs
Controller LEDs
EMU Error Reporting
Replacing Components (FRUs)
Differential/Wide UltraSCSI Bus
Replacing the Controller Memory Cache Modules
Chapter 4: RAID Array Controller
n
n
n
n
Product Description
Expansion Pedestal Cabinet
Expansion Pedestal Components
Reconfiguring Base Pedestal UltraSCSI Bus
Chapter 5: Second Controller Option
n
n
n
Second Controller Option Kit
Installing the Upgrade
Configuring a Dual Controller Installation for a Single Serial Port
Contents xi
Related Documents
In addition to this guide, the following documentation is useful to the reader:
Table 1
Related Documents
Document Title
Part Number
RAID Array 3000 Subsystem Second
Controller Option Installation Guide
EK-SM3KC-IG.E01
RAID Array 3000 Controller Shelf Hardware
User’s Guide
EK-SMCPQ-UG.D01
AA-RB52C-TE
Command Console V2.2 for the RAID Array
3000 (Pedestal and Rack Mount Models)
User’s Guide
xii RAID Array 3000 Pedestal Storage Subsystem Hardware User's Guide
Text Conventions
This document uses the following conventions to distinguish elements of text:
Keys
Keys appear in boldface. A plus sign (+) between
two keys indicates that they should be pressed
simultaneously.
USER INPUT
User input appears in a different typeface and in
uppercase.
FILENAMES
File names appear in uppercase italics.
Menu Options,
These elements appear in initial capital letters.
Command Names,
Dialog Box Names
COMMANDS,
These elements appear in uppercase, unless case
DIRECTORY NAMES, sensitive.
and DRIVE NAMES
Type
When you are instructed to type information, type
the information without pressing the Enter key.
Enter
When you are instructed to enter information, type
the information and then press the Enter key.
Contents xiii
Symbols in Text
The following symbols are found in the text of this guide to indicate different
types of information.
WARNING: Text set off in this manner indicates that failure to follow directions
in the warning could result in bodily harm or loss of life.
CAUTION: Text set off in this manner indicates that failure to follow directions
could result in damage to equipment or loss of information.
IMPORTANT: Text set off in this manner presents clarifying information or specific
instructions.
NOTE: Text set off in this manner presents commentary, sidelights, or interesting points
of information.
Symbols on Equipment
The following symbols are placed on equipment to indicate the presence of
potentially hazardous conditions:
This symbol in conjunction with any of the following symbols indicates the
presence of a potential hazard. The potential for injury exists if warnings
are not observed. Consult your documentation for specific details.
This symbol indicates the presence of hazardous energy circuits or electric
shock hazards. Refer all servicing to qualified personnel.
WARNING: To reduce the risk of injury from electric shock hazards, do not
open this enclosure. Refer all maintenance, upgrades, and servicing to
qualified personnel.
This symbol indicates the presence of electric shock hazards. The area
contains no user or field serviceable parts. Do not open for any reason.
WARNING: To reduce the risk of injury from electric shock hazards, do
not open this enclosure.
xiv RAID Array 3000 Pedestal Storage Subsystem Hardware User's Guide
This is a test
This symbol on an RJ-45 receptacle indicates a Network Interface
Connection.
WARNING: To reduce the risk of electric shock, fire, or damage to the
equipment, do not plug telephone or telecommunications connectors into
this receptacle.
This symbol indicates the presence of a hot surface or hot component. If
this surface is contacted, the potential for injury exists.
WARNING: To reduce the risk of injury from a hot component, allow the
surface to cool before touching.
These symbols on power supplies or systems indicate the
equipment is supplied by multiple sources of power.
WARNING: To reduce the risk of injury from electric shock,
remove all power cords to completely disconnect power from
the system.
This symbol indicates that the component exceeds the recommended
weight for one individual to handle safely.
Weight in kg
Weight in lb
WARNING: To reduce the risk of personal injury or damage to the
equipment, observe local occupational health and safety requirements and
guidelines for manual material handling.
Contents xv
Rack Stability
WARNING: To reduce the risk of personal injury or damage to the equipment,
be sure that:
n
n
n
The leveling jacks are extended to the floor.
The full weight of the rack rests on the leveling jacks.
The stabilizing feet are attached to the rack if it is a single rack
installation.
n
n
The racks are coupled together in multiple rack installations.
Only one component is extended at a time. A rack may become unstable
if more than one component is extended for any reason.
Getting Help
If you have a problem and have exhausted the information in this guide, you
can get further information and other help in the following locations.
Compaq Technical Support
In North America, call the Compaq Technical Phone Support Center at
1-800-OK-COMPAQ. This service is available 24 hours a day, 7 days a week.
For continuous quality improvement, calls may be recorded or monitored.
Outside North America, call the nearest Compaq Technical Support Phone
Center. Telephone numbers for worldwide Technical Support Centers are
listed on the Compaq website. Access the Compaq website:
http://www.compaq.com
xvi RAID Array 3000 Pedestal Storage Subsystem Hardware User's Guide
Be sure to have the following information available before you call Compaq:
n
n
n
n
n
n
n
Technical support registration number (if applicable)
Product serial number
Product model name and number
Applicable error messages
Add-on boards or hardware
Third-party hardware or software
Operating system type and revision level
Compaq Website
The Compaq website has information on this product. Access the Compaq
website:
http://www.compaq.com/storage
Compaq Authorized Reseller
For the name of your nearest Compaq authorized reseller:
n
n
n
In the United States, call 1-800-345-1518.
In Canada, call 1-800-263-5868.
Elsewhere, see the Compaq website for locations and telephone
numbers.
Chapter
1
Product Overview
This chapter provides an overall description of the RAID Array 3000 Storage
System and its components. Examples of Host/Storage System connections
and a list of technical and environmental specifications are included at the end
of the chapter.
NOTE: This guide is the Hardware User’s Guide. For configuration information, refer to the
Getting Started RAID Array 3000 Installation Guide for your Host system and the
Command Console V2.2 for the RAID Array 3000 (Pedestal and Rack Mount Models)
User’s Guide.
Product Description
The RAID Array 3000 storage subsystem is a desk-side storage system
(subsystem) offering the basic components required to create a user-designed
storage array with two 16-bit, differential UltraSCSI bus host interfaces
(Figure 1–1). The pedestal can accommodate up to seven 3½-in storage
devices. The devices, referred to as StorageWorks Building Blocks or SBBs,
are disk drives from the StorageWorks family of storage devices. The release
note that accompanies the subsystem lists the software solutions and disk
drives that are supported. A battery backup subsystem is included as part of
the pedestal enclosure in the form of a freestanding Uninterruptable Power
Supply (UPS). In case of a power failure, the UPS provide a temporary backup
for cache while the subsystem flushes to disks.
1-2 RAID Array 3000 Pedestal Storage Subsystem Hardware User’s Guide
The RAID Array 3000 offering also includes option kits designed to increase
the storage capacity and enhance the performance of the subsystem. The first
is an expansion pedestal (second enclosure) designed to increase the storage
capacity of the subsystem to a maximum of 14 drives. The pedestal expansion
kit option is described in detailed in Chapter 4 “Expansion Pedestal Option” of
this guide.
The second option kit allows the addition of a second RAID controller to the
subsystem for redundancy. The second controller operates in conjunction with
the installed controller to protect data during a malfunction. Chapter 5 “Second
Controller Option” describes how to install the redundant controller option and
how to reconfigure the subsystem to accommodate it.
The RAID Array 3000 pedestal enclosure and its associated options are listed
and described in Table 1–1. Figure 1–1 shows the pedestal with a full
complement of drives (optional) for completeness.
PEDESTAL
UPS
3000-01A
Figure 1-1. RAID Array 3000 pedestal enclosure (drives optional)
Product Overview 1-3
The RAID Array 3000 pedestal is equipped with a dual-channel RAID
controller that supports all of the UltraSCSI bus features. It also contains an
Environmental Monitor Unit (EMU) board for environmental monitoring and
error detection.
Table 1-1
RAID Array 3000 Pedestal Part Numbers and Model Descriptions
Compaq Part No.
Item Description
DS-SWXRA-GA
RA3000 pedestal subsystem with one controller, 120 V.
Includes: Seven-slot pedestal for wide UltraSCSI SBBs, one HSZ22
two-channel controller with 16 MB cache, Environmental Monitor Unit
(EMU), two 204 watt power supplies with fans, five meter host SCSI
cable (BN37A), BN38E-OB adapter, one 120-volt UPS, and North
American power cords. Disks are not included.
Requires: Solutions Software Kit for platform, host adapter, and disks.
Options: Second HSZ22 controller, seven disk SBB expansion pedestal,
and cache memory upgrade.
DS-SWXRA-GC
RA3000 pedestal subsystem with one controller, 230 V.
Includes: Seven-slot pedestal for wide UltraSCSI SBBs, one HSZ22
two-channel controller with 16 MB cache, Environmental Monitor Unit
(EMU), two 204 watt power supplies with fans, five meter host SCSI
cable (BN37A), BN38E-OB adapter, one 230-volt Uninterruptable Power
Supply (UPS), and North American power cords. Disks are not included.
Requires: Solutions Software Kit for platform, host adapter, and disks.
Options: Second HSZ22 controller, seven-disk SBB expansion
pedestal, and cache memory upgrade.
DS-HSZ22-AA
DS-HSZ22-AB
RA3000 second controller option which includes:
DS-HSZ22-AA SCSI controller, three 16-MB SIMM modules, 0.8 m
adapter-to-SCSI-3 cable, 5 m SCSI cable, 9-pin serial cable, user
documentation.
RA3000 second controller option which includes:
DS-HSZ22-AB SCSI controller, four 32-MB SIMM modules, 0.8 m
adapter-to-SCSI-3 cable, 5 m SCSI cable, 9-pin serial cable, user
documentation.
DS-SWXRA-GD
DS-SWXRA-GR
Expansion Pedestal (120/240 V) with slot space for seven additional
UltraSCSI disk drives.
Single 204-watt power supply for RA3000, 120/230 V for on-site spare.
1-4 RAID Array 3000 Pedestal Storage Subsystem Hardware User’s Guide
Pedestal Features
The major features of the pedestal are:
I
I
I
I
I
Two differential 16-bit UltraSCSI host buses
Seven 3½-in disk drive SBB slots
One dual-channel RAID array controller
Second controller option for redundancy
Expansion pedestal option allowing up to fourteen SBB slots in a dual-
pedestal subsystem configuration
I
I
Memory cache expansion option for the controller
Redundant power provided by two fan-cooled universal AC input power
supplies (50/60 Hz, 100 to 240 VAC)
I
I
I
Cache backup provided by an external UPS
Environmental monitor unit (EMU) for error detection
The ability to hot plug SBBs without powering down the system
Pedestal Cabinet
The pedestal cabinet is a modular freestanding storage enclosure that is
completely self-contained. It has two fan-cooled power supplies, an internal
EMU circuit board, and a RAID array controller with front panel display and
control.
Figure 1–2 shows the major components in the pedestal enclosure.
Figure 1–3 identifies the items on the rear panel power supplies. The
characteristics of the pedestal cabinet are:
I
I
I
The disk drive storage capacity is seven 3½-in disk drive SBBs.
The subsystem slots are numbered 0 through 6 from top to bottom.
There are two 68-pin VHDCI female SCSI connectors on the rear panel,
which interconnect the host system to the RAID controller in the
pedestal.
I
The rear panel also contains an alarm switch, a UPS monitor connector,
an external fault condition connector, and a serial port connector (for
controller configuration).
Product Overview 1-5
I
The pedestal is equipped with an internal configuration switch, which
sets the SCSI ID addresses of the controller and the storage devices.
Figure 1-2. Pedestal front panel major components
Figure 1-3. Pedestal rear panel power supplies
1-6 RAID Array 3000 Pedestal Storage Subsystem Hardware User’s Guide
Pedestal Components
The major components in the pedestal subsystem include:
Dual-channel RAID array controller
Two 16-bit single-ended split SCSI buses
I
I
I
I
I
Environmental Monitor Unit (EMU)
Two universal 50/60 Hz, 120 or 240 VAC power supplies
Separate free-standing backup power supply (UPS)
StorageWorks Building Blocks (SBBs)
The pedestal has seven 3½-in disk drive SBB slots. The number of drives that
make up each configuration of the array is left to the end user with a maximum
of seven storage devices.
RAID Array Controller
The controller contains two wide,UltraSCSI differential host channels and two
wide, UltraSCSI single-ended disk channels. In dual-controller configurations,
the controllers support fully automatic and smooth controller failover.
The controller supports one or two standard 72-pin cache SIMMs of up to
32 MB. In a redundant controller setup, both controllers must have identical
cache configurations and the total usable cache (per controller) will be half the
amount installed. Thus, in a single controller setup, the maximum usable cache
is 64 MB while a redundant setup has a maximum usable cache of 32 MB (per
controller).
The RAID Array controller contains the following features:
I
I
I
I
I
I
I
Single PCB form factor for inclusion in the enclosure
Support for dual hot-swap controller operation
Dual differential Ultra-Wide SCSI host channels
Dual single-ended Ultra-Wide SCSI disk channels
RAID level 0, 1, 0+1, 4, 5, and JBOD support
EMU support
Cluster support for Windows
Product Overview 1-7
I
32 Logical Unit (LUNs) per host channel (some operating systems may
be limited to 8)
I
I
I
I
Support for Hot and Warm spare disks
UPS-backed write caching
Per LUN write cache/write back selection
Configuration/Maintenance via RS-232 or host SCSI channel using
StorageWorks Command Console (SWCC)
I
Update of firmware via host channel
Pedestal Power Supplies
The pedestal has two interchangeable, air-cooled, AC power supply modules
located at the rear of the unit. The power supplies provide redundant power if
one of the units should malfunction. Each supply provides +5 and +12 VDC to
power the RAID controller, EMU, and the storage SBBs in the pedestal. In
addition, each unit contains a high-speed fan for pedestal cooling. The upper
power supply is designated as A and the lower as B. The unit contains an AC
power receptacle, a power status LED, a fan, and a latching slider switch to
secure the supply in the pedestal.
UPS
The UPS is separate and free-standing unit designed to protect the pedestal
from problems associated with poor quality AC power or a complete loss of
AC power. The UPS is connected between the AC outlet and the line input of
the pedestal power supply B to provide battery backup power.
The major features of the UPS include Cell Saver Technology (doubles battery
life and speeds recharge time), hot-swap batteries, and network surge
protection. The front panel display has user controls (LEDs and control
buttons) and the rear panel contains a COMM port, which provides UPS status
to the EMU in the pedestal. The rear panel also contains the network surge
protector, a reset button, and four power receptacles. An audible alarm is
activated when input power fails, as a Low Battery Warning, or whenever the
UPS is in need of servicing.
The UPS automatically recharges its battery when power is returned following
a power failure. Recharge time is four to six hours depending on the energy
requirements of your load and the length of the power outage.
1-8 RAID Array 3000 Pedestal Storage Subsystem Hardware User’s Guide
The UPS has its own installation, operation, and service manual. The manual
describes the UPS in detail and is part of the documentation set enclosed with
your subsystem.
Environmental Monitor Unit (EMU)
The EMU is an internal circuit board that monitors the operation of the
pedestal. The EMU monitors power supply voltages, fans, temperatures which
are reported to the user, and controls (turns on and off) the audible alarm and
status LED on the front panel. The EMU also reports the subsystem status to
the controller that reports to the host, and has the capability of exchanging
signals with auxiliary devices and controllers.
The EMU is located internally in the top rear of the pedestal as shown in
(Figure 1–4). It is connected to the SCSI bus and powered by an internal cable.
The following external components on the rear panel of the pedestal are part of
the EMU (Figure 1–5):
I
I
I
An alarm switch (S1) that enables (up) or disables (down) the audible
alarm
A power monitor connector (UPS) allows the EMU to monitor and
report the status of a battery backup power supply
An External Fault Condition connector allows the EMU to monitor the
status of a user-selected device
EMU
3000-37
Figure 1-4. EMU circuit board location
Product Overview 1-9
Figure 1-5 shows the Pedestal rear panel components.
External
Fault
Host #0
UPS
Host #1
Controller (Top)
Controller (Bottom)
3000-23A
Figure 1-5. Pedestal rear panel components
1-10 RAID Array 3000 Pedestal Storage Subsystem Hardware User’s Guide
UltraSCSI Buses
The pedestal contains two, 16-bit, single-ended, wide UltraSCSI buses
(factory-configured as a split bus) that connects the controllers to the disk
drives.
The split-bus arrangement is divided into two-bus paths designated device port
0 and device port 1 as shown in Figure 1–6. Port 0 connects the controller to
the upper four devices in the pedestal (IDs 8 through 11) and port 1 connects
the controller to lower three devices (IDs 8 through 10). The device addresses
on the bus are set at the factory by an internal configuration switch
(Figure 1–7).
ID8
ID9
ID10
ID11
ID8
Device
Port 0
ID9
Device
Port 1
ID10
Top Controller
ID=7
ID=7
ID=6
Bottom Controller (Optional)
ID=6
3000-51
Figure 1-6. UltraSCSI bus port and default SCSI ID assignments
When set to a specific position, the switch controls the addresses of each SBB
slot. Figure 1–8 identifies the pedestal slot locations and their corresponding
SCSI ID addresses for each device port.
Product Overview 1-11
The subsystem can be reconfigured for through-bus operation by modifying
the bus and resetting the internal configuration switch. The information needed
to reconfigure the bus from split-bus to a through-bus configuration is
described in Chapter 4 “Expansion Pedestal Option”.
6
3000-38
Figure 1-7. UltraSCSI bus configuration switch
Controller
SLOT 0
SLOT 1
SLOT 2
SLOT 3
SLOT 4
SLOT 5
SLOT 6
ID = 8
Device
Port 0
11
8
Device
Port 1
ID = 10
3000-52
Figure 1-8. Slot locations and SCSI ID addresses
1-12 RAID Array 3000 Pedestal Storage Subsystem Hardware User’s Guide
Connecting the Pedestal to a Host System
This section illustrates how to connect four possible RA3000/Host
configurations. The configurations are:
I
I
I
Single host, single adapter configuration
Single host, dual adapter/dual controller configuration
Single host, single adapter/dual controller configuration (using a
Y-cable)
I
Dual host, single adapter/single controller configuration
NOTE: The following illustrations show the expansion pedestal option as part of the
storage system installation. See Chapter 4 for a full description of the Expansion Pedestal.
Product Overview 1-13
Figure 1-9 shows the Single host, Single Adapter Cabling diagram.
Rear View of DS-SWXRA-GA
Controller Pedestal
Rear View of
DS-SWXRA-GD
Expansion Pedestal
1
2
3
Host
System
Host
Adapter
6
5
4
shr-1311b
Figure 1-9. Single host, single adapter cabling diagram
Table 1-2
Single Host, Single Adapter Cabling
Item
Description
Host #1 VHDCI connector
Host #0 VHDCI connector
SCSI device bus out connector D0
SCSI Cable BN37A-05 (host adapter connection made using Technology
Adapter cable BN38E-0B, not shown)
SCSI cable 17-04454-01
SCSI device bus In connector D0
1-14 RAID Array 3000 Pedestal Storage Subsystem Hardware User’s Guide
Figure 1-10 shows the Single host, Dual Adapter/dual Controller Cabling
diagram.
Rear View of DS-SWXRA-GA
Rear View of DS-SWXRA-GA
Controller Pedestal
Controller Pedestal
Rear View of
Rear View of
DS-SWXRA-GD
DS-SWXRA-GD
1
Expansion Pedestal
Expansion Pedestal
2
3
Host
System
Host
Adapter
Host
Adapter
6
5
4
shr-1312b
Figure 1-10. Single host, dual adapter/dual controller cabling diagram
Table 1-3
Single Host, Dual Adapter/Dual Controller Cabling
Item
Description
Host #1 VHDCI connector
Host #0 VHDCI connector
SCSI device bus out connector D0
(2) SCSI Cables BN37A-05 (host adapter connection made using two Technology
Adapter cables BN38E-0B, not shown)
SCSI cable 17-04454-01
SCSI device bus in connector D0
Product Overview 1-15
Figure 1-11 shows the Single Host, Single Adapter/dual Controller (y-cable
connection) Cabling diagram.
Rear View of DS-SWXRA-GA
Controller Pedestal
Rear View of
DS-SWXRA-GD
Expansion Pedestal
Host
System
Host
Adapter
shr-1313b
Figure 1-11. Single host, single adapter/dual controller (y-cable connection)
cabling diagram
Table 1-4
Single Host, Single Adapter/Dual Controller
(Y-cable connection cabling)
Item
Description
Host #1 VHDCI connector
Host #0 VHDCI connector
SCSI device bus out connector D0
SCSI Y-cable BN-21W-OB
(2) SCSI cables BN37A-05 (connections to Y-cable made using two Technology
Adapter cables BN38E-0B, not shown)
SCSI cable 17-04454-01
SCSI device bus In connector D0
1-16 RAID Array 3000 Pedestal Storage Subsystem Hardware User’s Guide
Figure 1-12 shows the Dual host, Single Adapter/single Controller Cabling
diagram.
Rear RVeiearwVioewf DofSD-SS-SWWXXRRAA--GGAA
Controller Pedestal
Controller Pedestal
ReRareVaierwVoifew of
DS-SWXRA-GD
DS-SWXRA-GD
Expansion Pedestal
Expansion Pedestal
Host
System
Host
Adapter
Host
System
Host
Adapter
shr-1314b
Figure 1-12. Dual host, single adapter/single controller cabling diagram
Table 1-5
Dual Host, Single Adapter/Single Controller Cabling
Item
Description
Host #1 VHDCI connector
Host #0 VHDCI connector
SCSI Cable BN37A-05 (host adapter connection made
through Technology Adapter cable BN38E-0B, not shown)
SCSI Cable BN37A-05 (host adapter connection made
through Technology Adapter cable BN38E-0B, not shown)
SCSI device bus out connector D0
SCSI cable 17-04454-01
SCSI device bus In connector D0
Product Overview 1-17
Specifications
Table 1-6
Pedestal Technical Specifications
Item
Description
Cabinet
Pedestal with seven (7) disk SBB slots
Expansion pedestal with an additional 7 slots
Controller
HSZ22
Controller cache
16 MB standard
upgrades to 128 MB for a two controller pair
Backup for cache
Standard UPS
Mirrored write-back cache
Device channels per controller
Maximum disks per device port
Dual active controllers
Host interface
Yes
2
14
Yes, order HSZ22-AA and second solutions software kit
UltraSCSI wide differential
UltraSCSI wide single-ended
0, 1, 0+1, 4, 5
Drive interface
RAID levels supported
Non-RAID disk support
Sustained I/O rate
Yes (JBOD)
4,400 I/O’s per second per controller pair
28 MB per second per controller pair
40 MB per second per controller pair
Yes
RAID 5 sustained transfer rate
Maximum transfer rate
Redundant fans
Redundant power supplies
Global disk spares
Yes
Yes
EMU
Yes, monitors power and temperature
One serial
Setup/control lines
Serviceability
Hot-swap components
SWCC 2.2 available for all platforms.
RAID manager GUI support
Regulatory approvals
UL, CSA, TUV, FCC, CE MARK, C TICK,
BSMI (replaces BCIQ), VCCI
1-18 RAID Array 3000 Pedestal Storage Subsystem Hardware User’s Guide
Table 1-7
Pedestal Physical and Power Specification
Physical Specifications
Item
Dimension
Height
Width
Depth
564 mm
254 mm
494 mm
305 mm
305 mm
19.5 kg
Rear clearance (air exhaust)
Front clearance (door opening)
Weight (no devices)
Power Specifications
Item
Rating
Input power
110-240 VAC, 50/60 Hz, single
phase, 12A/6A
Heat dissipation
3070 Btu/hr
Temperature (optimal, minimum required)
65°F to 75°F (18°C to 24°C),
50°F to 104°F (10 to 40°C)
Up to 2,400 m
Altitude
Air quality
Not to exceed 500,000 particles/ft3
for air at a size of 0.5 micron or
larger
204 watts, maximum
Total power per power supply
(Total of +12 VDC and +5 VDC outputs)
Nominal output voltages
Device startup time
+5 VDC @ 15 amps, maximum
+12 VDC @ 12 amps, maximum
4 second internal, minimum
Chapter
2
RAID Array Controller
This chapter describes the major features and characteristics of the RAID array
controller in the RAID Array 3000 subsystem. The number of devices
supported by the controller may be limited by the enclosure.
Controller Overview
The RAID Array controller provides high performance, high-availability
access to SCSI disk array subsystems along a UltraSCSI/Wide SCSI bus. With
a modular hardware design and an intuitive configuration utility, the controller
is designed to meet a wide range of storage needs.
The controller consists of a single 5 ½ in (14.2 cm) x 8 in (20.3 cm) PCB
mounted in a sheet metal subassembly. The package consists of the controller
PCB, a 300-pin connector, mechanical insertion assists, and a LED/reset
switch interface. All signals to the controller are routed through the backplane
connector.
The unit is configured with two Ultra Wide, differential SCSI host channels
capable of transferring data to and from the host at rates up to 40 Mb/s. The
host SCSI IDs are configurable via the host parameters and can support
32-deep tagged queuing. The controller is also configured with two Ultra
Wide, single-ended SCSI disk channels capable of transferring data to and
from the disk drives at rates up to 40 Mb/s. Each channel can support up to 15
drives (14 in redundant controller subsystems).
2-2 RAID Array 3000 Pedestal Storage Subsystem Hardware User’s Guide
The controller has two Single Inline Memory Module (SIMM) connectors for
up to 64 MB of cache memory. The SIMM connectors form a mirrored pair
when the controllers are configured in a redundant controller configuration;
otherwise they are fully accessible by the controller. In a redundant controller
setup, both controllers must have identical cache configurations and the total
usable cache (per controller) will be half the amount installed. Thus, in a
single controller setup, the maximum usable cache is 64 MB while a redundant
setup has a maximum usable cache of 32 MB (per controller).
There are two configurations for redundant pairs of controllers: Active/Active
Failover mode and Active/Passive Failover mode. In Active/Active Failover,
each controller in the redundant pair has one active SCSI host port and one
passive SCSI host port. Redundancy Groups (Virtual LUNs) can be mapped
only to one active host port and are not accessible from the passive port or the
other controller (that is partitioned model).
In Active/Passive Failover, one controller in the redundant pair has both SCSI
host ports active and the other controller is in a standby passive mode.
Redundancy Groups (Virtual LUNs) can be mapped to either SCSI host port or
to both as in the single controller model.
In both cases, a single controller failure will not affect the subsystem because
the surviving controller will take over.
RAID Array Controller 2-3
Controller Features
The controller is the intelligent bridge between the host and the devices in the
pedestal. From the host’s perspective, the controller is simply another SCSI
device connected to one of its I/O buses. Consequently, the host sends its I/O
requests to the controller just as it would to any other SCSI device. Figure 2–1
shows the role of the controller between the host and the pedestal.
Figure 2-1. Bridging the gap between the host and the pedestal
2-4 RAID Array 3000 Pedestal Storage Subsystem Hardware User’s Guide
From the pedestal’s perspective, the controller receives the I/O requests from
the host and directs them to the devices in the pedestal. Since the controller
processes all the I/O requests, it eliminates the host-based processing that is
typically associated with reading and writing data to multiple storage devices.
The controller does much more than simply manage I/O requests: it provides
the ability to combine several ordinary disk drives into a single, high-
performance storage unit called a storageset. Storagesets are implementations
of RAID technology, also known as a Redundant Array of Independent Disks.
Every storageset shares one important feature: whether it uses two disk drives
or 14, each storageset looks like a single storage unit to the host.
You create storage units by combining disk drives into storagesets such as
stripesets, RAIDsets, and mirrorsets, or by presenting them to the host as
single-disk units (Figure 2–2).
Figure 2-2. Units created from storagesets, partitions, and disk drives
RAID Array Controller 2-5
I
I
Stripesets (RAID 0) combine disk drives in serial to increase transfer or
requests rates
Mirrorsets (RAID 1) combine disk drives in parallel to provide a highly
reliable storage unit
I
I
RAID 4 provides striping with a fixed parity drive
RAIDsets (RAID 5) combine disk drives in serial— just like stripesets
— but also store parity data to ensure high reliability
I
Stripe mirrorsets (RAID 0 + 1) combine mirrorsets in serial to provide
the highest throughput and availability of any storage unit
Table 2–1 lists the features of the RAID 3000 controller.
Table 2-1
Controller Specifications
Item
Specifications
Environmental monitoring
Processor
High availability fault bus support via EMU
40 MHz, 32 bit LR33310 RISC CPU
Two, Wide, differential UltraSCSI channels
Two RS232 serial ports
System bus interface
Configuration
RAID levels supported
Drive channels supported
Number of logical drives (LUN’s)
0, 1, 0+1, 4, 5
Two, Wide, UltraSCSI single-ended channels
Up to 30 RAID sets, and up to 16 redundancy
groups (LUNs) per RAID set
SCSI channels
Two, UltraSCSI, 16-bit, single-ended
20 blocks/disk (10240 bytes)
Metadata
Largest allowable disk/RAID set/LUN
Non-RAID device support
Drives supported
Two, 32 blocks (approximately 2.2 petabytes)
Disk drives (JBOD)
StorageWorks 2, 4, 18, and 36 GB SCSI and
UltraSCSI drives.
Drive reconstruct
Disk hot plug
Automatic with hot or warm spares
Yes
Disk hot spare (spinning)
Yes, global hot spare
continued
2-6 RAID Array 3000 Pedestal Storage Subsystem Hardware User’s Guide
Table 2-1
Controller Specifications continued
Item
Disk warm spare (not spinning)
Redundant power supplies
Redundant controllers
Specifications
Yes, global warm spare
Yes
Yes
Controller failover
Yes, automatic
Controller hot spare
Yes (Active/Passive mode)
Controller hot plug
Yes
Cluster support
Yes, single (SCSI) bus cluster
Maximum number of units presented to host
Maximum host port transfer speed
Command queuing
64
20 MHz
Yes, 64 commands (host and disk SCSI
channels)
Heterogeneous multi-host support
Mixed drive types
Yes
Yes
Configurable reconstruct time
Stripe size (chunk size)
Write through cache
Write back cache
Yes
Variable
Yes, user selectable (optional)
Yes, user selectable (default)
Write on top
Yes
Yes
Write gathering
Battery backup for cache
Yes, Pedestal Uninterruptable Power Supply
(UPS)
Boot capability
Bootable from RAID set (system-dependent)
Two
Number of controllers /system
Cache support
Up to 64 MB (using two 32 MB industry
standard, 72-pin, 36-bit, 60 ns SIMMS)
FCC rating
Class B
continued
RAID Array Controller 2-7
Table 2-1
Controller Specifications continued
Item
Specifications
Environmental
Temperature
41ºF to 122ºF (5ºC to 50ºC) operating,
-40ºF to 140ºF (-40ºC to +60ºC)
non-operating
Relative humidity
Physical size
10% to 95% non-condensing (operating), 5%
to 90%, non-condensing (non-operating)
8.55 in (21.7 cm) deep, 5.03 in wide, 1.6 in
(4 cm) high
Power requirements
5 VDC @ 3 A, peak; - 12 VDC @ 1 A, peak
Controller Reset and LED Indicators
Figure 2–3 illustrates the front panel of the controller. All LEDs are numbered
from left to right. The reset button (LED 0) flashes green about once every
second (heartbeat) to indicate that the controller is operating normally. LEDs 1
through 4-display host and disk channel activity (amber). LED 5 (normally
off) displays red during a controller failure. The LED/Reset switch interface is
defined in Table 2–2.
Table 2-2
LED/Reset Switch Interface
LED #
Name
0
1
2
3
4
5
Heart beat controller reset switch (green)
Host channel 0 activity LED (amber)
Host channel 1 activity LED (amber)
Disk channel 0 activity LED (amber)
Disk channel 1 activity LED (amber)
Fault LED (red)
2-8 RAID Array 3000 Pedestal Storage Subsystem Hardware User’s Guide
Figure 2-3 shows the front panel of the controller.
Figure 2-3. Controller front panel
Flexible RAID Set Configuration
In addition to its flexible hardware design, the controller’s firmware offers the
user the flexibility to configure RAID sets in several different ways:
I
RAID sets can comprise drives from any drive channel and SCSI ID.
I
A RAID set can contain all the drives connected to the controller, a
single drive, or any number of drives in between.
I
The controller supports RAID Levels 0, 1, 0+1, 4, and 5. It also supports
JBOD allowing you to connect standalone disk drives (such as a system
disk) to the controller without making them members of a RAID set.
RAID Array Controller 2-9
I
I
Each RAID set can be partitioned into smaller redundancy groups.
The controller’s host LUN Mapping feature makes it possible to map
RAID sets differently to each host port. You make the same redundancy
group appear on different LUNs to different hosts, or make a
redundancy group visible to one host but not to another.
I
Any drive may be designated as a hot or warm spare. Spares are global,
meaning that in the event of a drive failure, the controller will search for
the first available spare on any channel or SCSI ID and automatically
begin rebuilding the failed drive’s data.
Performance Enhancements
The controller employs a number of techniques to achieve as much
performance as possible from its design.
Custom Components
To increase performance and reliability, the controller’s core functions have
been encapsulated in four custom Application Specific Integrated Circuits
(ASIC) components as follows:
I
XOR ASIC: Used in the exclusive -or parity calculations employed by
RAID levels 4 and 5.
I
I
DMA ASIC: Controls the data path hardware for the various I/O ports
CPU Interface ASIC: Supports the controller’s MIPS R3000 RISC
central processing unit.
I
Memory Controller ASIC: Controls the memory system and supports
data movement on the internal bus at a maximum burst rate of 80 Mb/s
and a maximum sustainable rate of 60 Mb/s.
2-10 RAID Array 3000 Pedestal Storage Subsystem Hardware User’s Guide
Efficient Write and Read Algorithms
Standard RAID write operations that involve parity, such as those in RAID
levels 4 and 5, require multiple, time-consuming steps:
1. Read data from the parity drive.
2. Read existing data from the target data drives.
3. Exclusive-or the old parity, old data, and new data to generate new
parity data.
4. Write the new parity data to the parity drive.
5. Write the new data to the target data drives.
The controller uses several techniques to streamline write operations and
significantly improve performance. All the techniques use the controller’s on-
board cache, which can contain up to 64 MB of memory in the form of
standard 72-pin, 60 ns SIMMs.
NOTE: The controller will not operate without at least one 4 MB SIMM installed in its
cache. Also, it will not operate without either a backup or a UPS connected to the
controller. Without a backup, data stored in the cache, but not yet written to the disk
drives, would be lost in the event of a power interruption.
Write-Back Caching
When the host sends data to be written to a redundancy group, the controller
stores the data in its cache and immediately reports to the host that it has
completed the write. The controller eventually writes the data to the disk
drives when the write can be done most efficiently, or when the controller
must flush the cache to make room for other data or to prepare for a shutdown.
Write-back caching makes the host more responsive to the user, since the host
does not have to wait for a lengthy RAID write before proceeding to another
task.
RAID Array Controller 2-11
Write Gathering
The controller will attempt to consolidate multiple writes destined for
contiguous blocks and then write the entire data block in one operation. The
controller stores the data in cache until it performs the write. Ideally, the
controller will wait until it has gathered enough data to fill an entire stripe.
This action enables the controller to avoid reading from the parity and data
drives before making the write. All the controller has to do is calculate parity
from the data it already has in its cache, then write the data and parity to the
drives. Even if the controller cannot accumulate enough data to fill a stripe, the
consolidation of small writes can reduce the number of read/write operations
that must take place.
Write On Top
If the host commands that data be written to disk, and data for that address is
pending in the controller’s cache, the controller writes the new data on top of
the old in the cache. Only the new data is eventually written to the disk drives.
2-12 RAID Array 3000 Pedestal Storage Subsystem Hardware User’s Guide
RAID Levels Supported
The RAID Array 3000 controller supports the following RAID levels:
Table 2-3
RAID Levels Supported
RAID Level
Description
0
1
Striping without parity
Mirroring
0+1
4
Striping and mirroring
Striping with fixed parity drive
Striping with floating parity drive
Just a Bunch of Drives
5
JBOD
NOTE: The controller stripes data in multi-block chunk sizes. Also, the controller does not
support RAID level 3 or 0 with a one-block chunk size.
There are some restrictions you must adhere to when creating a RAID set on
the RAID 3000 pedestal. The minimum and maximum number of drives
required to support each RAID level are listed in Table 2–4.
Table 2-4
Pedestal RAID Set Restrictions
RAID Level
Min. No.* of Drives
Max. No.* of Drives
JBOD
1
2
2
4
3
3
1
0
1
14
14
14
14
14
0+1
4
5
* Must be an even number.
RAID Array Controller 2-13
RAID 0
RAID 0 breaks up data into smaller chunks and writes each chunk to a
different drive in the array. The size of each chunk is determined by the
controller’s chunk size parameter, which you set in the course of creating a
RAID set.
The advantage of RAID 0 is its high bandwidth. By breaking up a large block
of data into smaller chunks, the controller can use multiple drive channels to
write the chunks to the disk drives. Furthermore, RAID 0 involves no parity
calculations to complicate the write operation. Likewise, a RAID 0 read
operation employs multiple drives to assemble a single, large data block. This
makes RAID 0 ideal for applications such as graphics, video, and imaging that
involve the writing and reading of large, sequential blocks.
CAUTION: The lack of parity means that a RAID 0-disk array offers absolutely
no redundancy and thus cannot recover from a drive failure.
2-14 RAID Array 3000 Pedestal Storage Subsystem Hardware User’s Guide
Figure 2–4 shows a diagram of a RAID 0 write.
Figure 2-4. RAID 0 write
|