HP INTEGRITY RX3600 User Manual

HP Integrity rx3600User Service GuideHP Part Number: AB463-9003CPublished: November 2007Edition: Third edition

Replacing the I/O VRM...233Removing and

DRVCFG ScreensAdapter List ScreenThe Adapter List screen displays when the configuration utility is first started. This screendisplays a scrolling lis

Use the arrow keys to select RAID Properties, and press Enter to view the Select New ArrayType screen.To access the following screens, use the arrow k

Figure 3-24 Select New Array Type ScreenSelect New Array Type ScreenThe Select New Array Type screen enables you to view an existing array or create a

spare per IM array is permitted. A hot spare is not required in an IM.You can specify a hot spare at array creation, or any time aftercreation, provid

You can perform the following actions on the View Array screen:• To view the next array, press N.• To create a new array, press C.Array Displays the n

Wrg Type Device is not compatible for use as part of an IMarray.Too Small Disk is too small to mirror existing data.Max Dsks Maximum # of disks allowe

Delete ArrayTo perform the deletion of the currently displayed IM array, press Enter on Delete Array. Thescreen prompts you to ask if you want to perf

CFGGEN OperationThe cfggen command is not case sensitive. You can enter cfggen commands and parametersin uppercase, lowercase, or a mixture of the two

to a volume that only uses 9 GB of capacity on each disk drive, the remaining 27 GB of capacityon the disk drive is unusable.The disk identified by th

than or equal to the capacity of the smallest disk in the logical drive. An easy way to verify thisis to use the DISPLAY command.CAUTION: See “Rules f

Processor Upgrades...279Upgra

6. Power on the enclosure.7. Power on the server.SAS Cable Part NumbersIf you require additional cables, order them by the option kit number listed in

• LIST• UPDATE• UPDATE all• HELP or ?ListUse LIST to display all detected Smart Array controllers along with the active firmware versions.fs0: > sa

The example below shows the command to update all controllers for which the firmware imagefile applies. The controllers for which the firmware image i

EBSU UtilityThe EFI-based Setup Utility (EBSU) provides an easy-to-use interface for flashing firmware,partitioning the hard disk, installing diagnost

7. Use the down arrow key to scroll down to the Smart Array Controller item in the list.8. Press Enter to display detailed information about the devic

NOTE: The utility does not allow you to flash the firmware if the installed version is thesame or higher than the version on the Smart Setup media.10.

Table 3-17 ACU and ORCA Supported Features and Procedures (continued)ORCAACUSupported ProceduresYesYesCreation and deletion of arrays and logical driv

2. Use the Arrow keys, Spacebar, and Tab to navigate around the screen and set up the logicaldrive, including an online spare drive if one is required

server. Error messages are displayed on local and remote consoles. System history (console,event, and history logs) is available through the iLO 2 MP,

EFI Menu is Not AvailableIf you cannot access the EFI from either the main disk partition or the CD, use the following toolsto help solve the problem:

baud...322

4. Replace the hard drive backplane.5. Replace the SAS core I/O card.Console ProblemsConsole problems during installations can be caused by faulty int

keys created by the TPM encapsulate system application encryption keys to provide an additionallayer of security for sensitive system data.The fundame

122

4 Booting and Shutting Down the Operating SystemThis chapter covers procedures for booting and shutting down operating systems on entry classHP Integr

• To set Windows boot options see “Adding Microsoft Windows to the Boot Options List”(page 132)• To set Linux boot options see “Adding Linux to the Bo

NOTE: The operating system installer automatically adds an entry to the boot options list.To add an HP-UX boot option when logged in to HP-UX, use the

1. Access the EFI Boot Manager menu for the system on which you want to boot HP-UX.a. Log in to the iLO 2 MP and enter CO to select the system console

Shell> fs0:fs0:\> hpux(c) Copyright 1990-2002, Hewlett Packard Company.All rights reservedHP-UX Boot Loader for IA64 Revision 1.723Press Any Ke

loading symbol tableloading System Directory(boot.sys) to MFS...loading MFSFILES Directory(bootfs) to MFS...Launching /stand/vmunixSIZE: Text:2595

2. Issue the shutdown command with the appropriate command-line options.The command-line options you specify dictate the way in which HP-UX shuts down

Select Active Console Output Devices...346Select Active Console Inpu

bcfg boot mv #a #b Move the item number specified by #a to the positionspecified by #b in the boot list.bcfg boot add # file.efi "Description&quo

1. Access the EFI Shell environment for the system on which you want to boot HP OpenVMS.a. Log in to the iLO 2 MP and enter CO to select the system co

3. At the OpenVMS DCL command element prompt issue the @SYS$SYSTEM:SHUTDOWNcommand and specify the shutdown options in response to the prompts. For ex

NOTE: You must only initiate this loader from the EFI Boot Menu, not from the EFI Shell.3. List the contents of the \EFI\Microsoft\WINNT50 directory t

4. Once Windows begins loading, wait for the Special Administration Console (SAC) to becomeavailable.The SAC interface provides a text-based administr

See the help shutdown Windows command for details.To shutdown Windows from the command line, follow these steps:1. Log in to Windows running on the sy

1. Access the EFI Shell.a. Log in to the iLO 2 MP and enter the CO command to access the system console.b. Confirm that you are at the EFI Boot Manage

2. To load the Red Hat Enterprise Linux operating system at the EFI Boot Manager menu,select its entry from the list of boot options.3. Selecting a Li

4. Allow the ELILO.EFI loader to proceed with booting the SuSE Linux kernel.By default, the ELILO.EFI loader boots the kernel image and options specif

5 TroubleshootingThis chapter provides preferred strategies, procedures, and tools for troubleshooting rx3600server error and fault conditions.This ch

14

NOTE: The Front Panel Health LEDs will be flashing amber with a warning indication, orflashing red with a fault indication.— System Alert on console?—

would prefer to start by examining the logs, you can go directly to the subsection entitled “Errorsand Reading Error Logs” (page 154).Table 5-1 lists

NOTE: The Unit Identifier (UID)/Locator LED has not been included in Table 5-2, because it isnot used directly for troubleshooting rx3600 servers. How

Table 5-3 Basic Entry Class TroubleshootingActionConditionStepNothing is logged for this condition.1. For new server installations, review the install

Table 5-3 Basic Entry Class Troubleshooting (continued)ActionConditionStepA warning or critical failure was detected and logged, while bootingor runni

Table 5-3 Basic Entry Class Troubleshooting (continued)ActionConditionStepNothing may be logged for this condition (system health is off,internal heal

Table 5-4 Advanced Entry Class TroubleshootingActionSymptom/ConditionStepSystem event logging has stopped due to a presumed BMCmalfunction (system hea

Table 5-4 Advanced Entry Class Troubleshooting (continued)ActionSymptom/ConditionStepFront panel LEDs indicate that the server detected a fatal error

The health LEDs are driven by the BMC; the System Power LED is driven solely by hardware.BMC code determines the state of the Internal and External He

Table 5-7 Internal Health LED StatesStateFlash RateLED ColorHealth is good on all internal CRUs or system is off.OffOffHealth good on all internal CRU

List of Figures1-1 I/O Subsystem Block Diagram...26

Table 5-10 VFP System Health DescriptionStateLED ColorNone.OffThe OS is booting or running.GreenWarning or critical fault. Check the logs for details.

Table 5-11 Diagnostics Panel LED StatesDefinitionFlash RateLED ColorCRU health is assumed good.OffOffCRU health last known to be bad.SteadyAmberCustom

information necessary to perform a particular task. You must have theappropriate license to run expert tools.Online Support Tool AvailabilityOnline di

Table 5-13 Offline Support Tools List (continued)Functional AreaOffline ToolDisk test utility (non-destructive)DISKUTILData copy utilityCOPYUTILDisk e

Hardware monitors are available on the HP-UX OE to monitor the following components:• Chassis, fans, and environment• CPU monitor• UPS monitor• FC hub

NOTE: Your terminal console must be able to connect to the iLO 2 MP.1. Login to the console with proper username and password.NOTE: The default operat

Figure 5-3 rx3600 with PCI/PCI-X I/O System Block Diagram156 Troubleshooting

Figure 5-4 rx3600 with PCI/PCI-X/PCIe I/O System Block DiagramThere are two types of CRUs in the rx3600 server: externally accessible CRUs (eCRUs) and

• FP and Diagnostic LED board• HBAs (optional)• I/O VRM• Cooling Fans 1-31• Midplane board• Interconnect boardSystem Build-Up Troubleshooting Procedur

Each physical CPU core contains logic to support two physical threads. This results in up to eightphysical threads, or the equivalent of 8 logical CPU

6-3 Removing and Replacing the Top Cover...1826-4 Removing and Repla

Table 5-15 Processor Events that Light Diagnostic Panel LEDs (continued)NotesSourceCauseIPMI EventDiagnosticLEDsPower Pod voltageis out of range ( too

in both memory cells 0 and 1. A 24 DIMM memory carrier provides two 12-DIMM memoryboards that hold four, eight, or twelve DIMMs in both memory cells 0

Table 5-17 Memory Subsystem Events that Light Diagnostic Panel LEDsNotesSourceCauseIPMI EventsDiagnosticLEDsA voltage on thememory expander isout of r

Table 5-18 Memory Subsystem Events that May Light Diagnostic Panel LEDs (continued)NotesSourceCauseIPMI EventsDiagnosticLEDs24 or 48 slot memorycarrie

Figure 5-6 24-DIMM Memory Carrier Board Slot IDs0C1C2C0D1D2D0A1A2A0B1B2BTroubleshooting rx3600 SBAThe rx3600 server shares a common I/O backplane that

Power supply CRU failures are identified visually by a single green LED that is turned off whenone or both of the power supplies fail. Power supply fa

NOTE: For high availability and safety reasons, the power LED is run directly from the powerrails, not under firmware control.Power Supply Power LEDTh

Table 5-22 Cooling Subsystem Events that Light Diagnostic Panel LEDsNotesSourceCauseIPMI EventsDiagnosticLEDsReplace the fan.BMCThe fan has failed ori

Table 5-24 I/O Card Events that May Light Diagnostic Panel LEDsNotesSourceCauseIPMI EventsDiagnosticLEDsO/S does not boot. Thesystem displays thefollo

Table 5-24 I/O Card Events that May Light Diagnostic Panel LEDs (continued)NotesSourceCauseIPMI EventsDiagnosticLEDsSFWPCIe link failed to trainType E

List of Tables1 Publishing History Details...

Table 5-26 PCI/PCI-X/PCIe Slot-Rope-ACPI Paths (continued)Logical ACPI PathOLARDPhysical Rope#Physical Slot #Acpi(HWP0002,PNP0A03,0)/Pci(4|*)No0XXCore

Press and release the reset button quickly to soft reset the iLO 2 MP. Press the reset button andhold it for more than four seconds to hard reset the

4. If the activity LED on a disk drive does not illuminate during the boot cycle, the disk drivemay be installed incorrectly or its lightpipes may be

BootingTable 5-31 displays the normal boot process, as reflected in changes to front panel LED states.Table 5-31 Normal Boot Process LED StatesSystem

FirmwareThe system has three sets of firmware installed:• System firmware• BMC firmware• iLO 2 MP firmwareAll firmware must be from the same release.

integrated remote console feature for redirecting the VGA is only supported on the WindowsOS.For instance, by default HP-UX is configured to use text/

Online SupportTo contact HP Customer Support online, see the Worldwide Limited Warranty and TechnicalSupportGuide or visit us at http://www.hp.com/go/

6 Removing and Replacing Server ComponentsThis chapter describes safety information, required service tools, accessing the server, and theremoval and

Safety InformationUse care to prevent injury and equipment damage removing and replacing server components.Voltages can be present within the server.

Hot-Pluggable ComponentsA component is defined as hot-pluggable if you can remove it from the chassis while the serverremains operational. Software in

5-17 Memory Subsystem Events that Light Diagnostic Panel LEDs...1625-18 Memory Subsystem Events that M

http://h18004.www1.hp.com/products/servers/proliantstorage/bcs-rackandpower/information_library.htmlWARNING! Ensure that all anti tip features are emp

Figure 6-2 Server in Pedestal Kit21Pedestal Kit FeetFinger GripRemoving and Replacing the Top CoverAccess to internal components require moving the lo

NOTE: The cover release lever also disengages the memory carrier assembly cover forremoval.You can have the memory carrier assembly cover in place whi

NOTE: When the memory carrier assembly cover is open or removed, the chassis fan unitsincrease to high speed to assist cooling. When the top cover is

1. Position the cover onto the opening above the memory carrier assembly.2. Slide the cover toward the right side of the server until it is flush with

4. Pull the fan straight up and out of the chassis.CAUTION: To prevent server components from overheating, replace the fan within 20seconds. Failure t

When the fan is functioning normally, the LED is off.•• If the fan fails, the LED is lit.3. Replace the server top cover. See “Replacing the Top Cover

Figure 6-6 Removing and Replacing a Hot-Swappable Power Supply P0 P1Rear Chassis ViewReplacing a Hot-Swappable Power SupplyTo replace a hot-swappable

Removing and Replacing a Hot-Swappable Disk Drive FillerDisk drive fillers are installed for all slots that do not contain a disk drive.IMPORTANT: For

2. Pull gently until the hot-pluggable disk drive slides out of the chassis.Figure 6-7 Removing and Replacing a Hot-Pluggable Disk DriveFront chassis

List of Examples6-1 Enabling the TPM...

8th drive load in bay 1CAUTION: Drives are loaded in the factory, starting with number 8, working from right to leftand bottom to top. If you have nev

by preventing inadvertent contact between cards during the replacement, addition, or removalof a card.WARNING! Ensure that the system is powered off a

Figure 6-9 PCI/PCI-X/PCIe Card Divider Removal and ReplacementCard Divider Locking TabsCard DividerHandleFront Of ChassisRear OfChassisReplacing a PCI

• “Online Replacement (OLR)” (page 199)Describes the replacement of a PCI/PCI-X/PCIe card without powering down the server.This action requires suspen

2Slot 210Slot 106Slot 67Slot 73Slot 311Core I/O Board Slot1284PCI/PCI-X/PCIe CardDividersSlot 8Slot 4PCI/PCI-X/PCIe ConfigurationsThis section contain

Table 6-1 PCI/PCI-X I/O Paths (continued)EFI Device PathHP-UX Device PathLocation(asviewedfromrear ofchassis)Functionwith PathSlotAcpi(HWP0002,700)/Pc

Table 6-1 PCI/PCI-X I/O Paths (continued)EFI Device PathHP-UX Device PathLocation(asviewedfromrear ofchassis)Functionwith PathSlotAcpi(HWP0002,0)/Pci(

Table 6-2 PCI/PCI-X/PCIe I/O PathsEFI Device PathHP-UX DevicePathLocation asviewed fromrear of chassisFunctionAssociated withPathSlotAcpi(HWP0002,PNP0

1. If there is a PCI-X 66 MHz card in slot 7, and you hot-plug a PCI 33 MHz card into slot 8,the operation fails. The new PCI 33 MHz card does not ini

3. Select an empty slot that is appropriate for the card you are installing. See “PCI/PCI-X/PCIeConfigurations” (page 194) for more information.CAUTIO

© Copyright 2007 Hewlett-Packard Development Company, L.PLegal NoticesThe information contained herein is subject to change without notice. The only w

20

3. Deactivate the PCI/PCI-X/PCIe card and slot.a. Press the red attention button located on the MRL of the appropriate slot, and the powerLED starts t

Removing a PCI/PCI-X/PCIe Card OfflineObserve the following warning and cautions before performing an offline removal of aPCI/PCI-X/PCIe card.WARNING!

6. Remove the PCI/PCI-X/PCIe bulkhead filler.7. Insert the PCI/PCI-X/PCIe card into the empty slot, and use firm, even pressure to seat thecard in the

Figure 6-11 DVD Drive Removal and ReplacementDVD ReleaseHoleFront Chassis ViewReplacing the DVD DriveTo replace a DVD drive, follow these steps:1. Ins

WARNING! Ensure that the system is powered off and all power sources have been disconnectedfrom the server prior to performing this procedure.Voltages

NOTE: The extraction handles latch into the open position with an audible click.6. Pull the extraction handles to lift the memory carrier assembly out

NOTE: Assembly side 0 is on the left, and assembly side 1 is on the right as viewed fromthe front of the chassis.3. Slide the memory carrier assembly

NOTE: To avoid damage to the memory carrier extraction handles, HP recommendsrotating the handles inward and snapping them into the locked position wh

Figure 6-14 shows the memory carrier with the side cover removed.Figure 6-14 Memory Carrier Assembly with Side Cover Removed4-DIMM MemoryRetaining Slo

Table 6-5 Supported Memory ConfigurationsMaximum MemoryConfigurationMinimum MemoryConfigurationMemory Boards InstalledMemory Carrier Type32 GB (four p

About This DocumentThis document describes how to troubleshoot and diagnose server problems, and remove andreplace server components for the HP Integr

Figure 6-15 8-DIMM Memory Carrier Board Slot IDs0A1A0B1B24-DIMM Memory Carrier Load Order The 24-DIMM memory carrier has two sides labeledside 0 and s

Figure 6-16 24-DIMM Memory Carrier Board Slot IDs0C1C2C0D1D2D0A1A2A0B1B2BMemory Loading Rules and GuidelinesUse the following rules and guidelines whe

IMPORTANT: The number in parenthesis indicates the order in which the quads are loaded.Table 6-7 24-DIMM Memory Carrier Loading ExamplesMemory Carrier

NOTE: To avoid damage to the memory carrier extraction handles, HP recommendsrotating the handles inward and snapping them into the locked position wh

8. Install the DIMM (Figure 6-17).a. Align the DIMM with the correct slot located on the memory board, and align the keyin the connector with the notc

Removing and Replacing the Front BezelThe front bezel provides server control and port access, and LED interfaces. You must poweroff the server to rem

Figure 6-18 Removing and Replacing the Front BezelScrew LocationsPlastic Server LabelScrew LocationsFront BezelReplacing the Front BezelTo replace the

Removing and Replacing the Processor Board AssemblyThe processor board assembly holds one or two dual-core Itanium processors, it is located beneathth

Figure 6-19 Removing the Processor Board AssemblyProcessor Board AssemblyProcessor BoardProcessor Board AssemblyFront Chassis ViewAccess DoorAssembly

If the server has fewer than the maximum number of dual-core processors installed, install theadditional processor in the appropriate slot.WARNING! En

Typographic ConventionsThis document uses the following conventions:audit(5) An HP-UX manpage. In this example, audit is the name and 5 is the section

Figure 6-20 Processor Board AssemblyProcessor cageHandleProcessor CageProcessor Cage Closure RotationModule 1Module 0Front of Assembly6. Open the proc

10. Protect the processor from damage.a. Install the protective pin cover on the processor connectors to shield the connector pins.b. Place the dual-c

Figure 6-22 Processor Alignment Posts and Lock/Unlock MechanismLock/UnlockMechanismAlignment Post LocationsFigure 6-23 shows the processor socket lock

Figure 6-23 Processor Alignment Holes and Lock/Unlock MechanismLock/UnlockMechanismAlignment HolesInstalling a Dual-Core ProcessorTo install a dual-co

3. Remove the memory carrier assembly cover. See “Removing the Memory Carrier AssemblyCover” (page 183).NOTE: You do not need to fully remove the top

16. Close the processor cage (Figure 6-20 (page 220)).a. Grasp the processor cage handle and rotate the cage closure inward toward the rear ofthe asse

3. Power off the server and disconnect the power cables. See “Powering Off the Server”(page 95).CAUTION: The removal and replacement of the I/O board

Figure 6-24 I/O Board AssemblyRetention LeversRear Chassis ViewExtraction LeversIn The Unlocked PositionInternal USB CableConnector12. Pull the I/O bo

13. Slide the I/O board assembly all the way out the rear of the chassis (Figure 6-25).NOTE: The I/O board assembly is large. Use care when lifting it

2. Align the I/O board assembly rails with the chassis slots, and slide the assembly into thechassis until it stops against the midplane board socket

Web Site for HP Technical Documentation: http://docs.hp.com This is the main Web sitefor HP technical documentation. This site offers comprehensive in

Removing and Replacing the System BatteryThe system battery is located on the I/O board assembly. Replace the battery with only an identicalor equival

Figure 6-26 Battery Location on I/O Board1234431Core I/O Board Slot System BatteryTPM2I/O VRMReplacing the System Battery1. Insert the replacement bat

Removing and Replacing the I/O Voltage Regulator ModuleThe I/O voltage regulator module (I/O VRM) is a stand alone component located on the I/O boarda

Figure 6-27 Removing and Replacing the I/O VRMI/O VRMCoverI/O VRMRear Of ChassisKnurled ThumbscrewReplacing the I/O VRMTo replace the I/O VRM, follow

The fundamental capabilities of the TPM include:• Platform authentication• Sensitive information protection• Data integrity• System privacyWARNING! En

6. Grasp the TPM by the edges and lift it out of the socket on the I/O board (Figure 6-28).CAUTION: Destroy the TPM after removing it from the server.

Example 6-1 Enabling the TPM1. Access the EFI Shell.2. Enter info sec to display the server security settings on the screen. The TPM is disabledby def

and iLO 2 MP status LEDs. For more detail on the port locations and LEDs, see “Controls, Ports,and LEDs” (page 36).WARNING! Ensure that the system is

3. Reconnect the USB cable to the card.4. Replace the top cover. See “Replacing the Top Cover” (page 182).5. If rack installed, slide the server compl

Figure 6-29 Battery Location on the Core I/O BoardCore I/OBoardBatteryReplacing the Core I/O Board BatteryTo replace the core I/O board battery, follo

24

Slots 1 and 2 are dedicated for the PCI-X core I/O cards. The LAN core I/O card is installed eitherin slot 2 or slot 10 depending on the configuration

4. Reconnect the internal SAS cables to the card.CAUTION: When reconnecting the SAS cables, note the labeling on the channel cables.Both cables and so

3. Replace the top cover. See “Replacing the Top Cover” (page 182).4. If rack installed, slide the server completely into the rack. See “Inserting the

NOTE: The USB cable connector is an RJ45 connector; it is not a typical USB connector.4. Remove the air baffle (Figure 6-33).5. Remove the clear plast

14. Remove the diagnostic panel light guide by squeezing the plastic tabs until they disengagefrom the slots on the board (Figure 6-32).IMPORTANT: Do

Figure 6-31 Display BoardFigure 6-32 Display Board Removal and ReplacementFront of ChassisL-Shaped KeywayL-Shaped KeywayConnector plugs Intointerconne

NOTE: Use the guide pins on the chassis and the L-shaped keyways on the display board tohelp you with the display board replacement procedures.1. Remo

• Thin cables and small connectors (assists with cooling and ease cable management issues)• Increased scalability (expanders enable support for thousa

Figure 6-33 Air Baffle Removal and ReplacementFront of Chassis248 Removing and Replacing Server Components

Figure 6-34 SAS Backplane Board Removal and ReplacementRelease TabSheet Metal BracketSAS Cable ConnectorsConnector Plugs IntoInterconnect BoardReplaci

1 OverviewThe HP Integrity rx3600 server is a high performance, high availability server that provides thefollowing features:• Form factor - 4U rack-

7. Replace the clear plastic cover.8. Replace the top cover. See “Replacing the Top Cover” (page 182).9. If rack installed, slide the server completel

11. Remove the interconnect board air baffle (Figure 6-35).a. Insert your finger into the opening on the interconnect board air baffle and pull upward

Figure 6-36 Interconnect Board Removal and ReplacementInterconnect Board HandleConnector to Display BoardConnector to SAS Backplane BoardConnector toM

8. Replace the DVD drive. See “Replacing the DVD Drive” (page 203).9. Reconnect the USB cable into the connector on the display board (Figure 6-30).10

1. Power off the server and disconnect the power cables. See “Powering Off the Server”(page 95).2. If rack installed, slide the server completely out

Figure 6-37 Midplane BoardReplacing the Midplane BoardTo replace the midplane board, follow these steps:1. Place the midplane board onto the guide pin

10. Replace the SAS disk drives. See “Replacing a Hot-Pluggable Disk Drive” (page 190).11. Replace the display board. See “Replacing the Display Board

A Customer Replaceable Units InformationThis appendix provides the following information for each field replaceable unit:• Manufacturing part number•

Table A-1 Customer Self Repair InformationCommentsDescriptionLevelCodeRequires you to replace these parts under warranty.No technical skills required.

Table A-2 CRU List (continued)Customer SelfRepairExchange PartNumberReplacement PartNumberDescriptionManufacturing PartNumberBYn/a409124-001Battery ca

Wake on LAN Wake on LAN, a hardware feature that enables the remote power on ofcomputers through special network packets, is enabled in core PCI/PCI-X

Table A-2 CRU List (continued)Customer SelfRepairExchange PartNumberReplacement PartNumberDescriptionManufacturing PartNumberAYn/aAB463-2003ADisplay b

B UpgradesThis appendix address the following topics:• “I/O Backplane Upgrade” (page 261)• “Installing Core I/O Cards” (page 268)• “Processor Upgrades

Figure B-1 OS Reinstallation FlowchartRequired Service ToolsService of this server requires one or more of the following tools:• Electrically Conducti

• If installing an assembly that is neither hot-swappable nor hot-pluggable, disconnect thepower cable from the external server power receptacle.WARNI

Table B-2 I/O Backplane Upgrade Checklist (continued)XActionStepPower to the EFI• Verify the serial number and model string data information copiedont

2. Updating the FirmwareIMPORTANT: When performing a firmware upgrade that contains system programmablehardware (FPGA, EFI, PSOC, BMC), you must prope

Back up the current TPM settings. See the HP-UX operating system documentation for moreinformation.TIP: Running the info io command from the EFI shell

10. Power up to EFI. See “Powering On and Powering Off the Server” (page 93) for thisprocedure.a. Verification from EFI1. Respond YES to prompts regar

00 00 02 00 0x1033 0x0035 XX Acpi(HWP0002,PNP0A03,0)/Pci(2|0) 00 00 02 01 0x1033 0x0035 XX Acpi(HWP0002,PNP0A03,0)/Pci(2|

Table B-3 Cable kit part numbers (continued)Part NumberDescriptionType of Cable389662-B21Multi-lane 76-cm (30-in) cableInternal SAS/SATA391330-B21Mult

Figure 1-2 PCI/PCI-X/PCIe I/O Subsystem Block DiagramPORTPorts FromChassis RearPORTPorts FromChassis FrontSingle - RopeDual - RopeSingle - RopeZX1 PCI

6. Close the MRL.a. Rotate the MRL downward 90 degrees.b. Push the edge of the MRL down until it clicks into place on the PCI/PCI-X/PCIe cardbulkhead.

5. Insert the adapter into the slot, and press it firmly into place. The contacts on the adapteredge should be fully seated in the system board connec

6. Close the MRL.a. Rotate the MRL downward 90 degrees.b. Push the edge of the MRL down until it clicks into place on the PCI/PCI-X/PCIe cardbulkhead.

confirm or update the controller firmware, you must know the device file name for the SmartArray Controller.1. Determine the device file for the Smart

3. Update the Smart Array controller firmware by using the sautil command. The sautilcommand syntax for updating Smart Array Controller firmware is:sa

Installing the HP Smart Array P800On HP Integrity rx3600 and rx6600 servers, the HP Smart Array P800 is supported by Windowsand Linux operating system

Procedure B-19 Installing the controller board1. Remove or open the access panel.2. Select the appropriate PCI Express slot (3 or 4).3. Open the MRL.a

server or controller component might be available on the support page of the HP website(http://www.hp.com/support).1. Find the most recent version of

3. Power down the server.CAUTION: In systems that use external data storage, be sure that the server is the first unitto be powered down and the last

Table B-5 SAS cable part numbers (continued)Option kit part numberType of cableApproximate cable length432239-B21Mini SAS 4x to mini SAS 4x6 m (20 ft.

Table 1-1 PCI/PCI-X I/O Rope Groups (continued)Hot Swap /OL*FunctionSpeedBitsPCI BusRope NumbersSlot #YHigh-Speed PCI-X (Public)133 MHz6452, 3 (DualBa

CAUTION: Intel Montvale processors cannot be intermixed with similar Montecito processors.Processor speed and cache size must be identical for all pro

FirmwareBefore upgrading the processor, ensure the server is at the required system firmware level. Checkthe system firmware version by executing the

282

C Core I/O Card UtilitiesThis appendix provides information on core I/O cards that need additional configuration.This appendix addresses the following

1. Insert the HP IPF Offline Diagnostics and Utilities CD in the drive and boot to the EFI Shell.NOTE: You can also download the firmware image file a

Flashing BIOS and EFI Driver on the First ControllerTo update the EFI driver on the first controller, follow these steps:1. At the fsO:\> prompt, e

Using the DRVCFG UtilityThe configuration utility uses several input keys (F1, F2, HOME, END, and so on) that may notbe supported by all terminal emul

of them. Use the arrow keys to select a SAS controller, and press Enter to view and modify theselected SAS controller's properties.You can view a

To access the following screens, use the arrow keys to select the screen, and press Enter on theappropriate field:• RAID Properties• SAS Topology• Adv

Figure C-3 Select New Array Type ScreenSelect New Array Type ScreenThe Select New Array Type screen enables you to view an existing array or create an

the ioconfig mps_optimize [on|off] command from a non-PCIe system, the followingoutput will be displayed:-------------Shell> ioconfig mps_optimizei

Hot Spr Specifies whether a device is the hot spare for an IM array. If hotspare is Yes the device is used as a hot spare for the IM array; if No,the

You can perform the following actions on the View Array screen:• To view the next array, press N.• To create a new array, press C.Array Displays the n

Max Dsks Maximum # of disks allowed for this type of Arrayreached and/or Maximum # of total IM disks on acontroller reached.No SMART Disk doesn't

Status Displays the status of this array.SAS Topology ScreenThe SAS Topology screen presents a view of the adapter's SAS hierarchy, and provides

Figure C-5 SAS Topology Screen - Expander OpenYou can access the Device Properties screen from SAS Topology:• To access the Device Properties screen f

Elapsed Time Displays the total time elapsed since Format or Verify Operationstarted.Percent Complete Graphical status bar display that indicates the

Figure C-6 Advanced Adaptor Properties ScreenYou can perform the following actions from Advanced Device Properties:• To set default values for all ite

IO Timeouts for Sequential Devices Specifies the time (Time in seconds (0-999, 0 meansno-timeout)) which the host uses to timeout I/Os for thefollowin

PHY Properties ScreenThe PHY Properties screen enables you to view and modify PHY specific settings. To access PHYProperties, press Enter on the PHY P

• Running Disparity Errors - Number of dwords with runningdisparity errors that have been received outside of PHY resetsequences, since the last PHY L

Table of ContentsAbout This Document...21Intended

Figure 1-3 8-DIMM Memory Carrier Block DiagramFigure 1-4 is a block diagram of the 24-DIMM memory carrier that shows data, addresses, andcontrols that

CFGGEN OperationCFGGENis not case sensitive. You can enter CFGGENcommands and parameters in uppercase,lowercase, or a mixture of the two. Use the foll

The disk identified by the first SCSI ID on the command line is assigned as the primary diskdrive when creating an IM volume. If the SAS controller is

Syntaxcfggen <controller #> delete [noprompt]Parameters<controller #> A SAS controller number between 0 and 255.[noprompt] Eliminates warn

Device is a Hard disk Enclosure # : 1 Slot # : 5 Target ID

StartSlot : 1Start TargetID : 0Start Bus : 0Logical drive s

STATUSThe STATUS command displays the status of any volume synchronization operation that iscurrently in progress on the controller.Syntaxcfggen <c

DISABLEIRThe DISABLEIR command turns off IR functionality on a SAS controller. To accomplish thedisabling, set the MPI_IOUNITPAGE1_DISABLE_IR bit in t

http://h20000.www2.hp.com/bizsupport/TechSupport/Home.jsp under the specificHP Smart Array Controller product for installation procedures.The latest f

IMPORTANT: Both saupdate.efi and the firmware image file must be located in the samedirectory. If they are not, copy them both to the EFI partition. R

Version: 1.04.12.00(C) Copyright 2004 Hewlett Packard Development Company L.P.*************************************************************Updating co

Figure 1-4 24-DIMM Memory Carrier Block DiagramCoolingThere are three system fans assemblies that cool the server. The fans are redundant, hot-swappab

saupdate ?Error MessagesThe following is a list of error messages under various situations:• When keyword LIST or UPDATE is misspelled or extra parame

4. Select OK and press Enter to continue.5. From the main menu, select Maintain Firmware and press Enter.Figure C-8 EBSU Main Menu6. In the Maintain F

• The version number in the first column (ROM Firmware Version) is the one currentlyinstalled on your system.• The version number in the second column

NOTE: To copy a particular array configuration to several other servers on the same network,use the Array Configuration Replicator (ACR) or the script

ORCA UtilityTo use ORCA, follow these steps:1. Power on the server. POST runs, and any array controllers that are in the server are initializedone at

5. Press Enter to continue. You can now create another logical drive by repeating the previoussteps.NOTE: Newly created logical drives are invisible t

316

D UtilitiesThis appendix describes the utilities that are part of the server. These include the EFI BootManager, and EFI-POSSE.This appendix addresses

point to the file to be loaded. These variables contain application-specific data that is passeddirectly to the EFI application. EFI variables provide

Table D-1 EFI Commands (continued)DefinitionBCH Command Parameters (PA-RISC)BCH CommandEquivalent(PA-RISC)EFI Shell CommandSearch for boot devices[ALL

Figure 1-5 Cooling FansPowerThe server power subsystem is designed to provide high availability with 1+1 power supplyredundancy. Figure 1-6 is a block

Table D-1 EFI Commands (continued)DefinitionBCH Command Parameters (PA-RISC)BCH CommandEquivalent(PA-RISC)EFI Shell CommandRead memory locations scope

Example D-1 help commandShell> helpList of classes of commands:boot -- Booting options and disk-related commandsconfiguration -- Changing

Example D-4 help cpuconfig commandShell> help cpuconfigCPUCONFIG [cpu] [on | off] cpu Specifies which cpu to configure on | off Specifies to

Syntaxbaud <index> <baudrate>Parameters<index> 0 through the total number of UARTS minus one<baudrate> baud rate.Operatio

Example D-6 boottest commandShell> boottest BOOTTEST Settings Default Variable Selftest Setting ------------- --------------------

NOTE: The last remaining configured CPU in a system cannot be deconfigured.Example D-8 cpuconfig commandShell> cpuconfigPROCESSOR INFORMATION

2 S Serial Acpi(HWP0002,0)/Pci(1 1) 3 P VGA Acpi(HWP0002,0)/Pci(4 0)Example D-11 conconfig 2 primary commandTo change primary

Example D-14 ioconfig commandShell> ioconfigDeconfigure or reconfigure IO components or settingsIOCONFIG [fast_init | wol [on | off]]fast_init Spe

Syntaxerrdump [mca | cpe | cmc | init | la | clear]Parametersmca dumps the Machine Check Abort error logcpe dumps the Co

Example D-15 info all commandShell> info allSYSTEM INFORMATIONDate/Time: Oct 31, 2003 22:03:39 (20:03:10:31:22:03:39)Manufacturer: hpProduct Na

Figure 1-6 Power Subsystem Block DiagramSystem POL ConvertersProcessor SideI/O SideBPS(2)Embedded designV1P 5POLV1P 2POLSummitLoopV3P3V3P 3POLV5P 0POL

--- --- --- --- ------ ------ --- ----------- 00 00 01 00 0x1033 0x0035 XX Acpi(HWP0002,0)/Pci(1|0) 00 00 01 01 0x10

*Mac(00306E4C0FF2) Acpi(HWP0002,100)/Pci(2|0)/Mac(00306E4C0FF2)) FIRMWARE INFORMATION Firmware Revision: 1.10 [4341] PAL_A Revision: 7.31/5.37

Example D-16 info cpu commandShell> info cpuPROCESSOR MODULE INFORMATION # of L3 L4 Family/ CPU Logical

Example D-18 info io commandShell> info ioI/O INFORMATIONBOOTABLE DEVICES Order Media Type Path ----- ---------- --------------------------

Example D-19 info boot commandShell> info bootBOOT INFORMATION Monarch CPU: Current Preferred Monarch Monarch Possible Warnings

OperationIf specified with no parameters, monarch displays the Monarch processor for the system.Specifying a processor number alters the preferred Mon

Example D-22 pdt commandShell> pdtPDT Information Last Clear time: PDT has not been cleared Number of total entries in PDT:

Example D-24 sysmode commandShell> sysmodeSystem Mode: NORMALShell> sysmode adminYou are now in admin mode.Shell> sysmode serviceYou are now

1. At the EFI Shell prompt, type the following command to map the parameters for all PCIcards installed in the system:shell> info ioA list of all t

Using the SCSI interface information from this example, the combined information that tellsyou this is a SCSI interface are the following (shown in bo

5. Initialize I/O Expander settings prior to turning on power.6. Set Power Sequencer Order. Set system frequency in Power Sequencer.7. Pulse BMC_PWR_C

Ctrl[30] Primary Standard Error DeviceCtrl[1C] Acpi(HWP0002,700)/Pci(2|0)Ctrl[32] Primary Console Output DeviceCtrl[30] Primary Standard Error DeviceC

NOTE: The EFI driver’s handle values change on every boot.TIP: From this command (drvcfg), record these two pieces of information for each channelof e

PCI Bus, PCI Device, and PCI Function to the Bus #, Dev #, and Fnc # values fromthe info io command.CAUTION: Do not change the value for any of the fo

Using the Boot Option Maintenance MenuThis menu enables you to select console output and input devices as well as various boot options.It contains the

For example:Boot From a File. Select a Volume NO VOLUME LABEL [Acpi(HWP0002,0)/Pci(2|0)/Ata(Primary,Master)/CDROM CD_FORMAT [Acpi(HWP0002,0)/Pci

• Load File EFI Shell: Adds a new instance to the EFI Shell. Load File with the MACaddress adds a network boot option.• Load File with the MAC address

This option displays the file systems that are on your system and lets you browse these filesystems for applications or drivers that are executable. E

Acpi(PNP0501,0)/Uart(9600 N81)/VenMsg(PcAnsi) Acpi(PNP0501,0)/Uart(9600 N81)/VenMsg(Vt100) * Acpi(PNP0501,0)/Uart(9600 N81)/VenMsg(Vt100+) Acpi(

Acpi(HWP0002,700)/Pci(1|1)/Uart(9600 N81)/VenMsg(Vt100) * Acpi(HWP0002,700)/Pci(1|1)/Uart(9600 N81)/VenMsg(Vt100+) Acpi(HWP0002,700)/Pci(1|1)/Uart

of the server’s High Availability (HA), embedded server, and fault management. It also providessystem administrators secure remote management capabili

• Hard drives• Cables• Backplane board• Core I/O cardsThe server can contain up to eight SAS disk drives. The drives have LEDs that indicate activitya

350

IndexSymbols24-DIMM memory carrier assembly, 69, 210 (see memory)(see also memory)block diagram, 31load order, 210removing, 204replacing, 205slot IDs,

Ddamaged equipment, returning, 55defaultpassword, 89user accounts, 89device paths, PCI/PCI-X/PCIe , 196, 197DHCP DNS, using to configure iLO 2 MP LAN,

hot-swappable fan (see fans)hot-swappable power supply (see power supply)HP Eight Port SAS Host Bus Adaptercompleting installation, 270connecting devi

rear panel locations, 41rear panel UID, 44system health, 37UID button, 37light pipes, 172load orderdisk drive, 60, 189, 190memory, 68–70, 209processor

support, 28PCIe MPS optimizeioconfig command, 326pedestal, converting from rack mount, 78pedestal-mount serveraccessing, 180portsfront panel locations

specifications, server, 47static IP addressassigning with ARP ping, 86storage (see mass storage)system abstraction layer (SAL), 35system backup, 265sy

these events helps you diagnose and troubleshoot problems with the server. For more information,see Chapter 5 (page 139).Controls, Ports, and LEDsThis

Table 1-4 Front Panel Controls and LEDsStatusStatesFunctionLEDNo ac powerOffManually powers the serveron and off.Power Button Full power is onGreenSta

Figure 1-9 Front Control Panel LEDsPower Button/LEDUID/Locator InitButtonExternalSystemHealthLEDHealthLEDInternalHealthLEDButton and LEDStorage and Me

1 The drive status LED is blue when you use various software utilities, such as online diagnostics and SAS driveconfiguration tools.Hot-Pluggable Disk

Power Consumption and Cooling...49Physical and Environ

Figure 1-12 Diagnostic Panel Label and LEDsRear PanelThe server rear panel includes communication ports, I/O ports, ac power connectors, and thelocato

Figure 1-13 Rear Panel Control, Port, and LED LocationsAC InputConsole RS232MP LANPort AndReceptaclePower SupplyLEDPCI/PCI-XSAS CoreVGAPortMP StatusLE

NOTE: The Core I/O Board figure is oriented vertically to match the orientation of the core I/Oboard.Figure 1-14 Core I/O Board Controls, Ports, and L

held for at least four seconds. The following values are reset to factory defaults when the buttonis held for at least four seconds:• Serial terminal

Table 1-8 System LAN Link Status and Speed LEDsLink StatusStateLEDActivityBlinking greenLink status Link with no activitySolid greenNo linkOff1000 MbS

a locator used to identify a particular PCI/PCI-X/PCIe slot. Activate the locator functionalityusing software utilities.CAUTION: Private core I/O slot

46

2 System SpecificationsThis chapter provides the system specifications for the HP Integrity rx3600 server.This chapter addresses the following topics:

Dimensions and ValuesTable 2-2 lists the dimensions and values of the HP Integrity rx3600 for a rack- or pedestal-installedconfiguration .Table 2-2 Ra

Table 2-3 System Power Specifications (continued)RatingParameter25 W per socket25 W per socketMaximum per PCI/PCI-X/PCIe Socket1056 W (3603 BTU/hr)109

Installing the Server into a Pedestal Mount...78Connecting the Cables

Table 2-5 Environmental Specifications (system processing unit with hard disk)ValueParameter+5˚ C to +35˚ C (+41˚ F to +95˚ F)Operating temperature- 4

1 Derate maximum dry bulb temperature 1oC/300 m above 900 m.2 m3/hr=1.7 x CFMPhysical and Environmental Specifications 51

52

3 Installing the SystemThis chapter addresses the following topics• “Safety Information” (page 53)• “Installation Sequence and Checklist” (page 54)• “

Installation Sequence and ChecklistTable 3-1 lists the server installation steps. Follow these steps in sequence to install the server.Table 3-1 Insta

Inspecting the Shipping Containers for DamageHP shipping containers protect their contents under normal shipping conditions. After theequipment arrive

Installing Additional ComponentsThis section describes how to install components into the server that are not factory integrated.Most servers are pre-

Figure 3-1 Removing and Replacing the Top CoverReplacing the Top CoverNOTE: Always replace the memory carrier assembly cover before replacing the top

Figure 3-2 Removing and Replacing the Memory Carrier Assembly CoverReplacing the Memory Carrier Assembly CoverTo replace the memory carrier assembly c

supply is identified as P0, and the second hot-swappable power supply is identified as P1(Figure 3-3).CAUTION: When a second power supply is not used,

Rules for creating IM volumes and hot spare disks...107CFGGEN Commands...

IMPORTANT: For cooling purposes, always leave disk drive fillers in slots that do not containa disk drive.Removing a Hot-Swappable Disk Drive FillerTo

NOTE: Save the disk drive filler for future use. For cooling purposes, always place diskdrive fillers in slots that do not contain a disk drive.3. Ins

Installing a PCI/PCI-X/PCIe CardFigure 3-6 shows the PCI/PCI-X/PCIe slot identification and card divider locations.NOTE: Slots one through eight are f

PCI/PCI-X IOBPThe following describes configuration requirements for slots one through ten on the PCI/PCI-XI/O backplane:• PCI-X slots 1 and 2 are res

NOTE: If the server is rebooted in the new configuration, both cards initialize to run atPCI 33 MHz. This is because the system firmware can only chan

5. Insert the PCI/PCI-X/PCIe card into the empty slot and exert firm, even pressure to seat thecard in the slot.CAUTION: Ensure that you fully seat th

1. Unlatch the cover release lever on the top cover and remove the memory carrier assemblycover. See “Removing the Memory Carrier Assembly Cover” (pag

NOTE: Assembly side 0 is on the left, and assembly side 1 is on the right as viewed fromthe front of the chassis.3. Slide the memory carrier assembly

Memory Installation ConventionsBefore installing memory, read and understand the following memory installation conventions:• Supported DIMM sizes and

Table 3-5 8-DIMM Memory Carrier Load OrderSlot IDMemory Carrier SidePair Number0A; 0BSide 010A; 0BSide 121A; 1BSide 031A; 1BSide 14The DIMM slot IDS a

Booting HP OpenVMS from the EFI Shell...130Shutting Down HP OpenVMS...

Figure 3-10 24-DIMM Memory Carrier Board Slot IDsMemory Loading Rules and GuidelinesUse the following rules and guidelines when installing memory:• In

NOTE: The number in parenthesis indicates the order in which the quads are loaded.Table 3-6 24-DIMM Memory Carrier Loading ExamplesMemory Carrier Side

NOTE: To avoid damage to the handles, HP recommends rotating the handles inward andsnapping them into place when servicing the system DIMMs or any tim

7. Replace the memory carrier assembly side cover.a. Insert the side cover tabs into the retaining slots at the base of the assembly (Figure 3-8).b. I

Figure 3-12 Removing the Processor Board AssemblyReplacing the Processor Board AssemblyTo replace the processor board assembly, follow these steps:1.

The server can contain one or two dual-core processors that provide the following configurationoptions:• 1P/2C (One processor/two cores)• 2P/4C (Two p

4. Open the processor cage (Figure 3-13).a. Grasp the processor cage handle and rotate the handle upward.b. Use the handle to rotate the cage closure

17. Replace the memory carrier assembly cover and latch the top cover release lever closed. See“Replacing the Memory Carrier Assembly Cover” (page 58)

Installing the Server into a Rack or Pedestal MountThis section provides instructions on how to install the server into a rack or a pedestal mount.Thi

AC Input PowerThe server can receive ac input from two different ac power sources. If two separate powersources are available, you can plug the server

Memory DIMM Load Order...161Memory Subsystem Behavior

Applying Standby Power to the ServerTo apply standby power to the server, follow these steps:IMPORTANT: If the server has one BPS, plug the power cabl

This section addresses the following topics:• “Overview” (page 81)• “Setup Checklist” (page 82)• “Console Setup Flowchart” (page 82)• “Preparation” (p

1IMPORTANT: Windows 2003 Server places the video controller into a non-standard resolution with a refresh rateof 55Hz. Some LCD monitors are not capab

Figure 3-17 Console Setup FlowchartPreparationThere are several tasks to perform before you can configure the iLO 2 MP LAN.• Determine the physical ac

LAN drop, IP address, and networking information from that of the port used by the operatingsystem.Figure 3-18 shows the server rear ports.Figure 3-18

Table 3-11 Physical Connection MatrixRequired Connection ComponentsConnection Method1. Host console2. RS-232 serial port DB-9F to DB-9F cable3. Emulat

• DHCP must be enabled (DHCP is enabled by default).• You are using a DHCP server that provides the domain name.• The primary DNS server accepts dynam

NOTE: ARP Ping operational issues:• The PC and the server must be on the same physical subnet.• When a new server is first booted, DHCP is automatical

ping 192.0.2.17. Use the IP address to connect to the iLO 2 MP LAN.8. Use Web or telnet access to connect to the iLO 2 MP from a host on the local sub

8. Use the LC command to disable DHCP.a. From the LC command menu, type D and press Enter.b. Follow the instructions on the screen to change the DHCP

Removing and Replacing a Hot-Swappable Power Supply...186Power Supply Loading Guidelines..

Login and password are case sensitive.TIP: For security reasons, HP strongly recommends you modify the default settings during theinitial login sessio

Accessing the Host ConsoleThis section provides information on the different methods of accessing the host console of anHP Integrity server.This secti

3. Click Sign In. The Status Summary page (Figure 3-20) displays after login.Figure 3-20 Status Summary PageFunction TabsNavigation BarDisplay Screen1

Accessing the Host Console With vKVM - Integrated Remote ConsoleFor information on how to access the host console using the vKVM feature through the I

Table 3-14 Power StatesDC VoltageAppliedAC VoltageAppliedPowered On With the iLO 2 MP PCCommand; or Front Panel Power ButtonPressedPower CablePlugged

Figure 3-21 rx3600 Power ButtonPower Button3. Start the operating system. For more information see the operating system documentation.Powering Off the

• “Integrated RAID” (page 96)• “HP 8 Internal Port SAS HBA (SAS Controller)” (page 96)• “MPTUTIL Utility” (page 96)• “DRVCFG Utility” (page 98)• “CFGG

1. Insert the HP IPF Offline Diagnostics and Utilities CD in the drive and boot to the EFI Shell.NOTE: You can also download the firmware image file a

running from flash and not memory. Operational state is needed to do everything else providedin the utility.Flashing BIOS and EFI Driver on the First

2. Type drvcfg -s and press Enter.Using the DRVCFG UtilityThe configuration utility uses several input keys (F1, F2, HOME, END, and so on) that may no