Tag Archives: Clariion

How to configure a VMware ESX / ESXi host with a QLogic HBA to boot from SAN in a CLARiiON environment

How to configure a VMware ESX / ESXi host with a QLogic HBA to boot from SAN in a CLARiiON environment

Solution:

This procedure explains how to configure the QLogic HBA to boot ESX/ESXi from SAN. The procedure involves enabling the QLogic HBA BIOS, enabling the selectable boot, and selecting the boot LUN.

Procedure:

1. While booting the server, press Ctrl+Q to enter the Fast!UTIL configuration utility.

2. Perform the appropriate action depending on the number of HBAs.

Option Description
One HBA If you have only one host bus adapter (HBA), the Fast!UTIL Options page appears. Skip to Step 3.
Multiple HBAs If you have more than one HBA, select the HBA manually.

1. In the Select Host Adapter page, use the arrow keys to position the cursor on the appropriate HBA.

2. Press Enter.

3. In the Fast!UTIL Options page, select Configuration Settings and press Enter.

4. In the Configuration Settings page, select Adapter Settings and press Enter.

5. Set the BIOS to search for SCSI devices.

a. In the Host Adapter Settings page, select Host Adapter BIOS.

b. Press Enter to toggle the value to Enabled.

c. Press Esc to exit.

6. Enable the selectable boot.

a. Select Selectable Boot Settings and press Enter.

b. In the Selectable Boot Settings page, select Selectable Boot.

c. Press Enter to toggle the value to Enabled.

7. Use the cursor keys to select the Boot Port Name entry in the list of storage processors (SPs) and press Enter to open the Select Fibre Channel Device screen.

8. Use the cursor keys to select the specific SP and press Enter.

If you are using an active-passive storage array, the selected SP must be on the preferred (active) path to the boot LUN. If you are not sure which SP is on the active path, use your storage array management software to find out. The target IDs are created by the BIOS and might change with each reboot.

9. Perform the appropriate action depending on the number of LUNs attached to the SP.

Option Description
One LUN The LUN is selected as the boot LUN. You do not need to enter the Select LUN screen.
Multiple LUNs Select LUN screen opens. Use the cursor to select the boot LUN, then press Enter.

To configure a CLARiiON array to serve as a boot device for a Solaris server, follow these steps:

Note: Check the EMC Support Matrix or E-Lab Navigator for the versions of Solaris and arrays that support using the array as a boot device.

1. Partition your LUN on your CLARiiON array so you have the slices of required sizes.

2. Run the newfs command to make a filesystem on the slices you need.

3. Make a mount point for the slice that you are going to copy to the LUN.

4. Mount the slice at the mount point.

5. Use the cd command to change your current directory to the mounted slice.

6. Run the following command to copy the slice to the array:

# ufsdump 0f – /dev/dsk/cxtxdxsx | ufsrestore rf –

Where x= controller,target,LUN, slice where the OS currently resides.

7. Run the command to copy a boot block to the LUN:

# /usr/sbin/installboot /usr/platform/sun4u/lib/fs/ufs/bootblk /dev/rdsk/cxtxdxsx

Where x= controller, target, LUN, and slice of array LUN.

8. Change /etc/vfstab to the new slices.

9. If ATF is to be part of this configuration, you must install it after setting up the boot partition.

EMC PowerPath Migration Enabler – Host Copy (Windows)

Requirements:

  • PowerPath, at least version 5.1 SP1 (I would suggest at least 5.3 if running Windows 2003/2008)
  • PowerPath Migration Enabler key (host-copy)
  • Supported storage array for target and destination

Details:

To explain this migration technique a little more, PPME is a block level migration.  It migrates the blocks on the LUN using the host to process the migration.  This can cause performance degradation depending on how active the host is and the throttle you specify during the synchronization. Since the migration is at the block level, whatever the filesystem/alignment offset on the source LUN is exactly what gets migrated. You can migrate to a larger LUN but NOT to a smaller LUN.
If you need to make a configuration change to the filesystem, such as correcting an alignment offset issue, PPME is NOT the tool.  EMC Open Migrator (OM), however, can do that. OM can migrate LUNs online, but the setup and takedown require reboots (no less than three). I digress, let’s get on with the PPME migration.

Process:

The high-level process to complete a migration with PPME is this:

  • powermig setup -src <pseduoname> -tgt <pseudoname> -techtype hostcopy
  • powermig sync -handle <x>
  • powermig query -handle <x>
  • powermig throttle -handle <x> -throttlevalue <y>
  • powermig selecttarget -handle <x>
  • powermig commit -handle <x>
  • powermig cleanup -handle <x>

Note: Adding -noprompt to many of these commands, specifically those that take action, prevent the yes/no prompt.

A live example for this migration…….

C:Documents and SettingsAdministrator>powermt set policy=co dev=all

C:Documents and SettingsAdministrator>powermt save

C:Documents and SettingsAdministrator>powermt display dev=all
Pseudo name=harddisk2
CLARiiON ID=CKxxxxxxxxx482 [NOZOMI_SUP_SG]
Logical device ID=600601607BD01A00F68F2AAC48C3DB11 [LUN 77]
state=alive; policy=CLAROpt; priority=0; queued-IOs=0
Owner: default=SP B, current=SP B       Array failover mode: 1
==============================================================================
—————- Host —————   – Stor –   — I/O Path –  — Stats —
### HW Path                 I/O Paths    Interf.   Mode    State  Q-IOs Errors
==============================================================================
3 port3path0tgt0lun0     c3t0d0    SP A5     active  alive      0      7
3 port3path0tgt1lun0     c3t1d0    SP B4     active  alive      0      1

Pseudo name=harddisk3
CLARiiON ID=CKxxxxxxxxx482 [NOZOMI_SUP_SG]
Logical device ID=60060160C2021B00D8807DC433F7DD11 [LUN 72]
state=alive; policy=CLAROpt; priority=0; queued-IOs=1
Owner: default=SP A, current=SP A       Array failover mode: 1
==============================================================================
—————- Host —————   – Stor –   — I/O Path –  — Stats —
### HW Path                 I/O Paths    Interf.   Mode    State  Q-IOs Errors
==============================================================================
3 port3path0tgt0lun1     c3t0d1    SP A5     active  alive      1      7
3 port3path0tgt1lun1     c3t1d1    SP B4     active  alive      0      1

Pseudo name=harddisk4
CLARiiON ID=CKxxxxxxxxx482 [NOZOMI_SUP_SG]
Logical device ID=60060160416121000560A5593994E111 [LUN 301]
state=alive; policy=CLAROpt; priority=0; queued-IOs=0
Owner: default=SP B, current=SP B       Array failover mode: 1
==============================================================================
—————- Host —————   – Stor –   — I/O Path –  — Stats —
### HW Path                 I/O Paths    Interf.   Mode    State  Q-IOs Errors
==============================================================================
3 port3path0tgt0lun2     c3t0d2    SP A5     active  alive      0      1
3 port3path0tgt1lun2     c3t1d2    SP B4     active  alive      0      1

Pseudo name=harddisk5
CLARiiON ID=FCNxxxxxxxx055 [SG_NOZOMI-SUP]
Logical device ID=6006016010A030009C49FE259E94E111 [LUN 300]
state=alive; policy=CLAROpt; priority=0; queued-IOs=0
Owner: default=SP B, current=SP B       Array failover mode: 4
==============================================================================
—————- Host —————   – Stor –   — I/O Path –  — Stats —
### HW Path                 I/O Paths    Interf.   Mode    State  Q-IOs Errors
==============================================================================
3 port3path0tgt2lun0     c3t2d0    SP B1     active  alive      0      1

C:Documents and SettingsAdministrator>powermig setup -src harddisk4 -tgt harddisk5 -techtype hostcopy

Setup migration? [yes]/no: y

Migration Handle = 1

C:Documents and SettingsAdministrator>powermig info -all
==========================================
Hnd  Source     Target         Tech  State
===  =========  =========  ========  =====
1  harddisk4  harddisk5  HostCopy  setup

C:Documents and SettingsAdministrator>powermig info -all
==========================================
Hnd  Source     Target         Tech  State
===  =========  =========  ========  =====
1  harddisk4  harddisk5  HostCopy  setup

C:Documents and SettingsAdministrator>powermig query -handle 1

Handle: 1
Source: harddisk4
Target: harddisk5
Technology: HostCopy
Migration state: setup

C:Documents and SettingsAdministrator>powermig sync -handle 1

Start sync? [yes]/no: y

C:Documents and SettingsAdministrator>powermig query -handle 1

Handle: 1
Source: harddisk4
Target: harddisk5
Technology: HostCopy
Migration state: syncing
Percent InSync: 0%
Throttle Value: 2
Suspend time: 5

C:Documents and SettingsAdministrator>powermig query -handle 1

Handle: 1
Source: harddisk4
Target: harddisk5
Technology: HostCopy
Migration state: syncing
Percent InSync: 67%
Throttle Value: 2
Suspend time: 5

C:Documents and SettingsAdministrator>powermig pause -handle 1

Pause migration? [yes]/no: y

PPME error(4): Not in proper state to perform the requested operation

C:Documents and SettingsAdministrator>powermig query -handle 1

Handle: 1
Source: harddisk4
Target: harddisk5
Technology: HostCopy
Migration state: sourceSelected

C:Documents and SettingsAdministrator>powermt display dev=all
Pseudo name=harddisk2
CLARiiON ID=CKxxxxxxxxx482 [NOZOMI_SUP_SG]
Logical device ID=600601607BD01A00F68F2AAC48C3DB11 [LUN 77]
state=alive; policy=CLAROpt; priority=0; queued-IOs=0
Owner: default=SP B, current=SP B       Array failover mode: 1
==============================================================================
—————- Host —————   – Stor –   — I/O Path –  — Stats —
### HW Path                 I/O Paths    Interf.   Mode    State  Q-IOs Errors
==============================================================================
3 port3path0tgt0lun0     c3t0d0    SP A5     active  alive      0      7
3 port3path0tgt1lun0     c3t1d0    SP B4     active  alive      0      1

Pseudo name=harddisk3
CLARiiON ID=CKxxxxxxxxx482 [NOZOMI_SUP_SG]
Logical device ID=60060160C2021B00D8807DC433F7DD11 [LUN 72]
state=alive; policy=CLAROpt; priority=0; queued-IOs=0
Owner: default=SP A, current=SP A       Array failover mode: 1
==============================================================================
—————- Host —————   – Stor –   — I/O Path –  — Stats —
### HW Path                 I/O Paths    Interf.   Mode    State  Q-IOs Errors
==============================================================================
3 port3path0tgt0lun1     c3t0d1    SP A5     active  alive      0      7
3 port3path0tgt1lun1     c3t1d1    SP B4     active  alive      0      1

Pseudo name=harddisk4
CLARiiON ID=CKxxxxxxxxx482 [NOZOMI_SUP_SG]
Logical device ID=60060160416121000560A5593994E111 [LUN 301]
state=alive; policy=CLAROpt; priority=0; queued-IOs=0
Owner: default=SP B, current=SP B       Array failover mode: 1
==============================================================================
—————- Host —————   – Stor –   — I/O Path –  — Stats —
### HW Path                 I/O Paths    Interf.   Mode    State  Q-IOs Errors
==============================================================================
3 port3path0tgt0lun2     c3t0d2    SP A5     active  alive      0      1
3 port3path0tgt1lun2     c3t1d2    SP B4     active  alive      0      1

Pseudo name=harddisk5
CLARiiON ID=FCNxxxxxxxx055 [SG_NOZOMI-SUP]
Logical device ID=6006016010A030009C49FE259E94E111 [LUN 300]
state=alive; policy=CLAROpt; priority=0; queued-IOs=0
Owner: default=SP B, current=SP B       Array failover mode: 4
==============================================================================
—————- Host —————   – Stor –   — I/O Path –  — Stats —
### HW Path                 I/O Paths    Interf.   Mode    State  Q-IOs Errors
==============================================================================
3 port3path0tgt2lun0     c3t2d0    SP B1     active  alive      0      1

C:Documents and SettingsAdministrator>powermig query -handle 1

Handle: 1
Source: harddisk4
Target: harddisk5
Technology: HostCopy
Migration state: sourceSelected

C:Documents and SettingsAdministrator>powermig selectTarget -handle 1

Transition to targetSelected state? [yes]/no: y

C:Documents and SettingsAdministrator>powermig query -handle 1

Handle: 1
Source: harddisk4
Target: harddisk5
Technology: HostCopy
Migration state: targetSelected

C:Documents and SettingsAdministrator>powermig commit -handle 1

Commit migration? [yes]/no: y

C:Documents and SettingsAdministrator>powermig query -handle 1

Handle: 1
Source: harddisk4
Target: harddisk5
Technology: HostCopy
Migration state: committed

C:Documents and SettingsAdministrator>powermt display dev=all
Pseudo name=harddisk2
CLARiiON ID=CKxxxxxxxxx482 [NOZOMI_SUP_SG]
Logical device ID=600601607BD01A00F68F2AAC48C3DB11 [LUN 77]
state=alive; policy=CLAROpt; priority=0; queued-IOs=0
Owner: default=SP B, current=SP B       Array failover mode: 1
==============================================================================
—————- Host —————   – Stor –   — I/O Path –  — Stats —
### HW Path                 I/O Paths    Interf.   Mode    State  Q-IOs Errors
==============================================================================
3 port3path0tgt0lun0     c3t0d0    SP A5     active  alive      0      7
3 port3path0tgt1lun0     c3t1d0    SP B4     active  alive      0      1

Pseudo name=harddisk3
CLARiiON ID=CKxxxxxxxxx482 [NOZOMI_SUP_SG]
Logical device ID=60060160C2021B00D8807DC433F7DD11 [LUN 72]
state=alive; policy=CLAROpt; priority=0; queued-IOs=1
Owner: default=SP A, current=SP A       Array failover mode: 1
==============================================================================
—————- Host —————   – Stor –   — I/O Path –  — Stats —
### HW Path                 I/O Paths    Interf.   Mode    State  Q-IOs Errors
==============================================================================
3 port3path0tgt0lun1     c3t0d1    SP A5     active  alive      1      7
3 port3path0tgt1lun1     c3t1d1    SP B4     active  alive      0      1

Pseudo name=harddisk4
CLARiiON ID=FCNxxxxxxxx055 [SG_NOZOMI-SUP]
Logical device ID=6006016010A030009C49FE259E94E111 [LUN 300]
state=alive; policy=CLAROpt; priority=0; queued-IOs=0
Owner: default=SP B, current=SP B       Array failover mode: 4
==============================================================================
—————- Host —————   – Stor –   — I/O Path –  — Stats —
### HW Path                 I/O Paths    Interf.   Mode    State  Q-IOs Errors
==============================================================================
3 port3path0tgt2lun0     c3t2d0    SP B1     active  alive      0      1

Pseudo name=harddisk5
CLARiiON ID=CKxxxxxxxxx482 [NOZOMI_SUP_SG]
Logical device ID=60060160416121000560A5593994E111 [LUN 301]
state=alive; policy=CLAROpt; priority=0; queued-IOs=0
Owner: default=SP B, current=SP B       Array failover mode: 1
==============================================================================
—————- Host —————   – Stor –   — I/O Path –  — Stats —
### HW Path                 I/O Paths    Interf.   Mode    State  Q-IOs Errors
==============================================================================
3 port3path0tgt0lun2     c3t0d2    SP A5     active  alive      0      1
3 port3path0tgt1lun2     c3t1d2    SP B4     active  alive      0      1

C:Documents and SettingsAdministrator>powermig query -handle 1

Handle: 1
Source: harddisk4
Target: harddisk5
Technology: HostCopy
Migration state: committed

C:Documents and SettingsAdministrator>powermig cleanup -handle 1

Cleanup migration? [yes]/no: y

C:Documents and SettingsAdministrator>powermig query -handle 1

PPME error(6): Handle not found

C:Documents and SettingsAdministrator>

 

The detailed process to complete a migration with PPME is this:

  1. Install PowerPath and/or PPME
    • Be sure to use a custom install and choose Migration Enabler as an option.  This is a default installation I use because it doesn’t cost anything to install and does not interfere with any other functionality.
    • Supposedly you can install PPME after PowerPath without a reboot, but the few times I did that, I had to reboot. This would be the ONLY reboot during the entire process.
  2. Prepare/present the target LUN.
    • Once the LUN is accessible to the host, this is all that is necessary. There is no need to prepare the filesystem or alignment offset.  In fact, whatever is done to the destination LUN will be overwritten by the storage migration.
  3. License PPME using the PowerPath Licensing Tool.
  4. Setup the migration session using the command:
    powermig setup -src <source_pseduoname> -tgt <target_pseudoname> -techtype hostcopy
    Where source_pseudoname is whatever PowerPath lists as the hosts LUN name.  For instance, harddisk1.  The same goes for target_pseudoname. This creates the relationship of the migration, using a session ID for all future tasks. Keep note of the session ID that is provided by PPME.
  5. Next is to start the synchronization.  If there is going to be a negative performance impact for the migration, it will be during the synchronization.
    powermig sync -handle <x>
    Where <x> is the session ID. This starts the synchronization of the migration at a throttle level of 2 on a scale of 0-9.  0 is the fastest and 9 is the slowest.  I found that using 2 was acceptable for most of the migrations I completed. If I thought that was going to be be too aggressive, I set the throttle to a value of 5.  The migration takes longer to complete, but the IO contention was far less.
    At this point, data is copied from source to target while the read requests are serviced and the writes are mirrored to source and target.
  6. Since the synchronization starts at a throttle of 2, there may be times when you need to slow it down or speed it up for whatever reason. This is NOT required, but if you need to the command is:
    powermig throttle -handle <x> -throttlevalue <y>
    Where <y> is a value from 0-9. Again, 0 is the fastest and 9 is the slowest.
  7. To check the status of the migration, enter the command:
    powermig query -handle <x>
    The output will give you the percentage complete and give you an idea as to when the synchronization will be complete.
  8. Once the status of the synchronization is listed as “sourceselected”, it is time to finish the migration.  One thing to note, is that it is still possible to backout of this migration. Enter the following command to select the target LUN:
    powermig selecttarget -handle <x>
    At this point, the read requests are serviced by the target and the writes continue to be mirrored.
  9. Now is the time to have the owner validate that the migration is acceptable.  If performance is not as expected, you can still backout of the migration by selecting the source (selectsource) and cleanup the migration as specified below, however that is not what we are after, is it?! If validation is successful, enter the following command to commit the change:
    powermig commit -handle <x>
    The reads and writes are solely serviced by the target LUN and the source LUN is no longer being used.
  10. At this point, you can no longer backout the change.  The source LUN, however, is still presented to the host and the underlying filesystem is still valid. You have two choices on how to proceed:
    • Cleaning up the migration as documented by the PowerPath guide
      • This is destructive to the source LUN, as the guide says that it removes some data.  What that data contains is beyond me, but the end result is that the data on the LUN is not longer accessible by any host.
        powermig cleanup -handle <x>
    • My preferred option is to remove the LUN from host access and then forcing the session cleanup. That provides the ability to mount that LUN on a different host, or back to the original host if there was a need.  I would rename the LUN with the date of the migration and the name of the host. I would then leave that LUN bound for a week before destroying it, call me paranoid or over cautious.
      powermig cleanup -handle <x> -force
  11. This completes the migration.

Thanks to Mike