Contents

Notes 基于 IP 哈希的路由
Cisco switch setting
SAN_01 & SAN_03
SAN_02 & SAN_04
RMAN scripts
1. delete expired backupset
initial setting
connected to recovery catalog database
1. DDRMAN-register-DOS

Notes 基于 IP 哈希的路由

基于 IP 哈希的路由的运行方式是获取源和目标 IP 地址，然后在每个数据包上执行数学计算以确定要使用成组中的哪个上行链路。由于负载平衡基于源/目标 IP 地址，因此单个虚拟机与多个 IP 地址通信可以跨成组中的所有网络适配器平衡其负载，并更好的利用可用带宽。

基于 IP 哈希的路由负载平衡需要多个已组合到 EtherChannel（有时也称为聚合绑定、端口通道或中继）中的物理交换机端口。这确保了同一哈希算法用于返回相反方向的流量。 The switch must be set to perform 802.3ad link aggregation in static mode ON

优点：

* 单个虚拟机与多个虚拟机通信的情况下的性能已提高。理论上，虚拟机可使用超过一个物理网卡所提供的带宽。 * 网络适配器冗余：如果网卡出现故障，并且链路状态已断开，则成组中的其余网卡将继续传递流量。为了使链路状态正常运行，物理交换机和 ESXi 主机都必须将链路识别为断开。如果存在出入，则无法将流量故障切换到成组中的其他适配器。

缺点：

* 物理交换机配置较不灵活，并且需要为静态 EtherChannel 绑定配置物理交换机端口。有关详细信息，请参见 Sample configuration of EtherChannel / Link Aggregation Control Protocol (LACP) with ESXi/ESX and Cisco/HP switches (1004048)。 * 网卡组仅可使用一个物理交换机，因为大多数交换机都不支持跨多个物理交换机的 EtherChannel 绑定。这将防止物理硬件冗余。

注意：存在一些例外情况，因为某些“堆栈”交换机或模块交换机可跨多个物理交换机或模块执行此操作。Cisco 的 VPC（虚拟端口通道）技术也可在受支持的交换机上解决此问题。有关详细信息，请联系您的硬件供应商。 IRF，堆叠技术。

* IP 哈希不支持信号探测。仅可将链路状态用作故障检测方法。如果链路在其没有断开的情况下出现故障，则无法避免 vSwitch 上的网络通信问题。 * 标准 vSwitch 仅支持静态模式 EtherChannel。LACP 仅在 vSphere 5.1 的 vSphere Distributed Switch 中或 Cisco Nexus 1000V 中受支持。

Cisco switch setting

建议在 ESXi/ESX 网络环境中实施虚拟局域网 (VLAN)，这是因为：

它将 ESXi/ESX 集成到预先存在的网络中它可保障网络流量它可降低网络流量拥塞

Port Channel/Aggr

configure terminal
interface GigabitEthernet1/11
description VMware_MGT
switchport mode access
switchport access vlan x 
spanning-tree portfast

Port Channel/Aggr

First Enable LACP

configure terminal
switch (config)# feature lacp 
show system internal clis feature
show port-channel summary
show port-channel database
show port-channel load-balance

!
configure terminal
interface port-channel 1
description VMware_VM_Net
switchport trunk encapsulation dot1q
switchport mode trunk
!

interface GigabitEthernet1/13
switchport trunk encapsulation dot1q
switchport mode trunk
switchport trunk allowed vlan x,y,z
spanning-tree portfast trunk 
channel-group 1 mode on

Oracle RAC

建议创建+CRS磁盘组(OCR和表决文件)使用正常冗余(Normal)。

建议将其他所有ASM磁盘组设置为外部冗余(Extenal)。

建议将+DATA、+FRA和+LOG ASM磁盘组分开，位于不同的阵列，以减轻和平衡I/O负担。

SAN_01 & SAN_03

switchName:     SAN_01
switchType:     118.1
switchState:    Online   
switchMode:     Native
switchRole:     Subordinate
switchDomain:   1
switchId:       fffc01
switchWwn:      10:00:c4:f5:7c:05:8a:c0
zoning:         ON (ZHCIQ_SAN_A)
switchBeacon:   OFF
HIF Mode:       OFF

Index Port Address Media Speed       State   Proto
==================================================
   0   0   010000   id    N8       Online      FC  E-Port  10:00:50:eb:1a:ba:41:01 "SAN_03" (upstream)
   1   1   010100   id    N8       Online      FC  E-Port  10:00:50:eb:1a:ba:41:01 "SAN_03" 
   2   2   010200   id    N8       Online      FC  F-Port  50:00:14:42:c0:0c:b2:12 
   3   3   010300   id    N8       Online      FC  F-Port  50:00:14:42:d0:0c:b2:12 
   4   4   010400   id    N8       Online      FC  F-Port  50:00:14:42:c0:0c:b2:02 
   5   5   010500   id    N8       Online      FC  F-Port  50:00:14:42:d0:0c:b2:02 
   6   6   010600   id    N8       Online      FC  F-Port  50:06:01:60:08:60:7e:e6 
   7   7   010700   id    N8       Online      FC  F-Port  50:06:01:68:08:60:7e:e6 
   8   8   010800   id    N8       Online      FC  F-Port  50:06:01:60:09:60:11:49 
   9   9   010900   id    N8       Online      FC  F-Port  50:06:01:68:09:60:11:49 
  10  10   010a00   id    N8       Online      FC  F-Port  10:00:00:90:fa:c0:c1:e4 
  11  11   010b00   id    N8       Online      FC  F-Port  10:00:00:90:fa:c0:c2:ce 
  12  12   010c00   id    N16      No_Light    FC  Disabled
  13  13   010d00   id    N16      No_Light    FC  Disabled
  14  14   010e00   id    N16      No_Light    FC  Disabled
  15  15   010f00   id    N16      No_Light    FC  Disabled
  16  16   011000   id    N16      No_Light    FC  Disabled
  17  17   011100   id    N16      No_Light    FC  Disabled
  18  18   011200   id    N16      No_Light    FC  Disabled
  19  19   011300   id    N16      No_Light    FC  Disabled
  20  20   011400   id    N16      No_Light    FC  Disabled
  21  21   011500   id    N16      No_Light    FC  Disabled
  22  22   011600   id    N16      No_Light    FC  Disabled
  23  23   011700   id    N16      No_Light    FC  Disabled

switchshow:
switchshow        :
switchName:     SAN_02
switchType:     118.1
switchState:    Online   
switchMode:     Native
switchRole:     Subordinate
switchDomain:   2
switchId:       fffc02
switchWwn:      10:00:c4:f5:7c:06:56:e3
zoning:         ON (ZHCIQ_SAN_B)
switchBeacon:   OFF
HIF Mode:       OFF

Index Port Address Media Speed       State   Proto
==================================================
   0   0   020000   id    N8       Online      FC  E-Port  10:00:50:eb:1a:ba:36:f6 "SAN_04" (upstream)
   1   1   020100   id    N8       Online      FC  E-Port  10:00:50:eb:1a:ba:36:f6 "SAN_04" 
   2   2   020200   id    N8       Online      FC  F-Port  50:00:14:42:c0:0c:b2:13 
   3   3   020300   id    N8       Online      FC  F-Port  50:00:14:42:d0:0c:b2:13 
   4   4   020400   id    N8       Online      FC  F-Port  50:00:14:42:c0:0c:b2:03 
   5   5   020500   id    N8       Online      FC  F-Port  50:00:14:42:d0:0c:b2:03 
   6   6   020600   id    N8       Online      FC  F-Port  50:06:01:61:08:60:79:4b 
   7   7   020700   id    N8       Online      FC  F-Port  50:06:01:69:08:60:79:4b 
   8   8   020800   id    N8       Online      FC  F-Port  50:06:01:61:09:60:17:c1 
   9   9   020900   id    N8       Online      FC  F-Port  50:06:01:69:09:60:17:c1 
  10  10   020a00   id    N8       Online      FC  F-Port  10:00:00:90:fa:c0:c2:00 
  11  11   020b00   id    N8       Online      FC  F-Port  10:00:00:90:fa:c0:c2:d7 
  12  12   020c00   id    N16      No_Light    FC  Disabled
  13  13   020d00   id    N16      No_Light    FC  Disabled
  14  14   020e00   id    N16      No_Light    FC  Disabled
  15  15   020f00   id    N16      No_Light    FC  Disabled
  16  16   021000   id    N16      No_Light    FC  Disabled
  17  17   021100   id    N16      No_Light    FC  Disabled
  18  18   021200   id    N16      No_Light    FC  Disabled
  19  19   021300   id    N16      No_Light    FC  Disabled
  20  20   021400   id    N16      No_Light    FC  Disabled
  21  21   021500   id    N16      No_Light    FC  Disabled
  22  22   021600   id    N16      No_Light    FC  Disabled
  23  23   021700   id    N16      No_Light    FC  Disabled

switchdisable , cfgshow, cfgdisable , cfgclear, configure and set the fabric.ops parametres similerly as the existing one except the DOMAIN ID(it should be unique 1-239, by default it is 1 in each new SW), cfgsave.

Inter Switch Link (ISL) Setting

升级光纤交换机firmware版本
初始化配制，设置新交换机管理IP并分别修改domain id为1和3。
完成光纤连接。
确认ISL情况

  switchshow
  islshow
  fabricshow

创建别名

   1 alicreate "VPLEX_E1_A1_F0",""
   2 alicreate "VPLEX_E1_B1_F0",""
   3 alicreate "VPLEX_E1_A0_F2",""
   4 alicreate "VPLEX_E1_B0_F2",""
   5 alicreate "ST01_A0",""
   6 alicreate "ST01_B0",""
   7 alicreate "ST02_A0",""
   8 alicreate "ST02_B0",""
   9 alicreate "TA_SW01_F1",""
  10 alicreate "TA_SW02_F1",""
  11 
  12 alicreate "VPLEX_E1_A0_F0",""
  13 alicreate "VPLEX_E1_B0_F0",""
  14 alicreate "VPLEX_E1_A1_F2",""
  15 alicreate "VPLEX_E1_B1_F2",""
  16 alicreate "ST03_A0",""
  17 alicreate "ST03_B0",""
  18 alicreate "ST04_A0",""
  19 alicreate "ST04_B0",""
  20 alicreate "ESXi01_F1",""
  21 alicreate "ESXi02_F1",""
  22 alicreate "ESXi03_F1",""
  23 alicreate "ESXi04_F1",""
  24 alicreate "DB_RAC01_F1",""
  25 alicreate "DB_RAC02_F1",""

ZONE划分

   1 # Front Zone
   2 # VPLEX_E1_A0 with APPs
   3 zonecreate "VPLEX_DB_RAC01","DB_RAC01_F1,VPLEX_E1_A0_F0,VPLEX_E1_B0_F0"
   4 zonecreate "VPLEX_DB_RAC02","DB_RAC02_F1,VPLEX_E1_A0_F0,VPLEX_E1_B0_F0"
   5 zonecreate "VPLEX_ESXi01","ESXi01_F1,VPLEX_E1_A0_F0,VPLEX_E1_B0_F0"
   6 zonecreate "VPLEX_ESXi02","ESXi02_F1,VPLEX_E1_A0_F0,VPLEX_E1_B0_F0"
   7 zonecreate "VPLEX_ESXi03","ESXi03_F1,VPLEX_E1_A0_F0,VPLEX_E1_B0_F0"
   8 zonecreate "VPLEX_ESXi04","ESXi04_F1,VPLEX_E1_A0_F0,VPLEX_E1_B0_F0"
   9 
  10 zonecreate "VPLEX_TA_SW01","TA_SW01_F1,VPLEX_E1_A0_F2,VPLEX_E1_B0_F2"
  11 zonecreate "VPLEX_TA_SW02","TA_SW02_F1,VPLEX_E1_A0_F2,VPLEX_E1_B0_F2"
  12 # Back Zone
  13 # VPLEX_E1_A1 with VNX5200
  14 zonecreate "VPLEX_E1_A1_F0_ST01","VPLEX_E1_A1_F0,ST01_A0,ST01_B0"
  15 zonecreate "VPLEX_E1_A1_F0_ST02","VPLEX_E1_A1_F0,ST02_A0,ST02_B0"
  16 zonecreate "VPLEX_E1_A1_F0_ST03","VPLEX_E1_A1_F0,ST03_A0,ST03_B0"
  17 zonecreate "VPLEX_E1_A1_F0_ST04","VPLEX_E1_A1_F0,ST03_A0,ST04_B0"
  18 
  19 zonecreate "VPLEX_E1_A1_F2_ST01","VPLEX_E1_A1_F2,ST01_A0,ST01_B0"
  20 zonecreate "VPLEX_E1_A1_F2_ST02","VPLEX_E1_A1_F2,ST02_A0,ST02_B0"
  21 zonecreate "VPLEX_E1_A1_F2_ST03","VPLEX_E1_A1_F2,ST03_A0,ST03_B0"
  22 zonecreate "VPLEX_E1_A1_F2_ST04","VPLEX_E1_A1_F2,ST04_A0,ST04_B0"
  23 
  24 zonecreate "VPLEX_E1_B1_F0_ST01","VPLEX_E1_B1_F0,ST01_A0,ST01_B0"
  25 zonecreate "VPLEX_E1_B1_F0_ST02","VPLEX_E1_B1_F0,ST02_A0,ST02_B0"
  26 zonecreate "VPLEX_E1_B1_F0_ST03","VPLEX_E1_B1_F0,ST03_A0,ST03_B0"
  27 zonecreate "VPLEX_E1_B1_F0_ST04","VPLEX_E1_B1_F0,ST04_A0,ST04_B0"
  28 
  29 zonecreate "VPLEX_E1_B1_F2_ST01","VPLEX_E1_B1_F2,ST01_A0,ST01_B0"
  30 zonecreate "VPLEX_E1_B1_F2_ST02","VPLEX_E1_B1_F2,ST02_A0,ST02_B0"
  31 zonecreate "VPLEX_E1_B1_F2_ST03","VPLEX_E1_B1_F2,ST03_A0,ST03_B0"
  32 zonecreate "VPLEX_E1_B1_F2_ST04","VPLEX_E1_B1_F2,ST04_A0,ST04_B0"

VPLEX_E2_A1 with VNX5200 (预留)

zonecreate "VPLEX_E2_A0_F0_ST01","VPLEX_E2_A1_F0,ST01_A0,ST01_B0"
zonecreate "VPLEX_E2_A0_F0_ST02","VPLEX_E2_A1_F0,ST02_A0,ST02_B0"
zonecreate "VPLEX_E2_A0_F0_ST03","VPLEX_E2_A1_F0,ST03_A0,ST03_B0"
zonecreate "VPLEX_E2_A0_F0_ST04","VPLEX_E2_A1_F0,ST04_A0,ST04_B0"

zonecreate "VPLEX_E2_A0_F2_ST01","VPLEX_E2_A1_F2,ST01_A0,ST01_B0"
zonecreate "VPLEX_E2_A0_F2_ST02","VPLEX_E2_A1_F2,ST02_A0,ST02_B0"
zonecreate "VPLEX_E2_A0_F2_ST03","VPLEX_E2_A1_F2,ST03_A0,ST03_B0"
zonecreate "VPLEX_E2_A0_F2_ST04","VPLEX_E2_A1_F2,ST03_A0,ST03_B0"

zonecreate "VPLEX_E2_B0_F0_ST01","VPLEX_E2_B1_F0,ST01_A0,ST01_B0"
zonecreate "VPLEX_E2_B0_F0_ST02","VPLEX_E2_B1_F0,ST02_A0,ST02_B0"
zonecreate "VPLEX_E2_B0_F0_ST03","VPLEX_E2_B1_F0,ST03_A0,ST03_B0"
zonecreate "VPLEX_E2_B0_F0_ST04","VPLEX_E2_B1_F0,ST04_A0,ST04_B0"

zonecreate "VPLEX_E2_B0_F2_ST01","VPLEX_E2_B1_F2,ST01_A0,ST01_B0"
zonecreate "VPLEX_E2_B0_F2_ST02","VPLEX_E2_B1_F2,ST02_A0,ST02_B0"
zonecreate "VPLEX_E2_B0_F2_ST03","VPLEX_E2_B1_F2,ST03_A0,ST03_B0"
zonecreate "VPLEX_E2_B0_F2_ST04","VPLEX_E2_B1_F2,ST04_A0,ST04_B0"

创建并激活CONFIG

# sed -n '/VPLEX_E1/p' < /tmp/tmphSAXQp.moin | grep zonecre | awk -F"\"" '{ print $2 }' | sort | fmt | tr '\n' ' ' | tr ' ' ','

cfgcreate "ZHCIQ_SAN_A","VPLEX_DB_RAC01,VPLEX_DB_RAC02,VPLEX_E1_A1_F0_ST01,VPLEX_E1_A1_F0_ST02,VPLEX_E1_A1_F0_ST03,VPLEX_E1_A1_F0_ST04,VPLEX_E1_A1_F2_ST01,VPLEX_E1_A1_F2_ST02,VPLEX_E1_A1_F2_ST03,VPLEX_E1_A1_F2_ST04,VPLEX_E1_B1_F0_ST01,VPLEX_E1_B1_F0_ST02,VPLEX_E1_B1_F0_ST03,VPLEX_E1_B1_F0_ST04,VPLEX_E1_B1_F2_ST01,VPLEX_E1_B1_F2_ST02,VPLEX_E1_B1_F2_ST03,VPLEX_E1_B1_F2_ST04,VPLEX_ESXi01,VPLEX_ESXi02,VPLEX_ESXi03,VPLEX_ESXi04,VPLEX_TA_SW01,VPLEX_TA_SW02"

# 
cfgenable ZHCIQ_SAN_A
cfgsave ZHCIQ_SAN_A

SAN_02 & SAN_04

Inter Switch Link (ISL) Setting

升级光纤交换机firmware版本
初始化配制，设置新交换机管理IP并分别修改domain id为2和4。
完成光纤连接。
确认ISL情况

  switchshow
  islshow
  fabricshow

创建别名

   1 alicreate "VPLEX_E1_A1_F1",""
   2 alicreate "VPLEX_E1_B1_F1",""
   3 alicreate "VPLEX_E1_A0_F3",""
   4 alicreate "VPLEX_E1_B0_F3",""
   5 alicreate "ST01_A1",""
   6 alicreate "ST01_B1",""
   7 alicreate "ST02_A1",""
   8 alicreate "ST02_B1",""
   9 alicreate "TA_SW01_F2",""
  10 alicreate "TA_SW02_F2",""
  11 
  12 alicreate "VPLEX_E1_A0_F1",""
  13 alicreate "VPLEX_E1_B0_F1",""
  14 alicreate "VPLEX_E1_A1_F3",""
  15 alicreate "VPLEX_E1_B1_F3",""
  16 alicreate "ST03_A1",""
  17 alicreate "ST03_B1",""
  18 alicreate "ST04_A1",""
  19 alicreate "ST04_B1",""
  20 alicreate "ESXi01_F2",""
  21 alicreate "ESXi02_F2",""
  22 alicreate "ESXi03_F2",""
  23 alicreate "ESXi04_F2",""
  24 alicreate "DB_RAC01_F2",""
  25 alicreate "DB_RAC02_F2",""

ZONE划分

   1 # Front Zone
   2 # VPLEX_E1_A0 with APPs
   3 zonecreate "VPLEX_DB_RAC01","DB_RAC01_F2,VPLEX_E1_A0_F1,VPLEX_E1_B0_F1"
   4 zonecreate "VPLEX_DB_RAC02","DB_RAC02_F2,VPLEX_E1_A0_F1,VPLEX_E1_B0_F1"
   5 
   6 zonecreate "VPLEX_ESXi01","ESXi01_F2,VPLEX_E1_A0_F1,VPLEX_E1_B0_F1"
   7 zonecreate "VPLEX_ESXi02","ESXi02_F2,VPLEX_E1_A0_F1,VPLEX_E1_B0_F1"
   8 zonecreate "VPLEX_ESXi03","ESXi03_F2,VPLEX_E1_A0_F1,VPLEX_E1_B0_F1"
   9 zonecreate "VPLEX_ESXi04","ESXi04_F2,VPLEX_E1_A0_F1,VPLEX_E1_B0_F1"
  10 
  11 zonecreate "VPLEX_TA_SW01","TA_SW01_F2,VPLEX_E1_A0_F3,VPLEX_E1_B0_F3"
  12 zonecreate "VPLEX_TA_SW02","TA_SW02_F2,VPLEX_E1_A0_F3,VPLEX_E1_B0_F3"
  13 # Back Zone
  14 # VPLEX_E1_A1 with VNX5200
  15 zonecreate "VPLEX_E1_A1_F1_ST01","VPLEX_E1_A1_F1,ST01_A1,ST01_B1"
  16 zonecreate "VPLEX_E1_A1_F1_ST02","VPLEX_E1_A1_F1,ST02_A1,ST02_B1"
  17 zonecreate "VPLEX_E1_A1_F1_ST03","VPLEX_E1_A1_F1,ST03_A1,ST03_B1"
  18 zonecreate "VPLEX_E1_A1_F1_ST04","VPLEX_E1_A1_F1,ST04_A1,ST04_B1"
  19 
  20 zonecreate "VPLEX_E1_A1_F3_ST01","VPLEX_E1_A1_F3,ST01_A1,ST01_B1"
  21 zonecreate "VPLEX_E1_A1_F3_ST02","VPLEX_E1_A1_F3,ST02_A1,ST02_B1"
  22 zonecreate "VPLEX_E1_A1_F3_ST03","VPLEX_E1_A1_F3,ST03_A1,ST03_B1"
  23 zonecreate "VPLEX_E1_A1_F3_ST04","VPLEX_E1_A1_F3,ST04_A1,ST04_B1"
  24 
  25 zonecreate "VPLEX_E1_B1_F1_ST01","VPLEX_E1_B1_F1,ST01_A1,ST01_B1"
  26 zonecreate "VPLEX_E1_B1_F1_ST02","VPLEX_E1_B1_F1,ST02_A1,ST02_B1"
  27 zonecreate "VPLEX_E1_B1_F1_ST03","VPLEX_E1_B1_F1,ST03_A1,ST03_B1"
  28 zonecreate "VPLEX_E1_B1_F1_ST04","VPLEX_E1_B1_F1,ST04_A1,ST04_B1"
  29 
  30 zonecreate "VPLEX_E1_B1_F3_ST01","VPLEX_E1_B1_F3,ST01_A1,ST01_B1"
  31 zonecreate "VPLEX_E1_B1_F3_ST02","VPLEX_E1_B1_F3,ST02_A1,ST02_B1"
  32 zonecreate "VPLEX_E1_B1_F3_ST03","VPLEX_E1_B1_F3,ST03_A1,ST03_B1"
  33 zonecreate "VPLEX_E1_B1_F3_ST04","VPLEX_E1_B1_F3,ST04_A1,ST04_B1"

VPLEX_E2_A1 with VNX5200 (预留)

zonecreate "VPLEX_E2_A1_F1_ST01","VPLEX_E2_A1_F1,ST01_A1,ST01_B1"
zonecreate "VPLEX_E2_A1_F1_ST02","VPLEX_E2_A1_F1,ST02_A1,ST02_B1"
zonecreate "VPLEX_E2_A1_F1_ST03","VPLEX_E2_A1_F1,ST03_A1,ST03_B1"
zonecreate "VPLEX_E2_A1_F1_ST03","VPLEX_E2_A1_F1,ST03_A1,ST03_B1"

zonecreate "VPLEX_E2_A1_F3_ST01","VPLEX_E2_A1_F3,ST01_A1,ST01_B1"
zonecreate "VPLEX_E2_A1_F3_ST02","VPLEX_E2_A1_F3,ST02_A1,ST02_B1"
zonecreate "VPLEX_E2_A1_F3_ST03","VPLEX_E2_A1_F3,ST03_A1,ST03_B1"
zonecreate "VPLEX_E2_A1_F3_ST04","VPLEX_E2_A1_F3,ST04_A1,ST04_B1"

zonecreate "VPLEX_E2_B1_F1_ST01","VPLEX_E2_B1_F1,ST01_A1,ST01_B1"
zonecreate "VPLEX_E2_B1_F1_ST02","VPLEX_E2_B1_F1,ST02_A1,ST02_B1"
zonecreate "VPLEX_E2_B1_F1_ST03","VPLEX_E2_B1_F1,ST03_A1,ST03_B1"
zonecreate "VPLEX_E2_B1_F1_ST04","VPLEX_E2_B1_F1,ST04_A1,ST04_B1"

zonecreate "VPLEX_E2_B1_F3_ST01","VPLEX_E2_B1_F3,ST01_A1,ST01_B1"
zonecreate "VPLEX_E2_B1_F3_ST02","VPLEX_E2_B1_F3,ST02_A1,ST02_B1"
zonecreate "VPLEX_E2_B1_F3_ST03","VPLEX_E2_B1_F3,ST03_A1,ST03_B1"
zonecreate "VPLEX_E2_B1_F3_ST04","VPLEX_E2_B1_F3,ST04_A1,ST04_B1"

创建并激活CONFIG

# sed -n '/VPLEX_E1/p' < /tmp/tmphSAXQp.moin | grep zonecre | awk -F"\"" '{ print $2 }' | sort | fmt | tr '\n' ' ' | tr ' ' ','

cfgcreate "ZHCIQ_SAN_B","VPLEX_DB_RAC01,VPLEX_DB_RAC02,VPLEX_E1_A1_F1_ST01,VPLEX_E1_A1_F1_ST02,VPLEX_E1_A1_F1_ST03,VPLEX_E1_A1_F1_ST04,VPLEX_E1_A1_F3_ST01,VPLEX_E1_A1_F3_ST02,VPLEX_E1_A1_F3_ST03,VPLEX_E1_A1_F3_ST04,VPLEX_E1_B1_F1_ST01,VPLEX_E1_B1_F1_ST02,VPLEX_E1_B1_F1_ST03,VPLEX_E1_B1_F1_ST04,VPLEX_E1_B1_F3_ST01,VPLEX_E1_B1_F3_ST02,VPLEX_E1_B1_F3_ST03,VPLEX_E1_B1_F3_ST04,VPLEX_ESXi01,VPLEX_ESXi02,VPLEX_ESXi03,VPLEX_ESXi04,VPLEX_TA_SW01,VPLEX_TA_SW02"
cfgenable ZHCIQ_SAN_B
cfgsave

Host HBAs

10:00:00:90:fa:b4:2f:16 ESXi_01_F1  
10:00:00:90:fa:b4:2f:17 ESXi_01_F2 
10:00:00:90:fa:b4:2e:be ESXi_02_F1 
10:00:00:90:fa:b4:2e:bf ESXi_02_F2 
21:00:00:24:ff:13:83:d5 ESXi_05_F1 
21:00:00:24:ff:13:82:ef ESXi_05_F2 
21:00:00:24:ff:14:23:72 ESXi_06_F1 
21:00:00:24:ff:14:22:ad ESXi_06_F2 
10:00:00:90:fa:c0:c1:e4 ESXi_07_F1 
10:00:00:90:fa:c0:c2:00 ESXi_07_F2 
10:00:00:90:fa:c0:c2:15 ESXi_08_F1 
10:00:00:90:fa:c0:c2:ca ESXi_08_F2 

# 一共6台ESXi

10:00:00:90:fa:c0:c1:e9 DB_RAC02_F2 
10:00:00:90:fa:c0:c1:60 DB_RAC02_F1 
10:00:00:90:fa:c0:c2:ce DB_RAC01_F1 
10:00:00:90:fa:c0:c2:d7 DB_RAC01_F2

Vplex

How to collect logs from VPLEX clusters.
What logs are required to debug VPLEX problems?

How do I capture collect-diagnostics on a VPLEX cluster?

How to validate the existing collect-diagnostics packages on the management servers.



The collect-diagnostics VPlexcli command produces compressed packages containing configuration and log files. The file is placed in the /diag/collect-diagnostics-out/ directory on the Management Server. Once the command finishes, you can use WINSCP, or equivalent SCP utility, to copy the file off the management server.  

Note: If collect-diagnostics is run with no options, two files are generated.VPLEX Support generally requires only the Base file; however, in some circumstances, may ask for the Extended file as well.

These are samples of what these two filenames look like, the date and time will be from the time frame these were collected:

    Base file - FNM000XXXX0021-diagnostics-2010-04-14-07.28.03.tar.gz
    Extended file - FNM000XXXX0021-extended-diagnostics-2010-04-14-07.28.03.tar.gz

To run collect diagnostics:

    Establish a SSH session to the Management Server and log into vplexcli
    Example:
      login as: service
      Using keyboard-interactive authentication.
      Password:
      service@ManagementServer:~> vplexcli
      Trying 1XX.0.X.1...
      Connected to localhost.
      Escape character is '^]'.

      username: service

      password:
      creating logfile:/var/log/VPlex/cli/session.log_service_localhost_T24190_20XXXX1407XXX1

 

    VPlexcli:/> collect-diagnostics
    2015-05-12 16:04:22 UTC: ****Initializing collect-diagnostics...
    2015-05-12 16:04:24 UTC: No cluster-witness server found.
    2015-05-12 16:04:24 UTC: No recoverpoint appliances found.
    2015-05-12 16:04:24 UTC: Free space = 36.86GB
    2015-05-12 16:04:24 UTC: Total space needed = 2.98GB
    2015-05-12 16:04:25 UTC: No cluster-witness server found.
    ================================================================================
    Starting collect-diagnostics, this operation might take a while...
    ================================================================================
    Executing Fast trace ..                                       OK
    Executing SMS log collection ..                               OK
    Executing director tracepath ..                               OK
    Executing health check ..                                     OK
    Executing debug tower-dump ..                                 OK
    ...
     
    When the command finishes and returns to the vplexcli prompt, connect to the mgmt server via winscp [or equivalent SCP utility] and navigate to /diag/collect-diagnostics-out/

 

    Identify the log file(s) with the correct timestamp and download them to your local workstation.

rman script level 0

export ORACLE_SID=SID

export DATE=date '+%Y%m%d_%H%M%S'

#backup incremental level 0 filesperset 8 database format 'Lev0_%d_%t_%u_%s_%p' plus archivelog;

RUN {
ALLOCATE CHANNEL C1 TYPE 'SBT_TAPE' TRACE 5 PARMS 'BLKSIZE=1048576, SBT_LIBRARY=/oracle/app/11.2/lib/libddobk.so,ENV=(STORAGE_UNIT=oraboost,BACKUP_HOST=10.48.223.102)' MAXOPENFILES 1;
ALLOCATE CHANNEL C2 TYPE 'SBT_TAPE' TRACE 5 PARMS 'BLKSIZE=1048576, SBT_LIBRARY=/oracle/app/11.2/lib/libddobk.so,ENV=(STORAGE_UNIT=oraboost,BACKUP_HOST=10.48.223.102)' MAXOPENFILES 1;

backup incremental level 0 filesperset 8 database format './ora-catalog/Lev0_%d_%t_%u_%s_%p';
#backup incremental level 0 as backupset filesperset 8 database format 'Lev0_%d_%t_%u_%s_%p';
sql 'alter system switch logfile';
backup archivelog all delete input;
backup current controlfile format './ora-catalog/%d_%t_%u_%s_%p_controlfile.cf';

RELEASE CHANNEL C1;
RELEASE CHANNEL C2;
}

rman script level 1

export ORACLE_SID=SID

export DATE=date '+%Y%m%d_%H%M%S'

#backup incremental level 1 filesperset 8 database format 'Lev1_%d_%t_%u_%s_%p' plus archivelog;

RUN {
ALLOCATE CHANNEL C1 TYPE 'SBT_TAPE' TRACE 5 PARMS 'BLKSIZE=1048576, SBT_LIBRARY=/oracle/app/11.2/lib/libddobk.so,ENV=(STORAGE_UNIT=ddboost01,BACKUP_HOST=10.48.223.102)' MAXOPENFILES 1;;
ALLOCATE CHANNEL C2 TYPE 'SBT_TAPE' TRACE 5 PARMS 'BLKSIZE=1048576, SBT_LIBRARY=/oracle/app/11.2/lib/libddobk.so,ENV=(STORAGE_UNIT=ddboost01,BACKUP_HOST=10.48.223.102)' MAXOPENFILES 1;;

backup incremental level 1 filesperset 8 database format './ora-catalog/Lev1_%d_%t_%u_%s_%p';
sql 'alter system switch logfile';
backup archivelog all delete input;
backup current controlfile format './ora-catalog/%d_%t_%u_%s_%p_controlfile.cf';

sql 'alter system switch logfile';
backup archivelog all delete input;

RELEASE CHANNEL C1;
RELEASE CHANNEL C2;
}

RMAN scripts

RMAN> create script backup_DDTEST_full
comment 'DDTEST FULL'
{
ALLOCATE CHANNEL C1 TYPE 'SBT_TAPE' TRACE 5 PARMS 'BLKSIZE=1048576, SBT_LIBRARY=/u01/app/oracle/product/11.2.0/db_1/lib/libddobk.so,ENV=(STORAGE_UNIT=ddboost01,BACKUP_HOST=192.168.25.112)';
backup incremental level 0 filesperset 8 database as backupset format 'Lev0_%d_%t_%u_%s_%p' plus archivelog;
backup current controlfile format '%d_%t_%u_%s_%p_controlfile.cf';
RELEASE CHANNEL C1;
}


created script backup_DDTEST_full

RMAN> 
RMAN> list script names;

List of Stored Scripts in Recovery Catalog


    Scripts of Target Database DDTEST

       Script Name
       Description
       -----------------------------------------------------------------------
       backup_DDTEST_full
       DDTEST FULL

RMAN> run {
2> execute script backup_DDTEST_full using 'SYSTEM'; }

executing script: backup_DDTEST_full

released channel: ORA_DISK_1
allocated channel: C1
channel C1: SID=166 instance=ddtest1 device type=SBT_TAPE
channel C1: Data Domain Boost API


Starting backup at 04-APR-18
...

delete expired backupset

RUN { ALLOCATE CHANNEL C2 TYPE 'SBT_TAPE' TRACE 5 PARMS 'BLKSIZE=1048576, SBT_LIBRARY=/u01/app/oracle/product/11.2.0/db_1/lib/libddobk.so,ENV=(STORAGE_UNIT=ddboost01,BACKUP_HOST=10.48.223.102)' MAXOPENFILES 1;; CROSSCHECK BACKUP; DELETE EXPIRED BACKUPSET;

CROSSCHECK archivelog all; DELETE EXPIRED archivelog all;

RELEASE CHANNEL C1; }

}}}

export RMAN_AGENT_HOME=/opt/dpsapps/rmanagent
export ORACLE_HOME=/oracle/app/11.2
export STORAGE_UNIT=oraboost
export BACKUP_HOST=10.48.223.102

initial setting

Catalog create

user & tablespace

SQL> create tablespace rman_catalog datafile '/data/oral/rman_catalog.dbf' size 50M AUTOEXTEND ON NEXT 10M MAXSIZE 5G; 

SQL> create user rman identified by rman default tablespace rman_catalog quota unlimited on rman_catalog;

SQL> grant recovery_catalog_owner to rman;
SQL> select privilege from dba_sys_privs where grantee = 'RECOVERY_CATALOG_OWNER';

RMAN recovery catalog

$ rman target /

RMAN> CREATE CATALOG;

tnsnames.ora SAMPLE

racdb =
  (DESCRIPTION =
    (ADDRESS_LIST =
      (ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.25.113)(PORT = 1521))
      (ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.25.114)(PORT = 1521))
    )
    (CONNECT_DATA =
      (SERVER = DEDICATED)
      (INSTANCE_NAME = ddtest1)
      (SERVICE_NAME = ddtest)
      (UR = A)
    )
  )

register database to RMAN catalog

$ rman  TARGET  /  CATALOG  rman@ddboost 

RMAN> REGISTER DATABASE; 
RMAN> REPORT SCHEMA;

target database RMAN setting

RMAN> configure controlfile autobackup on; 
RMAN> CONFIGURE RETENTION POLICY TO RECOVERY WINDOWS OF 14 DAYS; 

  # (control_file_record_keep_time = retention period + level 0 backup interval + 1) 
SQL> SHOW PARAMETER KEEP TIME; 
SQL> ALTER SYSTEM SET CONTROL_FILE_RECORD_KEEP_TIME=22 SCOPE=BOTH;

register RAC to DD2200 DD Boost (SAMPLE)

RUN {
ALLOCATE CHANNEL C1 TYPE 'SBT_TAPE' TRACE 5 PARMS 'BLKSIZE=1048576, SBT_LIBRARY=/oracle/app/11.2/lib/libddobk.so,ENV=(RMAN_AGENT_HOME=/opt/dpsapps/rmanagent)';
send 'hostnames rac01 rac02';
RELEASE CHANNEL C1;
}

note

RUN {
ALLOCATE CHANNEL C1 TYPE 'SBT_TAPE' PARMS 'SBT_LIBRARY=/oracle/app/11.2/lib/libddobk.so,ENV=(RMAN_AGENT_HOME=/opt/dpsapps/rmanagent)';
send 'set username ddboost password Systec36 servername 10.48.223.102';
RELEASE CHANNEL C1;
}
EXIT;

test if success

$ tail .bash_profile
alias tns='cd $ORACLE_HOME/network/admin'
alias envo='env | grep ORACLE'
alias sqlplus='rlwrap sqlplus'
alias rman='rlwrap rman'


umask 022
export RMAN_AGENT_HOME=/opt/dpsapps/rmanagent
export ORACLE_HOME=/oracle/app/11.2
export STORAGE_UNIT=oraboost
export BACKUP_HOST=10.48.223.102

oracle@ddboost-oracle ~ $ sbttest test.log -trace x.log -libname /oracle/app/11.2/lib/libddobk.so

GridControl installation

DB CHARACTER SET

SQL> select DECODE(parameter, 'NLS_CHARACTERSET', 'CHARACTER SET',
'NLS_LANGUAGE', 'LANGUAGE',
'NLS_TERRITORY', 'TERRITORY') name,
value from v$nls_parameters
WHERE parameter IN ( 'NLS_CHARACTERSET', 'NLS_LANGUAGE', 'NLS_TERRITORY')  2    3    4    5  
  6  ;

NAME          VALUE
------------- ----------------------------------------------------------------
LANGUAGE      AMERICAN
TERRITORY     AMERICA
CHARACTER SET ZHS16GBK

install JAVA jdk 6.0.45

deconfig EM control

post-db config task

un-install the database control

$ emca -deconfig dbcontrol db -repos drop

SQL> SELECT USERNAME FROM ALL_USERS WHERE USERNAME IN ('SYSMAN','SYSMAN_MDS');

Make the following initialization parameter changes.

show parameter log_buffer;
show parameter processes;
show parameter session_cached_cursors;

ALTER SYSTEM SET log_buffer=10485760 SCOPE=SPFILE;
ALTER SYSTEM SET processes=500 SCOPE=SPFILE;
ALTER SYSTEM SET session_cached_cursors=200 SCOPE=SPFILE;

install wls

oradb:~ # mkdir /opt/oracle/Middleware -v

oradb:~ # chown -R oracle:oinstall /opt/oracle/Middleware/

oracle@oradb:/orasoft/GridControl> java -jar wls1032_generic.jar 
Unable to instantiate GUI, defaulting to console mode.
Extracting 0%....................................................................................................100%

/opt/oracle/Middleware

uninstall if needed.

/opt/oracle/Middleware/utils/uninstall/uninstall.sh

install GridControl(OMS)

oracle@oradb:/orasoft/GridControl> for file in V20515-01_*.zip; do unzip $file; done

# xhost +
$ export DISPLAY=:1
oracle@oradb:/orasoft/GridControl> ./runInstaller
Starting Oracle Universal Installer...

Checking Temp space: must be greater than 150 MB.   Actual 51699 MB    Passed
Checking swap space: must be greater than 150 MB.   Actual 16382 MB    Passed
Checking monitor: must be configured to display at least 256 colors
    >>> Could not execute auto check for display colors using command /usr/bin/xdpyinfo. Check if the DISPLAY variable is set.    Failed <<<<

Some requirement checks failed. You must fulfill these requirements before

continuing with the installation,

Continue? (y/n) [n] y

OMS agent install

[root@OMS ~] rsync -aP /opt/oracle/Middleware/oms11g/sysman/agent_download root@192.168.25.113:/media

$ cd /media/agent_download/11.1.0.1.0/linux_x64
$ wget --no-check-certificate --secure-protocol=TLSv1   https://192.168.25.118:7799/agent_download/11.1.0.1.0/agent_download.rsp

editing agentDownload.linux_x64

else
   if [ -f /usr/bin/wget ]
   then
      WGET="/usr/bin/wget --no-check-certificate --secure-protocol=TLSv1"
   fi
fi

$ sh agentDownload.linux_x64 -b /u01/app/oracle/product/11.2.0/db_1/ -m 192.168.25.118 -r 7799 -y

# /u01/app/oracle/product/11.2.0/db_1//agent11g/root.sh

connected to recovery catalog database

connect target sys/Systec36@ddtest;
connect catalog ddboost/PASSWORD@rmandb;

RUN {
ALLOCATE CHANNEL C1 TYPE 'SBT_TAPE' TRACE 5 PARMS 'BLKSIZE=1048576, SBT_LIBRARY=/oracle/app/11.2/lib/libddobk.so,ENV=(STORAGE_UNIT=oraboost,BACKUP_HOST=10.48.223.102)' MAXOPENFILES 1;
ALLOCATE CHANNEL C2 TYPE 'SBT_TAPE' TRACE 5 PARMS 'BLKSIZE=1048576, SBT_LIBRARY=/oracle/app/11.2/lib/libddobk.so,ENV=(STORAGE_UNIT=oraboost,BACKUP_HOST=10.48.223.102)' MAXOPENFILES 1;

backup incremental level 0 filesperset 8 database format './oracle-catalog/Lev0_%d_%t_%u_%s_%p';
#backup incremental level 0 as backupset filesperset 8 database format 'Lev0_%d_%t_%u_%s_%p';
#sql 'alter system switch logfile';
#backup archivelog all delete input;
backup current controlfile format './oracl-catalog/%d_%t_%u_%s_%p_controlfile.cf';

RELEASE CHANNEL C1;
RELEASE CHANNEL C2;
}

DDRMAN-register-DOS

注册RAC数据库至DD2200 DD Boost (每个节点)

注. 'hostnames web-db1 web-db2' 要改为对应的主机名字。





#=================================

# WEBDB

#=================================



rm -vf /opt/dpsapps/rmanagent/config/ddboost*



rman target / catalog rman/rman@rman <<EOF

RUN {

ALLOCATE CHANNEL C1 TYPE 'SBT_TAPE' TRACE 5 PARMS 'BLKSIZE=1048576, SBT_LIBRARY=/oracle/app/11.2/lib/libddobk.so,ENV=(RMAN_AGENT_HOME=/opt/dpsapps/rmanagent)';

send 'hostnames web-db1 web-db2';

RELEASE CHANNEL C1;

}



RUN {

ALLOCATE CHANNEL C1 TYPE 'SBT_TAPE' PARMS 'SBT_LIBRARY=/oracle/app/11.2/lib/libddobk.so,ENV=(RMAN_AGENT_HOME=/opt/dpsapps/rmanagent)';

send 'set username ddboost password Systec36 servername 10.48.0.195';

RELEASE CHANNEL C1;

}

EOF















#=================================

# ciqdb 

#=================================

rm -vf /opt/dpsapps/rmanagent/config/ddboost*



rman target / catalog rman/rman@rman <<EOF

RUN {

ALLOCATE CHANNEL C1 TYPE 'SBT_TAPE' TRACE 5 PARMS 'BLKSIZE=1048576, SBT_LIBRARY=/oracle/app/11.2/lib/libddobk.so,ENV=(RMAN_AGENT_HOME=/opt/dpsapps/rmanagent)';

send 'hostnames ciq-db1 ciq-db2';

RELEASE CHANNEL C1;

}



RUN {

ALLOCATE CHANNEL C1 TYPE 'SBT_TAPE' PARMS 'SBT_LIBRARY=/oracle/app/11.2/lib/libddobk.so,ENV=(RMAN_AGENT_HOME=/opt/dpsapps/rmanagent)';

send 'set username ddboost password Systec36 servername 10.48.0.195';

RELEASE CHANNEL C1;

}

EOF











#=================================

# E-ciqdb 

#=================================

rm -vf /opt/dpsapps/rmanagent/config/ddboost*



rman target / catalog rman/rman@rman <<EOF



RUN {

ALLOCATE CHANNEL C1 TYPE 'SBT_TAPE' TRACE 5 PARMS 'BLKSIZE=1048576, SBT_LIBRARY=/oracle/app/11.2/lib/libddobk.so,ENV=(RMAN_AGENT_HOME=/opt/dpsapps/rmanagent)';

send 'hostnames ciqdb1 ciqdb2';

RELEASE CHANNEL C1;

}



RUN {

ALLOCATE CHANNEL C1 TYPE 'SBT_TAPE' PARMS 'SBT_LIBRARY=/oracle/app/11.2/lib/libddobk.so,ENV=(RMAN_AGENT_HOME=/opt/dpsapps/rmanagent)';

send 'set username ddboost password Systec36 servername 10.48.0.195';

RELEASE CHANNEL C1;

}



EOF







#=================================

# exdb

#=================================

rm -vf /opt/dpsapps/rmanagent/config/ddboost*



rman target / catalog rman/rman@rman <<EOF



RUN {

ALLOCATE CHANNEL C1 TYPE 'SBT_TAPE' TRACE 5 PARMS 'BLKSIZE=1048576, SBT_LIBRARY=/oracle/app/11.2/lib/libddobk.so,ENV=(RMAN_AGENT_HOME=/opt/dpsapps/rmanagent)';

send 'hostnames exvm1 exvm2';

RELEASE CHANNEL C1;

}



RUN {

ALLOCATE CHANNEL C1 TYPE 'SBT_TAPE' PARMS 'SBT_LIBRARY=/oracle/app/11.2/lib/libddobk.so,ENV=(RMAN_AGENT_HOME=/opt/dpsapps/rmanagent)';

send 'set username ddboost password Systec36 servername 10.48.0.195';

RELEASE CHANNEL C1;

}



EOF

désert/workarea/zhjyjyj

Notes 基于 IP 哈希的路由

Cisco switch setting

Port Channel/Aggr

Port Channel/Aggr

Oracle RAC

SAN_01 & SAN_03

Inter Switch Link (ISL) Setting

创建别名

ZONE划分

VPLEX_E2_A1 with VNX5200 (预留)

创建并激活CONFIG

SAN_02 & SAN_04

Inter Switch Link (ISL) Setting

创建别名

ZONE划分

VPLEX_E2_A1 with VNX5200 (预留)

创建并激活CONFIG

Host HBAs

Vplex

rman script level 0

rman script level 1

RMAN scripts

delete expired backupset

initial setting

Catalog create

tnsnames.ora SAMPLE

register database to RMAN catalog

target database RMAN setting

register RAC to DD2200 DD Boost (SAMPLE)

GridControl installation

DB CHARACTER SET

install JAVA jdk 6.0.45

deconfig EM control

post-db config task

install wls

install GridControl(OMS)

OMS agent install

connected to recovery catalog database

DDRMAN-register-DOS