Migrating and SAP HANA Primary
HDB资源之主备切换
Pre move
- Set the rsc_SAPHana_SLE_HDB00 to be maintenance.
~# crm resouce maintenance rsc_SAPHana_SLE_HDB00
saprep01:~ # crm status detail
Stack: corosync
Current DC: saprep01 (1) (version 1.1.15-19.15-e174ec8) - partition with quorum
Last updated: Tue Aug 8 16:02:14 2023
Last change: Tue Aug 8 15:52:13 2023 by root via crm_resource on saprep01
2 nodes configured
6 resources configured
Online: [ saprep01 (1) saprep02 (2) ]
stonith-sbd (stonith:external/sbd): Started saprep01
rsc_ip_SLE_HDB00 (ocf::heartbeat:IPaddr2): Started saprep02
Master/Slave Set: msl_SAPHana_SLE_HDB00 [rsc_SAPHana_SLE_HDB00] (unmanaged)
rsc_SAPHana_SLE_HDB00 (ocf::suse:SAPHana): Slave saprep01 (unmanaged)
rsc_SAPHana_SLE_HDB00 (ocf::suse:SAPHana): Master saprep02 (unmanaged)
Clone Set: cln_SAPHanaTopology_SLE_HDB00 [rsc_SAPHanaTopology_SLE_HDB00]
rsc_SAPHanaTopology_SLE_HDB00 (ocf::suse:SAPHanaTopology): Started saprep01
rsc_SAPHanaTopology_SLE_HDB00 (ocf::suse:SAPHanaTopology): Started saprep02
Started: [ saprep01 saprep02 ]
Manual Takeove Process
- Stop the primary SAP HANA database system.
~$ sapcontrol -nr 0 -function StopSystem HDB
- Start the takeover on the secondary SAP HANA database system.
~$ hdbnsutl -sr_takeover
- Register the former primary to become the new secondary.
~$ hdbnsutil -sr_register --name=DRSITE01 --remoteHost=saprep02 --remoteInstance=00 --replicationMode=async --operationMode=logreplay
- Start the new secondary SAP HANA database system.
~$ sapcontrol -nr 0 -function StartSystem HDB
Post Migrate
- Wait some time till SAPHanaSR-showAttr shows both SAP HANA database systems to be up again (field roles must start with the digit 4). The new secondary should have role "S" (for secondary).
- Tell the cluster to forget about the former master-slave roles and to re-monitor the failed master. The command could be submitted on any cluster node as user root.
saprep01:~ # crm resource refresh rsc_SAPHana_SLE_HDB00
- Set the master/slave resource to the status managed again. The command could be submitted on any cluster node as user root.
~# crm resouce maintenance rsc_SAPHana_SLE_HDB00 off
Check
crm status detail
或
crm_mon -R -A
saprep01:~ # crm status detail
Stack: corosync
Current DC: saprep01 (1) (version 1.1.15-19.15-e174ec8) - partition with quorum
Last updated: Tue Aug 8 16:22:26 2023
Last change: Tue Aug 8 16:22:02 2023 by hacluster via crmd on saprep02
2 nodes configured
6 resources configured
Online: [ saprep01 (1) saprep02 (2) ]
stonith-sbd (stonith:external/sbd): Started saprep01
rsc_ip_SLE_HDB00 (ocf::heartbeat:IPaddr2): Started saprep01
Master/Slave Set: msl_SAPHana_SLE_HDB00 [rsc_SAPHana_SLE_HDB00]
rsc_SAPHana_SLE_HDB00 (ocf::suse:SAPHana): Master saprep01
rsc_SAPHana_SLE_HDB00 (ocf::suse:SAPHana): Slave saprep02
Masters: [ saprep01 ]
Slaves: [ saprep02 ]
Clone Set: cln_SAPHanaTopology_SLE_HDB00 [rsc_SAPHanaTopology_SLE_HDB00]
rsc_SAPHanaTopology_SLE_HDB00 (ocf::suse:SAPHanaTopology): Started saprep01
rsc_SAPHanaTopology_SLE_HDB00 (ocf::suse:SAPHanaTopology): Started saprep02
Started: [ saprep01 saprep02 ]# crm_mon -R -A
# crm status --show-detail --show-node-attributes
Stack: corosync
Current DC: saprep01 (1) (version 1.1.15-19.15-e174ec8) - partition with quorum
Last updated: Tue Aug 8 16:27:28 2023
Last change: Tue Aug 8 16:26:57 2023 by root via crm_attribute on saprep01
2 nodes configured
6 resources configured
Online: [ saprep01 (1) saprep02 (2) ]
stonith-sbd (stonith:external/sbd): Started saprep01
rsc_ip_SLE_HDB00 (ocf::heartbeat:IPaddr2): Started saprep01
Master/Slave Set: msl_SAPHana_SLE_HDB00 [rsc_SAPHana_SLE_HDB00]
rsc_SAPHana_SLE_HDB00 (ocf::suse:SAPHana): Master saprep01
rsc_SAPHana_SLE_HDB00 (ocf::suse:SAPHana): Slave saprep02
Masters: [ saprep01 ]
Slaves: [ saprep02 ]
Clone Set: cln_SAPHanaTopology_SLE_HDB00 [rsc_SAPHanaTopology_SLE_HDB00]
rsc_SAPHanaTopology_SLE_HDB00 (ocf::suse:SAPHanaTopology): Started saprep01
rsc_SAPHanaTopology_SLE_HDB00 (ocf::suse:SAPHanaTopology): Started saprep02
Started: [ saprep01 saprep02 ]
Node Attributes:
* Node saprep01 (1):
+ hana_sle_clone_state : PROMOTED
+ hana_sle_op_mode : logreplay
+ hana_sle_remoteHost : saprep02
+ hana_sle_roles : 4:P:master1:master:worker:master
+ hana_sle_site : DRSITE01
+ hana_sle_srmode : async
+ hana_sle_sync_state : PRIM
+ hana_sle_vhost : saprep01
+ lpa_sle_lpt : 1691483217
+ master-rsc_SAPHana_SLE_HDB00 : 150
* Node saprep02 (2):
+ hana_sle_clone_state : DEMOTED
+ hana_sle_op_mode : logreplay
+ hana_sle_remoteHost : saprep01
+ hana_sle_roles : 4:S:master1:master:worker:master
+ hana_sle_site : DRSITE02
+ hana_sle_srmode : async
+ hana_sle_sync_state : SOK
+ hana_sle_vhost : saprep02
+ lpa_sle_lpt : 30
+ master-rsc_SAPHana_SLE_HDB00 : 100saprep01:~ # SAPHanaSR-showAttr
saprep01:~ # SAPHanaSR-showAttr Open live cib CIB-time: Tue Aug 8 16:22:36 2023 Hosts clone_state lpa_sle_lpt node_status op_mode remoteHost roles site srmode sync_state vhost --------------------------------------------------------------------------------------------------------------------------------------- 1 PROMOTED 1691482956 logreplay saprep02 4:P:master1:master:worker:master DRSITE01 async PRIM saprep01 2 DEMOTED 30 logreplay saprep01 4:S:master1:master:worker:master DRSITE02 async SOK saprep02 saprep01 online saprep02 online
saprep01:sleadm> HDBSettings.sh systemReplicationStatus.py --sapcontrol=0
saprep01:sleadm> HDBSettings.sh systemReplicationStatus.py --sapcontrol=0 | Database | Host | Port | Service Name | Volume ID | Site ID | Site Name | Secondary | Secondary | Secondary | Secondary | Secondary | Replication | Replication | Replication | | | | | | | | | Host | Port | Site ID | Site Name | Active Status | Mode | Status | Status Details | | -------- | -------- | ----- | ------------ | --------- | ------- | --------- | --------- | --------- | --------- | --------- | ------------- | ----------- | ----------- | -------------- | | SYSTEMDB | saprep01 | 30001 | nameserver | 1 | 1 | DRSITE01 | saprep02 | 30001 | 2 | DRSITE02 | YES | ASYNC | ACTIVE | | | SLE | saprep01 | 30007 | xsengine | 2 | 1 | DRSITE01 | saprep02 | 30007 | 2 | DRSITE02 | YES | ASYNC | ACTIVE | | | SLE | saprep01 | 30003 | indexserver | 3 | 1 | DRSITE01 | saprep02 | 30003 | 2 | DRSITE02 | YES | ASYNC | ACTIVE | | status system replication site "2": ACTIVE overall system replication status: ACTIVE Local System Replication State ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ mode: PRIMARY site id: 1 site name: DRSITE01
saprep01:sleadm> hdbnsutil -sr_state
saprep01:sleadm> hdbnsutil -sr_state System Replication State ~~~~~~~~~~~~~~~~~~~~~~~~ online: true mode: primary operation mode: primary site id: 1 site name: DRSITE01 is source system: true is secondary/consumer system: false has secondaries/consumers attached: true is a takeover active: false Host Mappings: ~~~~~~~~~~~~~~ saprep01 -> [DRSITE02] saprep02 saprep01 -> [DRSITE01] saprep01 done.
saprep01:sleadm> HDBSettings.sh systemReplicationStatus.py --sapcontrol=1
saprep01:sleadm> HDBSettings.sh systemReplicationStatus.py --sapcontrol=1 SAPCONTROL-OK: <begin> service/saprep01/30001/SHIPPED_LOG_POSITION_TIME=2023-08-08 17:23:23.280459 service/saprep01/30001/LAST_LOG_POSITION_TIME=2023-08-08 17:23:23.280459 service/saprep01/30001/SHIPPED_FULL_REPLICA_DURATION=19359026 service/saprep01/30001/SHIPPED_LAST_DELTA_REPLICA_START_TIME=- service/saprep01/30001/SHIPPED_FULL_REPLICA_SIZE=1543503872 service/saprep01/30001/SITE_ID=1 service/saprep01/30001/LAST_LOG_POSITION=63110528 service/saprep01/30001/SECONDARY_ACTIVE_STATUS=YES service/saprep01/30001/LAST_SAVEPOINT_LOG_POSITION=63110402 service/saprep01/30001/FULL_SYNC=DISABLED service/saprep01/30001/OPERATION_MODE=logreplay service/saprep01/30001/SHIPPED_LAST_FULL_REPLICA_START_TIME=2023-08-08 15:58:05.102148 service/saprep01/30001/LAST_SAVEPOINT_VERSION=520 service/saprep01/30001/LAST_SAVEPOINT_START_TIME=2023-08-08 17:23:10.023893 service/saprep01/30001/SERVICE_NAME=nameserver service/saprep01/30001/PORT=30001 service/saprep01/30001/SHIPPED_DELTA_REPLICA_COUNT=0 service/saprep01/30001/LAST_RESET_TIME=2023-08-08 15:57:22.942410 service/saprep01/30001/SECONDARY_FAILOVER_COUNT=0 service/saprep01/30001/SHIPPED_FULL_REPLICA_COUNT=1 service/saprep01/30001/SHIPPED_LOG_BUFFERS_DURATION=9052 service/saprep01/30001/REPLICATION_STATUS_DETAILS= service/saprep01/30001/SHIPPED_DELTA_REPLICA_SIZE=0 service/saprep01/30001/SHIPPED_LOG_POSITION=63110528 service/saprep01/30001/SHIPPED_DELTA_REPLICA_DURATION=0 service/saprep01/30001/RESET_COUNT=0 service/saprep01/30001/SHIPPED_LAST_DELTA_REPLICA_SIZE=0 service/saprep01/30001/SHIPPED_LAST_DELTA_REPLICA_END_TIME=- service/saprep01/30001/SITE_NAME=DRSITE01 service/saprep01/30001/SECONDARY_SITE_NAME=DRSITE02 service/saprep01/30001/REPLAYED_LOG_POSITION_TIME=2023-08-08 17:23:23.280459 service/saprep01/30001/SHIPPED_LAST_FULL_REPLICA_END_TIME=2023-08-08 15:58:24.461174 service/saprep01/30001/CREATION_TIME=2023-08-08 15:57:22.942410 service/saprep01/30001/HOST=saprep01 service/saprep01/30001/SHIPPED_SAVEPOINT_VERSION=493 service/saprep01/30001/SECONDARY_HOST=saprep02 service/saprep01/30001/VOLUME_ID=1 service/saprep01/30001/SHIPPED_LAST_FULL_REPLICA_SIZE=1543503872 service/saprep01/30001/SHIPPED_LOG_BUFFERS_SIZE=659456 service/saprep01/30001/REPLICATION_MODE=ASYNC service/saprep01/30001/DATABASE=SYSTEMDB service/saprep01/30001/REPLAYED_LOG_POSITION=63110528 service/saprep01/30001/SECONDARY_RECONNECT_COUNT=1 service/saprep01/30001/SHIPPED_SAVEPOINT_START_TIME=2023-08-08 15:58:05.102148 service/saprep01/30001/SECONDARY_PORT=30001 service/saprep01/30001/SHIPPED_SAVEPOINT_LOG_POSITION=63100418 service/saprep01/30001/REPLICATION_STATUS=ACTIVE service/saprep01/30001/SECONDARY_CONNECT_TIME=2023-08-08 16:13:09.783039 service/saprep01/30001/SHIPPED_LOG_BUFFERS_COUNT=161 service/saprep01/30001/SECONDARY_SITE_ID=2 service/saprep01/30007/SHIPPED_LOG_POSITION_TIME=2023-08-08 17:23:31.378885 service/saprep01/30007/LAST_LOG_POSITION_TIME=2023-08-08 17:23:31.378885 service/saprep01/30007/SHIPPED_FULL_REPLICA_DURATION=0 service/saprep01/30007/SHIPPED_LAST_DELTA_REPLICA_START_TIME=- service/saprep01/30007/SHIPPED_FULL_REPLICA_SIZE=0 service/saprep01/30007/SITE_ID=1 service/saprep01/30007/LAST_LOG_POSITION=1077824 service/saprep01/30007/SECONDARY_ACTIVE_STATUS=YES service/saprep01/30007/LAST_SAVEPOINT_LOG_POSITION=1075843 service/saprep01/30007/FULL_SYNC=DISABLED service/saprep01/30007/OPERATION_MODE=logreplay service/saprep01/30007/SHIPPED_LAST_FULL_REPLICA_START_TIME=- service/saprep01/30007/LAST_SAVEPOINT_VERSION=532 service/saprep01/30007/LAST_SAVEPOINT_START_TIME=2023-08-08 17:19:24.809126 service/saprep01/30007/SERVICE_NAME=xsengine service/saprep01/30007/PORT=30007 service/saprep01/30007/SHIPPED_DELTA_REPLICA_COUNT=0 service/saprep01/30007/LAST_RESET_TIME=2023-08-08 15:57:22.921136 service/saprep01/30007/SECONDARY_FAILOVER_COUNT=0 service/saprep01/30007/SHIPPED_FULL_REPLICA_COUNT=0 service/saprep01/30007/SHIPPED_LOG_BUFFERS_DURATION=24143 service/saprep01/30007/REPLICATION_STATUS_DETAILS= service/saprep01/30007/SHIPPED_DELTA_REPLICA_SIZE=0 service/saprep01/30007/SHIPPED_LOG_POSITION=1077824 service/saprep01/30007/SHIPPED_DELTA_REPLICA_DURATION=0 service/saprep01/30007/RESET_COUNT=0 service/saprep01/30007/SHIPPED_LAST_DELTA_REPLICA_SIZE=0 service/saprep01/30007/SHIPPED_LAST_DELTA_REPLICA_END_TIME=- service/saprep01/30007/SITE_NAME=DRSITE01 service/saprep01/30007/SECONDARY_SITE_NAME=DRSITE02 service/saprep01/30007/REPLAYED_LOG_POSITION_TIME=2023-08-08 17:23:31.378885 service/saprep01/30007/SHIPPED_LAST_FULL_REPLICA_END_TIME=- service/saprep01/30007/CREATION_TIME=2023-08-08 15:57:22.921136 service/saprep01/30007/HOST=saprep01 service/saprep01/30007/SHIPPED_SAVEPOINT_VERSION=0 service/saprep01/30007/SECONDARY_HOST=saprep02 service/saprep01/30007/VOLUME_ID=2 service/saprep01/30007/SHIPPED_LAST_FULL_REPLICA_SIZE=0 service/saprep01/30007/SHIPPED_LOG_BUFFERS_SIZE=2342912 service/saprep01/30007/REPLICATION_MODE=ASYNC service/saprep01/30007/DATABASE=SLE service/saprep01/30007/REPLAYED_LOG_POSITION=1077763 service/saprep01/30007/SECONDARY_RECONNECT_COUNT=1 service/saprep01/30007/SHIPPED_SAVEPOINT_START_TIME=- service/saprep01/30007/SECONDARY_PORT=30007 service/saprep01/30007/SHIPPED_SAVEPOINT_LOG_POSITION=0 service/saprep01/30007/REPLICATION_STATUS=ACTIVE service/saprep01/30007/SECONDARY_CONNECT_TIME=2023-08-08 16:13:25.548651 service/saprep01/30007/SHIPPED_LOG_BUFFERS_COUNT=572 service/saprep01/30007/SECONDARY_SITE_ID=2 service/saprep01/30003/SHIPPED_LOG_POSITION_TIME=2023-08-08 17:23:51.200949 service/saprep01/30003/LAST_LOG_POSITION_TIME=2023-08-08 17:23:51.200949 service/saprep01/30003/SHIPPED_FULL_REPLICA_DURATION=0 service/saprep01/30003/SHIPPED_LAST_DELTA_REPLICA_START_TIME=- service/saprep01/30003/SHIPPED_FULL_REPLICA_SIZE=0 service/saprep01/30003/SITE_ID=1 service/saprep01/30003/LAST_LOG_POSITION=65361600 service/saprep01/30003/SECONDARY_ACTIVE_STATUS=YES service/saprep01/30003/LAST_SAVEPOINT_LOG_POSITION=65356610 service/saprep01/30003/FULL_SYNC=DISABLED service/saprep01/30003/OPERATION_MODE=logreplay service/saprep01/30003/SHIPPED_LAST_FULL_REPLICA_START_TIME=- service/saprep01/30003/LAST_SAVEPOINT_VERSION=542 service/saprep01/30003/LAST_SAVEPOINT_START_TIME=2023-08-08 17:22:51.197641 service/saprep01/30003/SERVICE_NAME=indexserver service/saprep01/30003/PORT=30003 service/saprep01/30003/SHIPPED_DELTA_REPLICA_COUNT=0 service/saprep01/30003/LAST_RESET_TIME=2023-08-08 15:57:22.936572 service/saprep01/30003/SECONDARY_FAILOVER_COUNT=0 service/saprep01/30003/SHIPPED_FULL_REPLICA_COUNT=0 service/saprep01/30003/SHIPPED_LOG_BUFFERS_DURATION=358540 service/saprep01/30003/REPLICATION_STATUS_DETAILS= service/saprep01/30003/SHIPPED_DELTA_REPLICA_SIZE=0 service/saprep01/30003/SHIPPED_LOG_POSITION=65361600 service/saprep01/30003/SHIPPED_DELTA_REPLICA_DURATION=0 service/saprep01/30003/RESET_COUNT=0 service/saprep01/30003/SHIPPED_LAST_DELTA_REPLICA_SIZE=0 service/saprep01/30003/SHIPPED_LAST_DELTA_REPLICA_END_TIME=- service/saprep01/30003/SITE_NAME=DRSITE01 service/saprep01/30003/SECONDARY_SITE_NAME=DRSITE02 service/saprep01/30003/REPLAYED_LOG_POSITION_TIME=2023-08-08 17:23:51.200949 service/saprep01/30003/SHIPPED_LAST_FULL_REPLICA_END_TIME=- service/saprep01/30003/CREATION_TIME=2023-08-08 15:57:22.936572 service/saprep01/30003/HOST=saprep01 service/saprep01/30003/SHIPPED_SAVEPOINT_VERSION=0 service/saprep01/30003/SECONDARY_HOST=saprep02 service/saprep01/30003/VOLUME_ID=3 service/saprep01/30003/SHIPPED_LAST_FULL_REPLICA_SIZE=0 service/saprep01/30003/SHIPPED_LOG_BUFFERS_SIZE=35930112 service/saprep01/30003/REPLICATION_MODE=ASYNC service/saprep01/30003/DATABASE=SLE service/saprep01/30003/REPLAYED_LOG_POSITION=65361600 service/saprep01/30003/SECONDARY_RECONNECT_COUNT=1 service/saprep01/30003/SHIPPED_SAVEPOINT_START_TIME=- service/saprep01/30003/SECONDARY_PORT=30003 service/saprep01/30003/SHIPPED_SAVEPOINT_LOG_POSITION=0 service/saprep01/30003/REPLICATION_STATUS=ACTIVE service/saprep01/30003/SECONDARY_CONNECT_TIME=2023-08-08 16:13:29.380937 service/saprep01/30003/SHIPPED_LOG_BUFFERS_COUNT=7842 service/saprep01/30003/SECONDARY_SITE_ID=2 site/2/SITE_NAME=DRSITE02 site/2/SOURCE_SITE_ID=1 site/2/REPLICATION_MODE=ASYNC site/2/REPLICATION_STATUS=ACTIVE overall_replication_status=ACTIVE site/1/REPLICATION_MODE=PRIMARY site/1/SITE_NAME=DRSITE01 local_site_id=1 SAPCONTROL-OK: <end>