VCS関連 - mitsuaki0717/shino-repo GitHub Wiki
●インストール
tar zxvf Veritas_InfoScale_7.1_RHEL.tar.gz cd /var/tmp/dvd1-redhatlinux/rhel6_x86_64 ./installer -precheck rhel6-test1 rhel6-test2
質問1 今回はEnterpriseでインストールするため4を入力 1) Veritas InfoScale Foundation 2) Veritas InfoScale Availability 3) Veritas InfoScale Storage 4) Veritas InfoScale Enterprise
質問2 Select a product to perform pre-installation check for: [1-4,q]4
1) Cluster Server (VCS)
2) Storage Foundation (SF)
3) Storage Foundation and High Availability (SFHA)
4) Storage Foundation Cluster File System HA (SFCFSHA)
5) Storage Foundation for Oracle RAC (SF Oracle RAC)
6) Storage Foundation for Sybase ASE CE (SFSYBASECE)
Select a component to perform pre-installation check for: [1-6,q]3
質問3 Would you like the installer to setup ssh or rsh communication automatically between the systems? Superuser passwords for the systems will be asked. [y,n,q,?] (y)y
Enter the superuser password for system rhel6-test2:
質問4 1) Setup ssh between the systems 2) Setup rsh between the systems b) Back to previous menu
Select the communication method [1-2,b,q,?] (1)1
質問5 Would you like to install InfoScale Enterprise on rhel6-test1 rhel6-test2? [y,n,q] (n)y
質問6 This product may contain open source and other third party materials that are subject to a separate license. See the applicable Third-Party Notice at https://www.veritas.com/about/legal/license-agreements
Do you agree with the terms of the End User License Agreement as specified in the EULA/ja/EULA.pdf file present on media? [y,n,q,?]y
質問7 1) Enter a valid license key 2) Enable keyless licensing and complete system licensing later
How would you like to license the systems? [1-2,q] (2)2
質問8 1) Veritas InfoScale Foundation 2) Veritas InfoScale Availability 3) Veritas InfoScale Storage 4) Veritas InfoScale Enterprise b) Back to previous menu
Which product would you like to register? [1-4,b,q] (4) 4
質問9 Do you want to configure I/O Fencing in enabled mode? [y,n,q,?] (y)y
Press [Enter] to continue:
質問10 Enter the unique cluster name: [q,?] test-cluster
質問11 1) Configure the heartbeat links using LLT over Ethernet 2) Configure the heartbeat links using LLT over UDP 3) Configure the heartbeat links using LLT over RDMA 4) Automatically detect configuration for LLT over Ethernet b) Back to previous menu
How would you like to configure heartbeat links? [1-4,b,q,?] (4)
質問12 Discovering NICs on rhel6-test1 .............. Discovered eth0 eth1 eth2
Enter the NIC for the first private heartbeat link on rhel6-test1: [b,q,?] (eth1) eth1
質問13 Would you like to configure a second private heartbeat link? [y,n,q,b,?] (n)y
質問14 Enter the NIC for the second private heartbeat link on rhel6-test1: [b,q,?] (eth2) eth2
質問15 Do you want to configure an additional low-priority heartbeat link? [y,n,q,b,?] (n)n
質問16 Are you using the same NICs for private heartbeat links on all systems? [y,n,q,b,?] (y)y
質問17 Enter a unique cluster ID number between 0-65535: [b,q,?] (9243)未入力
質問18 Would you like to check if the cluster ID is in use by another cluster? [y,n,q] (y)y
Duplicated cluster ID detection passed. The cluster ID 9243 can be used for the cluster.
Press [Enter] to continue:
質問19 Cluster information verification:
Cluster Name: test-cluster
Cluster ID Number: 9243
Private Heartbeat NICs for rhel6-test1:
link1=eth1
link2=eth2
Private Heartbeat NICs for rhel6-test2:
link1=eth1
link2=eth2
Is this information correct? [y,n,q,?] (y)y
質問20 The following data is required to configure the Virtual IP of the Cluster:
A public NIC used by each system in the cluster
A Virtual IP address and netmask
Do you want to configure the Virtual IP? [y,n,q,?] (n)
質問21 The following data is required to configure the Virtual IP of the Cluster:
A public NIC used by each system in the cluster
A Virtual IP address and netmask
Do you want to configure the Virtual IP? [y,n,q,?] (n)n
質問22 Would you like to configure the VCS cluster in secure mode? [y,n,q,?] (y)n
質問23 Are you sure that you want to proceed with non-secure installation? [y,n,q] (n)y
質問24 The following information is required to add VCS users:
A user name
A password for the user
User privileges (Administrator, Operator, or Guest)
Do you wish to accept the default cluster credentials of 'admin/password'? [y,n,q] (y) n
質問25 Enter the user name: [b,q,?] (admin) root Enter the password: Enter again:
質問26 Do you want to add another user to the cluster? [y,n,q] (n)n
質問27 VCS User verification:
User: root Privilege: Administrators
Passwords are not displayed
Is this information correct? [y,n,q] (y)y
質問28 The following information is required to configure SMTP notification:
The domain-based hostname of the SMTP server
The email address of each SMTP recipient
A minimum severity level of messages to send to each recipient
Do you want to configure SMTP notification? [y,n,q,?] (n)n
質問29 The following information is required to configure SNMP notification:
System names of SNMP consoles to receive VCS trap messages
SNMP trap daemon port numbers for each console
A minimum severity level of messages to send to each console
Do you want to configure SNMP notification? [y,n,q,?] (n) n
質問30 The following data is required to configure the Global Cluster Option:
A public NIC used by each system in the cluster
A Virtual IP address and netmask
Do you want to configure the Global Cluster Option? [y,n,q,?] (n)n
質問31 Do you want to stop InfoScale Enterprise processes now? [y,n,q,?] (y)y
質問32 Fencing configuration 1) Configure Coordination Point client based fencing 2) Configure disk based fencing 3) Configure majority based fencing
Select the fencing mechanism to be configured in this Application Cluster: [1-3,q,?]2
質問33 This I/O fencing configuration option requires a restart of VCS. Installer will stop VCS at a later stage in this run. Note that the service groups will be online only on the systems that are in the 'AutoStartList' after restarting VCS. Do you want to continue? [y,n,q,b,?]y
質問34 Do you have SCSI3 PR enabled disks? [y,n,q,b,?] (y)y
質問35 Select one of the options below for fencing disk group: 1) Create a new disk group b) Back to previous menu
Enter the choice for a disk group: [1-1,b,q]1
質問36 Do you want to initialize more disks as VxVM disks? [y,n,q,b] (y)y
質問37 List of disks which can be initialized as VxVM disks: 1) rhel6-test1_vmdk0_0 2) rhel6-test1_vmdk0_1 3) rhel6-test1_vmdk0_2 4) rhel6-test1_vmdk0_3 5) rhel6-test1_vmdk0_4 6) rhel6-test1_vmdk0_5 b) Back to previous menu
Enter the disk options, separated by spaces: [1-6,b,q] 1,2,3
質問38 1) rhel6-test1_vmdk0_0 2) rhel6-test1_vmdk0_1 3) rhel6-test1_vmdk0_2 b) Back to previous menu
Select odd number of disks and at least three disks to form a disk group. Enter the disk options, separated by spaces: [1-3,b,q] 1,2,3
質問39 Enter the new disk group name: [b] dg_fen
質問40 As per the 'vxfentsthdw' run you performed, do you want to continue with this disk group? [y,n,q] (y)y
質問41 I/O fencing configuration verification
Disk Group: dg_fen
Fencing disk policy: dmp
Is this information correct? [y,n,q] (y)y
質問42 Installer will stop VCS before applying fencing configuration. To make sure VCS shuts down successfully, unfreeze any frozen service group and unmount the mounted file systems in the cluster.
HAD and all the applications will be stopped. Do you want to stop VCS and all its applications and apply fencing configuration on all nodes at this point? [y,n,q] (y)y
質問43 Do you want to configure Coordination Point Agent on the client cluster? [y,n,q] (y) y
質問44 Enter a non-existing name for the service group for Coordination Point Agent: [b] (vxfen)
質問45 Do you want to set LevelTwoMonitorFreq? [y,n,q] (y)y
質問46 Enter the value of the LevelTwoMonitorFreq attribute(0 to 65535): [b,q,?] (5)
質問47 Do you want to enable auto refresh of coordination points if registration keys are missing on any of them? [y,n,q,b,?] (n)
質問48 Do you want to cleanup the communication for the systems rhel6-test2? [y,n,q] (n)n
質問49 Would you like to view the summary file? [y,n,q] (n) n
●ディスクグループ作成 ・新規ディスク有効化 /opt/VRTS/bin/vxdisksetup -i xtremio0_3 (1000GB) /opt/VRTS/bin/vxdisksetup -i xtremio0_4 (400GB) /opt/VRTS/bin/vxdisksetup -i xtremio0_5
・新規ディスクグループを作成 /opt/VRTS/bin/vxdg -s init BUKKEN_ORAAREA ORAAREA=xtremio0_3 /opt/VRTS/bin/vxdg -s init BUKKEN_ARCAREA ARCAREA=xtremio0_4
・ボリューム作成 /opt/VRTS/bin/vxassist -g BUKKEN_ORAAREA make vol1 maxsize /opt/VRTS/bin/vxassist -g BUKKEN_ARCAREA make vol1 400g
・ファイルシステム作成 /opt/VRTS/bin/mkfs -t vxfs /dev/vx/rdsk/BUKKEN_ORAAREA/vol1 /opt/VRTS/bin/mkfs -t vxfs /dev/vx/rdsk/BUKKEN_ARCAREA/vol1
/opt/VRTS/bin/mount -t vxfs /dev/vx/dsk/BUKKEN_ARCAREA/vol1 /mnt
●サービスグループ作成 ・サービスグループ登録 /opt/VRTS/bin/hagrp -add sg1 /opt/VRTS/bin/hagrp -modify sg1 SystemList BKNDBN01 0 BKNDBN02 1 /opt/VRTS/bin/hagrp -modify sg1 AutoStartList BKNDBN01
・リソース追加1(NIC) /opt/VRTS/bin/hares -add sg1_NIC_bond0 NIC sg1 /opt/VRTS/bin/hares -modify sg1_NIC_bond0 Device bond0 /opt/VRTS/bin/hares -modify sg1_NIC_bond0 NetworkHosts "10.2.122.254" /opt/VRTS/bin/hares -modify sg1_NIC_bond0 Enabled 1
・リソース追加1(vIP) /opt/VRTS/bin/hares -add sg1_vIP_bond0 IP sg1 /opt/VRTS/bin/hares -modify sg1_vIP_bond0 Device bond0 /opt/VRTS/bin/hares -modify sg1_vIP_bond0 Address "10.2.122.12" /opt/VRTS/bin/hares -modify sg1_vIP_bond0 NetMask "255.255.255.0" /opt/VRTS/bin/hares -modify sg1_vIP_bond0 Enabled 1 /opt/VRTS/bin/hares -link sg1_vIP sg1_NIC_bond0
・リソース追加1(shareDisk1) /opt/VRTS/bin/haconf -makerw /opt/VRTS/bin/hares -modify sg1_mount_ARCAREA MountPoint "/oraarchive/bukken/arch" /opt/VRTS/bin/haconf -dump -makero
要検討 サービスグループのオプション ・AutoFailOver ・AutoRestart
●本番 group sg1 ( SystemList = { BKNDBN01 = 0, BKNDBN02 = 1 } AutoStartList = { BKNDBN01 } )
NIC sg1_NIC_bond0 (
Device = bond0
NetworkHosts = { "10.2.122.254" }
)
IP sg1_vIP_bond0 (
Device = bond0
Address = "10.2.122.12"
NetMask = "255.255.255.0"
)
DiskGroup sg1_dg_ORAAREA (
DiskGroup = BUKKEN_ORAAREA
StartVolumes = 0
StopVolumes = 0
)
DiskGroup sg1_dg_ARCAREA (
DiskGroup = BUKKEN_ARCAREA
StartVolumes = 0
StopVolumes = 0
)
Volume sg1_vol_ORAAREA (
DiskGroup = BUKKEN_ORAAREA
Volume = vol1
)
Volume sg1_vol_ARCAREA (
DiskGroup = BUKKEN_ARCAREA
Volume = vol1
)
Mount sg1_mount_ORAAREA (
MountPoint = "/ora_common/oradata/BKNDB"
BlockDevice = "/dev/vx/dsk/BUKKEN_ORAAREA/vol1"
FSType = vxfs
FsckOpt = "-n"
)
Mount sg1_mount_ARCAREA (
MountPoint = "/oraarchive/bukken/arch"
BlockDevice = "/dev/vx/dsk/BUKKEN_ARCAREA/vol1"
FSType = vxfs
FsckOpt = "-n"
)
Netlsnr sg1_Lisner (
Owner = oracle
Home = "/u01/app/oracle/product/12.1.0/dbhome_1"
TnsAdmin = "/u01/app/oracle/product/12.1.0/dbhome_1/network/admin"
)
Oracle sg1_Oracle (
Sid = BKNDB
Owner = oracle
Home = "/u01/app/oracle/product/12.1.0/dbhome_1"
)
sg1_Lisner requires sg1_Oracle
sg1_Oracle requires sg1_mount_ORAAREA
sg1_Oracle requires sg1_mount_ARCAREA
sg1_Oracle requires sg1_vIP_bond0
======================================= sg1_mount_ORAAREA requires sg1_vol_ORAAREA sg1_mount_ARCAREA requires sg1_vol_ARCAREA sg1_vIP_bond0 requires sg1_NIC_bond0 sg1_vol_ORAAREA requires sg1_dg_ORAAREA sg1_vol_ARCAREA requires sg1_dg_ARCAREA
●ステージング group sg1 ( SystemList = { STGBKNDBN01 = 0, STGBKNDBN02 = 1 } AutoStartList = { STGBKNDBN01 } )
NIC sg1_NIC_bond0 (
Device = bond0
NetworkHosts = { "10.2.124.254" }
)
IP sg1_vIP_bond0 (
Device = bond0
Address = "10.2.124.12"
NetMask = "255.255.255.0"
)
sg1_vIP_bond0 requires sg1_NIC_bond0
mkdir -p /oraarchive/bukken/arch chown oracle.oinstall -R /oraarchive mkdir -p /ora_common/oradata/BKNDB chown oracle.oinstall -R /ora_common/oradata
ディスク /dev/sda: 897.0 GB, 896998047744 バイト ディスク /dev/sde: 1099.5 GB, 1099511627776 バイト ディスク /dev/sdq: 1099.5 GB, 1099511627776 バイト ディスク /dev/sdw: 1099.5 GB, 1099511627776 バイト ディスク /dev/sdk: 1099.5 GB, 1099511627776 バイト ディスク /dev/sdf: 429.5 GB, 429496729600 バイト ディスク /dev/sdl: 429.5 GB, 429496729600 バイト ディスク /dev/sdr: 429.5 GB, 429496729600 バイト ディスク /dev/sdx: 429.5 GB, 429496729600 バイト ディスク /dev/sdg: 214.7 GB, 214748364800 バイト ディスク /dev/sdm: 214.7 GB, 214748364800 バイト ディスク /dev/sdy: 214.7 GB, 214748364800 バイト ディスク /dev/sds: 214.7 GB, 214748364800 バイト
/opt/VRTS/bin/hagrp -switch sg1 -to BKNDBN02 /opt/VRTS/bin/hagrp -switch sg1 -to BKNDBN01
/opt/VRTS/bin/hastatus -sum
サービスグループのフリーズ /opt/VRTS/bin/haconf -makerw /opt/VRTS/bin/hagrp -freeze sg1 -persistent /opt/VRTS/bin/haconf -dump -makero
サービスグループのアンフリーズ /opt/VRTS/bin/haconf -makerw /opt/VRTS/bin/hagrp -unfreeze sg1 -persistent /opt/VRTS/bin/haconf -dump -makero
1.VCSを停止 ※oracleのインスタンスが停止状態でディスクを切り離してもいい状態であることを確認する。 /opt/VRTS/bin/hastop -all 2.メインコンフィグのバックアップ cp /etc/VRTSvcs/conf/config/main.cf /var/tmp/main.cf_bk 3.コンフィグの編集 cd /etc/VRTSvcs/conf/config vi main.cf コンフィグを編集 4.構文チェック ※構文に問題がない場合は何も出力されない /opt/VRTS/bin/hacf -verify . 5.VCSの起動 node1、node2の順番で以下のコマンドを実施 /opt/VRTS/bin/hastart
Netlsnr sg1_Lisner (
Owner = oracle
Home = "/u01/app/oracle/product/12.1.0/dbhome_1"
TnsAdmin = "/u01/app/oracle/product/12.1.0/dbhome_1/network/admin"
)
Oracle sg1_Oracle (
Sid = BKNDB
Owner = oracle
Home = "/u01/app/oracle/product/12.1.0/dbhome_1"
)
※構文エラーの為不可 VCS WARNING V-16-1-12128 Resource sg1_NIC_bond0 is None and must not have children VCS ERROR V-16-1-12095 Aborting hacf: errors encountered
sg1_Lisner requires sg1_Oracle
sg1_Oracle requires sg1_vIP_bond0
sg1_vIP_bond0 requires sg1_NIC_bond0
sg1_NIC_bond0 requires sg1_mount_ORAAREA
sg1_NIC_bond0 requires sg1_mount_ARCAREA
sg1_mount_ORAAREA requires sg1_vol_ORAAREA
sg1_mount_ARCAREA requires sg1_vol_ARCAREA
sg1_vol_ORAAREA requires sg1_dg_ORAAREA
sg1_vol_ARCAREA requires sg1_dg_ARCAREA
リソースの依存関係を変更 sg1_Oracle requires sg1_Lisner sg1_Lisner requires sg1_mount_ORAAREA sg1_Lisner requires sg1_mount_ARCAREA sg1_mount_ORAAREA requires sg1_vol_ORAAREA sg1_mount_ARCAREA requires sg1_vol_ARCAREA sg1_vol_ORAAREA requires sg1_dg_ORAAREA sg1_vol_ARCAREA requires sg1_dg_ARCAREA sg1_dg_ORAAREA requires sg1_vIP_bond0 sg1_dg_ARCAREA requires sg1_vIP_bond0 sg1_vIP_bond0 requires sg1_NIC_bond0
=======================================
1.コマンドでのフェイルオーバー /opt/VRTS/bin/hagrp -switch sg1 -to BKNDBN02 状態を確認 /opt/VRTS/bin/hastatus -sum ローカルから接続確認(vIPへ)
2.node2を再起動(BKNDBN02) shutdown -r now node1にサービスグループが移動することを確認 /opt/VRTS/bin/hastatus -sum
3.node1を再起動(BKNDBN01) shutdown -r now node2にサービスグループが移動することを確認 /opt/VRTS/bin/hastatus -sum
4.コマンドでのフェイルバック /opt/VRTS/bin/hagrp -switch sg1 -to BKNDBN01 状態を確認 /opt/VRTS/bin/hastatus -sum ローカルから接続確認(vIPへ)
※フラグクリア サービスグループ内のリソースの障害フラグをリセットする /opt/VRTSvcs/bin/hares -clear <リソース名> -sys <システム名> /opt/VRTSvcs/bin/hares -clear sg1_Lisner -sys BKNDBN01
※VCSにOracleを組み込む際の注意点 プライマリとセカンダリの構成を合わせるためoracleのインストールディレクトリ をプライマリからセカンダリにコピーすること。
プライマリサーバのインストールディレクトリを圧縮しセカンダリサーバへ コピーする。 その後圧縮したファイルをセカンダリのインストールディレクトリに解凍して置き換える。
cd /var/tmp tar cfvz oracle_archive.tar.gz /u01/app scp oracle_archive.tar.gz [email protected]:/var/tmp
cd /var/tmp ll mv oracle_archive.tar.gz /u01 cd /u01 mv app app_bk tar zxvf oracle_archive.tar.gz cd /u01/u01 ll mv app /u01/