ã²ãŒã—ã•ã¾
広瀬ã§ã™ã€‚ãŠå¿™ã—ã„ä¸ã”確èªã¨çš„確ãªã”助言をã„ãŸã ã大変助ã‹ã‚Šã¾ã—ãŸã€‚
ã”èª¬æ˜Žé ‚ã„ãŸé€šã‚Šã€Actå´ã®DRBDãŒå…ˆã«demote処ç†ã«é™¥ã£ã¦ã—ã¾ã†æŒ™å‹•ã¨ã€
ãã®ã‚¿ã‚¤ãƒ アウトãŒèµ·å› ã§æœ€çµ‚çš„ãªå´©å£Šã«ã¤ãªãŒã£ã¦ã„ãŸã“ã¨ã¯èªã‚ã¦ã¯
ãŠã‚Šã¾ã—ãŸãŒã€ãã®å…ˆãŒã©ã“ã«é–¢é€£ã™ã‚‹ã‹ã§ç†è§£ä¸è¶³ã§ã‚ã‚Šã€orderã®è¨˜è¿°
ã«ã¾ã§é ãŒå›žã£ã¦ãŠã‚Šã¾ã›ã‚“ã§ã—ãŸã€‚
 ※ã©ã¡ã‚‰ã‹ã¨è¨€ãˆã°ã€colocationã®å®šç¾©ã«è…心ã—ã¦ã„ã¾ã—ãŸ
order odr_app-01 0: cl_diskd_db ms_drbd_app symmetrical=false
order odr_app-02 0: cl_diskd_os ms_drbd_app symmetrical=false
order odr_app-03 0: cl_pingd_ope ms_drbd_app symmetrical=false
order odr_app-04 inf: ms_drbd_app:promote rg_mysqld rg_app:start
ã”æ示ã„ãŸã ã„ãŸå†…容ã«å¾“ã„è¨å®šã‚’è¿½åŠ ã—ã€å‹•ä½œç¢ºèªã—ã¾ã—ãŸã¨ã“ã‚ã€
rg_mysqldã€rg_appã®ç‰‡ç³»ã«å¯„ã›ã¦ã‹ã‚‰ã€Standbyã®åœæ¢ãŒæ£å¸¸ã«è¡Œãˆ
ã¾ã—ãŸã€‚
ã¾ãŸã€å¯„ã›ãšã«HAåœæ¢ã€ã¾ãŸã¯Heartbeat Masterプãƒã‚»ã‚¹å¼·åˆ¶Killãªã©
考ãˆã‚‰ã‚Œã‚‹éšœå®³ãƒ‘ターンも確èªã—期待ã©ãŠã‚Šã¨ãªã‚Šã¾ã—ãŸã€‚
symmetricalパラメータã®æ„味åˆã„ã¯è‡³æ¥µã‚ã‹ã‚Šã‚„ã™ã„ã‚‚ã®ã§ã™ãŒã€ã
ã®ã‚ãŸã‚Šã¸ã®ç†è§£ã¨ã„ã†ã‹ã€é–¢é€£æ€§ã«æ°—ã¥ã‹ãªã„点ã¯ã¾ã ã¾ã 勉強ãŒ
足りã¦ãªã„ãªãã¨æ€ã†æ¬¡ç¬¬ã§ã™ï¼œã‚¹ã‚³ã‚¢æ¦‚念ã¯ã•ã‚‰ã«ãƒœãƒã‚¯ã‚½
ã“ã®åº¦ã¯ã”ä¸å¯§ãªã”説明ã¨è§£èª¬ã€ãŠã‚ˆã³è§£æ³•ã®ã”æ示ã„ãŸã ã大変助ã‹
ã‚Šã¾ã—ãŸ(実ã¯æ¥é€±ã«ã¯æ£å¼ç¨¼åƒäºˆå®šã§å›°ã£ã¦ã„ãŸã¨ã“ã‚ã§ã—ãŸ)。
以上ã§ã™ã€‚
kazuh@goo.jpã•ã‚“:
> 広瀬様
>
> ã²ãŒã—ã§ã™ã€‚ãŠä¸–話ã«ãªã‚Šã¾ã™ã€‚
>
> ã„ãŸã ã„ãŸha-logよりã€1ç³»ã®shutdown実行直後ã®çŠ¶æ…‹é·ç§»è¨ˆç®—ã§ã€
> 特ã«ã‚¨ãƒ©ãƒ¼ã¯ç™ºç”Ÿã—ã¦ã„ãªã„ã®ã«ã€2ç³»å´ã®DRBD(res_drbd_app:0)ãŒ
> å†èµ·å‹•(Restart)ã•ã‚Œã‚‹ã‚ˆã†Pacemakerã«ã‚ˆã£ã¦åˆ¤æ–ã•ã‚Œã¦ã„ã¾ã™ã€‚
>
>  Jan 26 21:53:39 appwd02p pengine: [22849]: info: stage6: Scheduling Node appwd01p.local for
shutdown
>  Jan 26 21:53:39 appwd02p.local pengine: [22849]: notice: LogActions: Restart resource res_drbd_
app:0 (Master appwd02p.local)
>
> ãã®çŠ¶æ…‹é·ç§»è¨ˆç®—çµæžœã«ã®ã£ã¨ã‚Šã€Pacemakerã¯2ç³»å´ã®DRBDã‚’
> demote→stop→start→promoteã—よã†ã¨ã—ã¾ã—ãŸãŒã€demoteã¯ã€
> DRBDデãƒã‚¤ã‚¹ã‚’誰ã‹(ãŠãらãmysql)ãŒä½¿ç”¨ä¸ã®ãŸã‚失敗ã—ã€
> タイムアウトã—ã¦ã„ã¾ã™ã€‚
>
>  Jan 26 21:53:40 appwd02p lrmd: [22835]: info: rsc:res_drbd_app:0 demote[71] (pid 30997)
>  Jan 26 21:53:40 appwd02p lrmd: [22835]: info: RA output: (res_drbd_app:0:demote:stderr) 0: State
change failed: (-12) Device is held open by someone
>  Jan 26 21:53:40 appwd02p lrmd: [22835]: info: RA output: (res_drbd_app:0:demote:stderr) Command
'drbdsetup-84 secondary 0' terminated with exit code 11
>  ・・・demoteã‚’ç¹°ã‚Šè¿”ã—試ã¿ã‚‹ãŒå¤±æ•—ã—続ã‘る・・
>  Jan 26 21:54:00 appwd02p lrmd: [22835]: WARN: res_drbd_app:0:demote process (PID 30997) timed
out (try 1). Killing with signal SIGTERM (15).
>
>
> demoteã®å¤±æ•—(タイムアウト)ã«ã‚ˆã‚Šæ•…障フラグãŒç«‹ã£ãŸãŸã‚
> Pacemakerã¯DRBDã®åœæ¢ã‚’試ã¿ã¾ã™ã€‚ã—ã‹ã—ã€ã“れもdemote時ã¨
> åŒæ§˜ã®ç†ç”±ã§å¤±æ•—(タイムアウト)ã—ã¦ã„ã¾ã™ã€‚
>
>  Jan 26 21:54:01 appwd02p pengine: [22849]: WARN: unpack_rsc_op: Forcing res_drbd_app:0 to stop
after a failed demote action
>  Jan 26 21:54:01 appwd02p lrmd: [22835]: info: rsc:res_drbd_app:0 stop[76] (pid 31995)
>  Jan 26 21:54:02 appwd02p lrmd: [22835]: info: RA output: (res_drbd_app:0:stop:stderr) 0: State
change failed: (-12) Device is held open by someone
>  Jan 26 21:54:02 appwd02p lrmd: [22835]: info: RA output: (res_drbd_app:0:stop:stderr) Command '
drbdsetup-84 secondary 0' terminated with exit code 11
>  ・・・stopã‚’ç¹°ã‚Šè¿”ã—試ã¿ã‚‹ãŒå¤±æ•—ã—続ã‘る・・
>  Jan 26 21:56:01 appwd02p lrmd: [22835]: WARN: res_drbd_app:0:stop process (PID 31995) timed out
(try 1). Killing with signal SIGTERM (15).
>
>
> ã•ã¦ã€ã§ã¯ã€ãªãœã€
> 「特ã«ã‚¨ãƒ©ãƒ¼ã¯ç™ºç”Ÿã—ã¦ã„ãªã„ã®ã«ã€2ç³»å´ã®DRBD(res_drbd_app:0)ãŒ
> å†èµ·å‹•ã•ã‚Œã‚‹ã‚ˆã†Pacemakerã«åˆ¤æ–ã•ã‚ŒãŸã€
> ã‹ã€ã§ã™ãŒã€ã“ã‚Œã¯ã€ãŠãらãã€ã‚¯ãƒãƒ¼ãƒ³ãƒªã‚½ãƒ¼ã‚¹ã¨DRBDリソースã®
> orderè¨å®šãŒinfã§è¨å®šã•ã‚Œã¦ã„ã‚‹ã“ã¨ã¨ã€ã€Œsymmetricalã€ãŒtrue(デフォルト)
> ã«ãªã£ã¦ã„ã‚‹ã“ã¨ãŒåŽŸå› ã®ã‚ˆã†ã§ã™ã€‚
>
> ãŠãらãã€1ç³»ã®shutdownã«ä¼´ã†1ç³»ã®ã‚¯ãƒãƒ¼ãƒ³ãƒªã‚½ãƒ¼ã‚¹ã®åœæ¢ã§ã€
> ã“ã®order制約ãŒåƒãã€ä¸¡ç³»ã®DRBDã‚’(一旦)åœæ¢ã—よã†ã¨ã—ãŸã¨
> æ€ã‚ã‚Œã¾ã™ã€‚
>
> 以下ã€ã€Œorder回é¿æ¡ˆã€ã®ã‚ˆã†ã«order制約ã®ã‚¹ã‚³ã‚¢ã‚’0ã«ã—ã€
> 「symmetrical=falseã€ã‚’è¨å®šã—ã¦ã¿ã¦ãã ã•ã„。
>
> ---- orderå¤‰æ›´å‰ ----
> order odr_app-01 inf: cl_diskd_db ms_drbd_app
> order odr_app-02 inf: cl_diskd_os ms_drbd_app
> order odr_app-03 inf: cl_pingd_ope ms_drbd_app
> ---------------------
>   ↓以下ã®é€šã‚Šå¤‰æ›´ã—ã¦ã¿ã¦ãã ã•ã„。
> ---- order回é¿æ¡ˆ ----
> order odr_app-01 0: cl_diskd_db ms_drbd_app symmetrical=false
> order odr_app-02 0: cl_diskd_os ms_drbd_app symmetrical=false
> order odr_app-03 0: cl_pingd_ope ms_drbd_app symmetrical=false
> ---------------------
>
>
> #外ã—ã¦ã„ãŸã‚‰ã”ã‚ã‚“ãªã•ã„。
>
> #ãªãŠã€Pacemaker1.1ç³»ã§ã¯ã€ä¸Šè¨˜orderã§ã‚‚ã€1ç³»ã®ã‚¯ãƒãƒ¼ãƒ³åœæ¢ã«
>  2ç³»ã®DRBDãŒé“連れã«ãªã‚‹ã€ã¨ã„ã†ã“ã¨ã¯ç„¡ã„よã†ã§ã™ã€‚
>  制約ã®ä»•æ§˜ãŒPacemaker1.0ã¨1.1ã§å¾®å¦™ã«å¤‰ã‚ã£ã¦ã„るよã†ã§ã™ã・・
>
>
> 以上ã§ã™ã€‚
> よã‚ã—ããŠé¡˜ã„ã„ãŸã—ã¾ã™ã€‚
>
> ----- å…ƒã®ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ -----
> From: momoko@mail.t-momoko.org
> 宛先: linux-ha-japan@lists.osdn.me
> é€ä¿¡æ¸ˆã¿: 2016å¹´1月26æ—¥, ç«æ›œæ—¥ åˆå¾Œ 10:30:08
> 件å: Re: [Linux-ha-jp] スタンãƒã‚¤å´ã‚’切り離ã™ã¨DRBDãŒFailã‚’èµ·ã“ã—ã¦ã—ã¾ã†
>
> ã²ãŒã—ã•ã¾
>
>
> ãŠä¸–話ã«ãªã£ã¦ãŠã‚Šã¾ã™ã€åºƒç€¬ã§ã™ã€‚
> 添付ã¨ã—ã¾ã™ãŒã€ã”指示通りã«ha-logã¨messagesã®ãƒã‚°ã‚’ãã‚Œãžã‚Œ
> å–å¾—ã„ãŸã—ã¾ã—ãŸã€‚解決ã®ç³¸å£ãŒã‚ã‚Œã°ã‚ˆã„ã®ã§ã™ãŒãƒ»ãƒ»ãƒ»
>
> å°šã€ã“ã®ãƒã‚°å‡ºåŠ›å‰ã«ãŠã“ãªã£ãŸã“ã¨ã§ã™ãŒã€ä»¥ä¸‹ã®é€šã‚Šã§ã™ã€‚
>
>
> â—†æ£å¸¸çŠ¶æ…‹
> �1å·æ©Ÿå´ã§ã€rg_appグループãŒèµ·å‹•ä¸
>
> �2å·æ©Ÿå´ã§ã€rg_mysqldグループãŒèµ·å‹•ä¸
>
>
> ◆マイグレーション
>
> �上記ã€æ£å¸¸çŠ¶æ…‹ã‹ã‚‰1å·æ©Ÿã§ç¨¼åƒã—ã¦ã„ãŸrg_appグループをã€2å·æ©Ÿ
>  ã«migrateコマンドã§ç§»å‹•ï¼œunmigrateã¯è¡Œã‚ãš
>
> �æ£å¸¸ã«ç§»å‹•ã—ãŸã“ã¨ã‚’確èª
>
>
>  ⇒ã“ã®çŠ¶æ…‹ã‹ã‚‰ã€ãƒã‚°ã®åã出ã—ãŒè½ã¡ç€ã„ãŸã‚¿ã‚¤ãƒŸãƒ³ã‚°ã§ã€ãƒã‚°
>   リãƒãƒ¼ãƒ ã—ã¦ã€ä»¥é™ã®æ–°è¦ãƒã‚°ã‚’今回ã”æ示ã•ã›ã¦é ‚ãã¾ã—ãŸã€‚
>
>  ⇒上記ã®ãƒã‚°ã¯2å·æ©Ÿå´ã®ã¿ã¨ãªã‚Šã¾ã™ï¼œ1å·æ©Ÿå´ã‚‚å¿…è¦ãªå ´åˆã¯ã”æ示å¯èƒ½ã§ã™
>
>
> ◆完全ã«ã‚¹ã‚¿ãƒ³ãƒã‚¤ã¨åŒ–ã—ãŸ1å·æ©Ÿã®åœæ¢
>
> �heartbeatåœæ¢ã‚’実施
>
>  ⇒2å·æ©Ÿå´ã§crm_mon -fAを実行ã—ã¾ã™ãŒã€ã™ãã«DRBDã®demote処ç†ã§
>   エラーをåã出ã—ãŸæ¨¡æ§˜ï¼œãªãŠã€ç™ºç”Ÿã—ãŸã®ã¯ä½•æ•…ã‹2å·æ©Ÿå´ã®DRBD
>   リソース<1å·æ©Ÿã®ãƒªã‚½ãƒ¼ã‚¹ã§ã¯ç„¡ã„
>
> �時間ã¯ä¿‚ã‚‹ã‚‚ã®ã®ã€1å·æ©Ÿã®HAã¯æœ€çµ‚çš„ã«ã¯åœæ¢ã—ã¾ã™
>
>
>  ⇒ãƒã‚°ã¯æ¦‚ã1å·æ©Ÿå´ãŒåœæ¢ã—ã€ãƒã‚°ãŒè½ã¡ç€ã„ãŸå½“ãŸã‚Šã¾ã§ã§ã™
>
>
> 以上ã¨ãªã‚Šã¾ã™ã€‚よã‚ã—ããŠé¡˜ã„ã„ãŸã—ã¾ã™ã€‚
>
> ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼
> 追伸
>
> 上記対応直後ã®crm_mon -fAçµæžœã¯ä»¥ä¸‹ã¨ãªã‚Šã¾ã™
>
> Online: [ appwd02p.local ]
> OFFLINE: [ appwd01p.local ]
>
> Resource Group: rg_app
> res_vip_chk_app (ocf::heartbeat:VIPcheck): Started appwd02p.local
> res_vip_app (ocf::heartbeat:IPaddr2): Started appwd02p.local
> res_app_svr (ocf::heartbeat:appserver): Started appwd02p.local
> res_app_jgw (lsb:javagateway): Started appwd02p.local
> res_MailTo_app (ocf::heartbeat:MailTo): Started appwd02p.local
> Master/Slave Set: ms_drbd_app
> res_drbd_app:0 (ocf::linbit:drbd): Slave appwd02p.local (unmanaged) FAILED
> Stopped: [ res_drbd_app:1 ]
> Clone Set: cl_diskd_db
> Started: [ appwd02p.local ]
> Stopped: [ res_diskd_db:1 ]
> Clone Set: cl_diskd_os
> Started: [ appwd02p.local ]
> Stopped: [ res_diskd_os:1 ]
> Clone Set: cl_pingd_ope
> Started: [ appwd02p.local ]
> Stopped: [ res_pingd_ope:1 ]
>
> Node Attributes:
> * Node appwd02p.local:
> + disk_chk_db : normal
> + disk_chk_os : normal
> + master-res_drbd_app:0 : 10000
> + ope_l3sw_chk : 100
>
> Migration summary:
> * Node appwd02p.local:
> res_drbd_app:0: migration-threshold=1 fail-count=1000000
>
> Failed actions:
> res_drbd_app:0_demote_0 (node=appwd02p.local, call=71, rc=-2, status=Timed Out): unknown exec
> error
> res_drbd_app:0_stop_0 (node=appwd02p.local, call=76, rc=-2, status=Timed Out): unknown exec e
> rror
> ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼
>
>
>
>
>
> kazuh@goo.jpã•ã‚“:
> > 広瀬様
> >
> > ã²ãŒã—ã¨ç”³ã—ã¾ã™ã€‚ãŠä¸–話ã«ãªã‚Šã¾ã™ã€‚
> >
> > > ã—ã‹ã—ãªãŒã‚‰ã€ã©ã¡ã‚‰ã‹ã²ã¨ã¤ã®ã‚µãƒ¼ãƒã«ï¼’グループ全部寄ã›ãŸã‚ã¨ã€å®Œå…¨ã«ã‚¹ã‚¿
> > > ンãƒã‚¤æ©Ÿã¨åŒ–ã—ãŸã‚µãƒ¼ãƒå´ã®Heartbeatã‚’åœæ¢ã™ã‚‹ã¨ã€DRBDãŒã‚³ã‚±ã¦ã—ã¾ã„çµæžœçš„
> > > ã«MySQLãŒæ»äº¡ã™ã‚‹ã“ã¨ã«ãªã‚‹ã®ã§ã€HAãŒå´©å£Šã—ã¾ã™
> > ç§ãŒDRBDã«ã‚ã¾ã‚Šæ˜Žã‚‹ããªã„ã›ã„ã‚‚ã‚ã‚Šã€è¨å®šã‚’見ãŸã ã‘ã§ã¯
> > ã¡ã‚‡ã£ã¨åŽŸå› ãŒã‚ã‹ã‚Šã¾ã›ã‚“ã§ã—ãŸã€‚
> >
> > 「DRBDãŒã‚³ã‚±ã‚‹ã€ã¨ã‚ã‚‹ã®ã§ã€ä½•ã‚‰ã‹ã®ã‚¨ãƒ©ãƒ¼ãŒçµ¡ã‚“ã§ã„ã‚‹ã®
> > ã§ã¯ãªã„ã‹ã¨æ€ã„ã¾ã™ã€‚
> >
> > 解æžã®ãŸã‚ã€å½“該事象発生時ã®Pacemakerã®ãƒã‚°(ha-logã¾ãŸã¯/var/log/messages)ã¨
> > OSãƒã‚°(/var/log/messages)ã‚’ã„ãŸã ã‘ãªã„ã§ã—ょã†ã‹ã€‚
> >
> >
> > 以上ã§ã™ã€‚
> > よã‚ã—ããŠé¡˜ã„ã„ãŸã—ã¾ã™ã€‚
> >
> > ----- å…ƒã®ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ -----
> > From: momoko@mail.t-momoko.org
> > 宛先: linux-ha-japan@lists.osdn.me
> > é€ä¿¡æ¸ˆã¿: 2016å¹´1月26æ—¥, ç«æ›œæ—¥ åˆå‰ 1:33:45
> > 件å: [Linux-ha-jp] スタンãƒã‚¤å´ã‚’切り離ã™ã¨DRBDãŒFailã‚’èµ·ã“ã—ã¦ã—ã¾ã†
> >
> > 広瀬ã¨ç”³ã—ã¾ã™
> >
> >
> > ★環境
> >  CentOS6.7 x86_64
> >  Pacemaker(1.0.13-2.el6.x86_64)
> >  Heartbeat(3.0.5-1.1.el6.x86_64)
> >
> >
> > 上記環境ã«ãŠã„ã¦ã€1å·æ©Ÿå´ã§ã¯ã‚¢ãƒ—リケーションAã€2å·æ©Ÿå´ã§ã¯MySQL+DRBDã‚’
> > Activeã¨ã—ãŸã€é…置制約é•ã„ã®ä¸¡ç³»Act/Act構æˆã‚’ã¨ã‚Šã¾ã—ãŸ(コンフィグã¯æœ€å¾Œ
> > ã«å¼µã‚Šä»˜ã‘ã¾ã™)
> >
> >
> > 具体的ã«ã¯rg_mysqldグループã¯2å·æ©Ÿã§èµ·å‹•ã•ã›ã€rg_applicationグループã¯1å·
> > æ©Ÿã§èµ·å‹•ã•ã›ã€ã©ã¡ã‚‰ã‹ãŒæ•…éšœã€åœæ¢ã—ãŸå ´åˆã¯ç”Ÿã残ã£ã¦ã„るサーãƒå´ã«å¯„ã‚‹
> > よã†ã«æ§‹æˆã—ã¾ã—ãŸ(HA起動時ã®å„ªå…ˆèµ·å‹•é †ã¨ã—ã¦)
> > 構æˆã¨ã—ã¦ã¯ã€å…¬é–‹ã•ã‚Œã¦ã„ã‚‹LinuxHA-JPã®éŽåŽ»ã®OSCã®å…¬é–‹è³‡æ–™ã«ã‚ã‚‹æ±ã•ã¾ã®
> > 「雷ã€ãƒ‘ターンã«è¿‘ã„ã¨è€ƒãˆã¦ã„ãŸã ã‘ã‚Œã°ã¨æ€ã„ã¾ã™ã€‚
> >
> >  ※「CRM-CLIã§HAクラスタを自在ã«åˆ¶å¾¡ã—よã†ï¼ã€å‚考
> >
> > ãŸã ã—ã€ä¸Šè¨˜è³‡æ–™ã®å ´åˆã¯ã‚°ãƒ«ãƒ¼ãƒ—化ã¯ã›ãšã€å˜ä¸€ãƒªã‚½ãƒ¼ã‚¹ã‚’ãƒãƒ©ãƒãƒ©ã«èµ·å‹•ã•ã›
> > ãŸã„å ´åˆã€ä¸”ã¤DRBDã¯å˜åœ¨ã—ãªã„å‰æã®ãŸã‚ã€MSリソースを絡ã‚ãŸå„種ã®åˆ¶ç´„æ¡ä»¶
> > 定義ã¯ç‹¬è‡ªã®è§£é‡ˆã«åŸºã¥ã„ãŸã‚‚ã®ã¨ãªã‚Šã¾ã™ã€‚
> >
> >
> > ★グループ定義
> > group rg_mysqld res_vip_chk_db res_vip_db res_fs_db res_mysql_app res_MailTo_db
> > group rg_app res_vip_chk_app res_vip_app res_app_svr res_app_jgw res_MailTo_app
> >
> >
> > ★é…置制約定義
> > location loc_app rg_app \
> > rule $id="l_app-01" $role="master" 200: #uname eq appwd01p.local \
> > rule $id="l_app-02" $role="master" 100: #uname eq appwd02p.local \
> >
> >
> > location loc_mysql ms_drbd_app \
> > rule $id="l_sql-01" $role="master" 200: #uname eq appwd02p.local \
> > rule $id="l_sql-02" $role="master" 100: #uname eq appwd01p.local \
> >
> >
> > 基本的ãªã€locationã€colocationã€orderã®åˆ¶ç´„ã«é–¢ã—ã¦ã¯æœŸå¾…通りã®èµ·å‹•ã€ä¸¦ã³ã«
> > マイグレーション動作をã—ã¾ã™
> > ã—ã‹ã—ãªãŒã‚‰ã€ã©ã¡ã‚‰ã‹ã²ã¨ã¤ã®ã‚µãƒ¼ãƒã«ï¼’グループ全部寄ã›ãŸã‚ã¨ã€å®Œå…¨ã«ã‚¹ã‚¿
> > ンãƒã‚¤æ©Ÿã¨åŒ–ã—ãŸã‚µãƒ¼ãƒå´ã®Heartbeatã‚’åœæ¢ã™ã‚‹ã¨ã€DRBDãŒã‚³ã‚±ã¦ã—ã¾ã„çµæžœçš„
> > ã«MySQLãŒæ»äº¡ã™ã‚‹ã“ã¨ã«ãªã‚‹ã®ã§ã€HAãŒå´©å£Šã—ã¾ã™
> >
> >
> > èµ·å› ã¯DRBDã®çŠ¶æ…‹ã«ã‚ã‚‹ã¨ã¿ã¦ã„ã‚‹ã®ã§ã€MSリソースã®åŒå±…制約ã€é…ç½®ã«ãªã‚“らã‹
> > ã®å•é¡ŒãŒã‚ã‚‹ã¨ã¿ã¦ã„ã¾ã™(Diskdも関係ã™ã‚‹ã‹ãƒ»ãƒ»ãƒ»)
> > ç§ã¨ã—ã¦ã‚‚難易度ã®é«˜ã„構æˆã«ã—ãŸãªãã¨å°‘ã—後悔気味ã§ã™ãŒã€MySQLを主軸ã¨ã™ã‚‹
> > グループã¨ã€Javaを主軸ã¨ã™ã‚‹ã‚¢ãƒ—リケーショングループã®ãƒ¡ãƒ¢ãƒªã®åˆ©ç”¨çŽ‡ãŒã¨ã‚‚
> > ã«é«˜ã„ã®ã§ã€åˆ†é›¢ã•ã›ãŸæ¬¡ç¬¬ã§ã™(ã¾ãã€ã‚ã¨ã‚¹ã‚¿ãƒ³ãƒã‚¤æ©ŸãŒéŠã‚“ã§ã„ã‚‹ã¨ã‚‚ã£ãŸã„
> > ãªã„ã®ã§)
> >
> >
> > 簡便ãªã”質å•å†…容ã§å¤§å¤‰ç”³ã—訳ã”ã–ã„ã¾ã›ã‚“ãŒã€æœ¬ä»¶ä½•ã‹ã”指摘ã„ãŸã ã‘る部分ãŒ
> > 御座ã„ã¾ã—ãŸã‚‰ã€ã”è¿”ç”ã„ãŸã ã‘ã‚‹ã¨åŠ©ã‹ã‚Šã¾ã™
> >
> >
> > 以上ã€ã‚ˆã‚ã—ããŠé¡˜ã„ã„ãŸã—ã¾ã™
> >
> > ★以下パラメータ(primitiveã®è©³ç´°ã¯ãŠãらã関係ãŒç„¡ã„ã®ã§çœã„ã¦ã¾ã™)
> > ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼
> > primitive res_MailTo_db ocf:heartbeat:MailTo \
> > primitive res_MailTo_app ocf:heartbeat:MailTo \
> > primitive res_diskd_db ocf:pacemaker:diskd \
> > primitive res_diskd_os ocf:pacemaker:diskd \
> > primitive res_drbd_app ocf:linbit:drbd \
> > primitive res_fs_db ocf:heartbeat:Filesystem \
> > primitive res_mysql_app ocf:heartbeat:mysql \
> > primitive res_pingd_ope ocf:pacemaker:pingd \
> > primitive res_vip_chk_db ocf:heartbeat:VIPcheck \
> > primitive res_vip_chk_app ocf:heartbeat:VIPcheck \
> > primitive res_vip_db ocf:heartbeat:IPaddr2 \
> > primitive res_vip_app ocf:heartbeat:IPaddr2 \
> > primitive res_app_jgw lsb:java_application \
> > primitive res_app_svr ocf:heartbeat:application \
> >
> > group rg_mysqld res_vip_chk_db res_vip_db res_fs_db res_mysql_app res_MailTo_db
> > group rg_app res_vip_chk_app res_vip_app res_app_svr res_app_jgw res_MailTo_app
> >
> > ms ms_drbd_app res_drbd_app \
> > meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true"
> >
> > clone cl_diskd_db res_diskd_db \
> > meta clone-max="2" clone-node-max="1"
> > clone cl_diskd_os res_diskd_os \
> > meta clone-max="2" clone-node-max="1"
> > clone cl_pingd_ope res_pingd_ope \
> > meta clone-max="2" clone-node-max="1"
> >
> > location loc_mysql ms_drbd_app \
> > rule $id="l_sql-01" $role="master" 200: #uname eq appwd02p.local \
> > rule $id="l_sql-02" $role="master" 100: #uname eq appwd01p.local \
> > rule $id="l_sql-03" $role="master" -inf: defined ope_l3sw_chk and ope_l3sw_chk lt 100 \
> > rule $id="l_sql-04" -inf: defined os_disk_chk and os_disk_chk eq ERROR \
> > rule $id="l_sql-05" -inf: defined db_disk_chk and db_disk_chk eq ERROR
> > location loc_apprg_app \
> > rule $id="l_app-01" $role="master" 200: #uname eq appwd01p.local \
> > rule $id="l_app-02" $role="master" 100: #uname eq appwd02p.local \
> > rule $id="l_app-03" $role="master" -inf: defined ope_l3sw_chk and ope_l3sw_chk lt 100 \
> > rule $id="l_app-04" -inf: defined os_disk_chk and os_disk_chk eq ERROR \
> > rule $id="l_app-05" -inf: defined db_disk_chk and db_disk_chk eq ERROR
> >
> > colocation col_app-01 inf: ms_drbd_app cl_diskd_db
> > colocation col_app-02 inf: ms_drbd_app cl_diskd_os
> > colocation col_app-03 inf: ms_drbd_app cl_pingd_ope
> > colocation col_app-04 inf: rg_mysqld ms_drbd_app:Master
> >
> > order odr_app-01 inf: cl_diskd_db ms_drbd_app
> > order odr_app-02 inf: cl_diskd_os ms_drbd_app
> > order odr_app-03 inf: cl_pingd_ope ms_drbd_app
> > order odr_app-04 inf: ms_drbd_app:promote rg_mysqld rg_app:start
> >
> > property $id="cib-bootstrap-options" \
> > default-resource-stickiness="200" \
> > no-quorum-policy="ignore" \
> > stonith-enabled="false" \
> > dc-version="1.0.13-a83fae5" \
> > cluster-infrastructure="Heartbeat"
> > ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼
> >
> > _______________________________________________
> > Linux-ha-japan mailing list
> > Linux-ha-japan@lists.osdn.me
> > http://lists.osdn.me/mailman/listinfo/linux-ha-japan
> >
> > _______________________________________________
> > Linux-ha-japan mailing list
> > Linux-ha-japan@lists.osdn.me
> > http://lists.osdn.me/mailman/listinfo/linux-ha-japan
>
> _______________________________________________
> Linux-ha-japan mailing list
> Linux-ha-japan@lists.osdn.me
> http://lists.osdn.me/mailman/listinfo/linux-ha-japan
> _______________________________________________
> Linux-ha-japan mailing list
> Linux-ha-japan@lists.osdn.me
> http://lists.osdn.me/mailman/listinfo/linux-ha-japan
_______________________________________________
Linux-ha-japan mailing list
Linux-ha-japan@lists.osdn.me
http://lists.osdn.me/mailman/listinfo/linux-ha-japan
広瀬ã§ã™ã€‚ãŠå¿™ã—ã„ä¸ã”確èªã¨çš„確ãªã”助言をã„ãŸã ã大変助ã‹ã‚Šã¾ã—ãŸã€‚
ã”èª¬æ˜Žé ‚ã„ãŸé€šã‚Šã€Actå´ã®DRBDãŒå…ˆã«demote処ç†ã«é™¥ã£ã¦ã—ã¾ã†æŒ™å‹•ã¨ã€
ãã®ã‚¿ã‚¤ãƒ アウトãŒèµ·å› ã§æœ€çµ‚çš„ãªå´©å£Šã«ã¤ãªãŒã£ã¦ã„ãŸã“ã¨ã¯èªã‚ã¦ã¯
ãŠã‚Šã¾ã—ãŸãŒã€ãã®å…ˆãŒã©ã“ã«é–¢é€£ã™ã‚‹ã‹ã§ç†è§£ä¸è¶³ã§ã‚ã‚Šã€orderã®è¨˜è¿°
ã«ã¾ã§é ãŒå›žã£ã¦ãŠã‚Šã¾ã›ã‚“ã§ã—ãŸã€‚
 ※ã©ã¡ã‚‰ã‹ã¨è¨€ãˆã°ã€colocationã®å®šç¾©ã«è…心ã—ã¦ã„ã¾ã—ãŸ
order odr_app-01 0: cl_diskd_db ms_drbd_app symmetrical=false
order odr_app-02 0: cl_diskd_os ms_drbd_app symmetrical=false
order odr_app-03 0: cl_pingd_ope ms_drbd_app symmetrical=false
order odr_app-04 inf: ms_drbd_app:promote rg_mysqld rg_app:start
ã”æ示ã„ãŸã ã„ãŸå†…容ã«å¾“ã„è¨å®šã‚’è¿½åŠ ã—ã€å‹•ä½œç¢ºèªã—ã¾ã—ãŸã¨ã“ã‚ã€
rg_mysqldã€rg_appã®ç‰‡ç³»ã«å¯„ã›ã¦ã‹ã‚‰ã€Standbyã®åœæ¢ãŒæ£å¸¸ã«è¡Œãˆ
ã¾ã—ãŸã€‚
ã¾ãŸã€å¯„ã›ãšã«HAåœæ¢ã€ã¾ãŸã¯Heartbeat Masterプãƒã‚»ã‚¹å¼·åˆ¶Killãªã©
考ãˆã‚‰ã‚Œã‚‹éšœå®³ãƒ‘ターンも確èªã—期待ã©ãŠã‚Šã¨ãªã‚Šã¾ã—ãŸã€‚
symmetricalパラメータã®æ„味åˆã„ã¯è‡³æ¥µã‚ã‹ã‚Šã‚„ã™ã„ã‚‚ã®ã§ã™ãŒã€ã
ã®ã‚ãŸã‚Šã¸ã®ç†è§£ã¨ã„ã†ã‹ã€é–¢é€£æ€§ã«æ°—ã¥ã‹ãªã„点ã¯ã¾ã ã¾ã 勉強ãŒ
足りã¦ãªã„ãªãã¨æ€ã†æ¬¡ç¬¬ã§ã™ï¼œã‚¹ã‚³ã‚¢æ¦‚念ã¯ã•ã‚‰ã«ãƒœãƒã‚¯ã‚½
ã“ã®åº¦ã¯ã”ä¸å¯§ãªã”説明ã¨è§£èª¬ã€ãŠã‚ˆã³è§£æ³•ã®ã”æ示ã„ãŸã ã大変助ã‹
ã‚Šã¾ã—ãŸ(実ã¯æ¥é€±ã«ã¯æ£å¼ç¨¼åƒäºˆå®šã§å›°ã£ã¦ã„ãŸã¨ã“ã‚ã§ã—ãŸ)。
以上ã§ã™ã€‚
kazuh@goo.jpã•ã‚“:
> 広瀬様
>
> ã²ãŒã—ã§ã™ã€‚ãŠä¸–話ã«ãªã‚Šã¾ã™ã€‚
>
> ã„ãŸã ã„ãŸha-logよりã€1ç³»ã®shutdown実行直後ã®çŠ¶æ…‹é·ç§»è¨ˆç®—ã§ã€
> 特ã«ã‚¨ãƒ©ãƒ¼ã¯ç™ºç”Ÿã—ã¦ã„ãªã„ã®ã«ã€2ç³»å´ã®DRBD(res_drbd_app:0)ãŒ
> å†èµ·å‹•(Restart)ã•ã‚Œã‚‹ã‚ˆã†Pacemakerã«ã‚ˆã£ã¦åˆ¤æ–ã•ã‚Œã¦ã„ã¾ã™ã€‚
>
>  Jan 26 21:53:39 appwd02p pengine: [22849]: info: stage6: Scheduling Node appwd01p.local for
shutdown
>  Jan 26 21:53:39 appwd02p.local pengine: [22849]: notice: LogActions: Restart resource res_drbd_
app:0 (Master appwd02p.local)
>
> ãã®çŠ¶æ…‹é·ç§»è¨ˆç®—çµæžœã«ã®ã£ã¨ã‚Šã€Pacemakerã¯2ç³»å´ã®DRBDã‚’
> demote→stop→start→promoteã—よã†ã¨ã—ã¾ã—ãŸãŒã€demoteã¯ã€
> DRBDデãƒã‚¤ã‚¹ã‚’誰ã‹(ãŠãらãmysql)ãŒä½¿ç”¨ä¸ã®ãŸã‚失敗ã—ã€
> タイムアウトã—ã¦ã„ã¾ã™ã€‚
>
>  Jan 26 21:53:40 appwd02p lrmd: [22835]: info: rsc:res_drbd_app:0 demote[71] (pid 30997)
>  Jan 26 21:53:40 appwd02p lrmd: [22835]: info: RA output: (res_drbd_app:0:demote:stderr) 0: State
change failed: (-12) Device is held open by someone
>  Jan 26 21:53:40 appwd02p lrmd: [22835]: info: RA output: (res_drbd_app:0:demote:stderr) Command
'drbdsetup-84 secondary 0' terminated with exit code 11
>  ・・・demoteã‚’ç¹°ã‚Šè¿”ã—試ã¿ã‚‹ãŒå¤±æ•—ã—続ã‘る・・
>  Jan 26 21:54:00 appwd02p lrmd: [22835]: WARN: res_drbd_app:0:demote process (PID 30997) timed
out (try 1). Killing with signal SIGTERM (15).
>
>
> demoteã®å¤±æ•—(タイムアウト)ã«ã‚ˆã‚Šæ•…障フラグãŒç«‹ã£ãŸãŸã‚
> Pacemakerã¯DRBDã®åœæ¢ã‚’試ã¿ã¾ã™ã€‚ã—ã‹ã—ã€ã“れもdemote時ã¨
> åŒæ§˜ã®ç†ç”±ã§å¤±æ•—(タイムアウト)ã—ã¦ã„ã¾ã™ã€‚
>
>  Jan 26 21:54:01 appwd02p pengine: [22849]: WARN: unpack_rsc_op: Forcing res_drbd_app:0 to stop
after a failed demote action
>  Jan 26 21:54:01 appwd02p lrmd: [22835]: info: rsc:res_drbd_app:0 stop[76] (pid 31995)
>  Jan 26 21:54:02 appwd02p lrmd: [22835]: info: RA output: (res_drbd_app:0:stop:stderr) 0: State
change failed: (-12) Device is held open by someone
>  Jan 26 21:54:02 appwd02p lrmd: [22835]: info: RA output: (res_drbd_app:0:stop:stderr) Command '
drbdsetup-84 secondary 0' terminated with exit code 11
>  ・・・stopã‚’ç¹°ã‚Šè¿”ã—試ã¿ã‚‹ãŒå¤±æ•—ã—続ã‘る・・
>  Jan 26 21:56:01 appwd02p lrmd: [22835]: WARN: res_drbd_app:0:stop process (PID 31995) timed out
(try 1). Killing with signal SIGTERM (15).
>
>
> ã•ã¦ã€ã§ã¯ã€ãªãœã€
> 「特ã«ã‚¨ãƒ©ãƒ¼ã¯ç™ºç”Ÿã—ã¦ã„ãªã„ã®ã«ã€2ç³»å´ã®DRBD(res_drbd_app:0)ãŒ
> å†èµ·å‹•ã•ã‚Œã‚‹ã‚ˆã†Pacemakerã«åˆ¤æ–ã•ã‚ŒãŸã€
> ã‹ã€ã§ã™ãŒã€ã“ã‚Œã¯ã€ãŠãらãã€ã‚¯ãƒãƒ¼ãƒ³ãƒªã‚½ãƒ¼ã‚¹ã¨DRBDリソースã®
> orderè¨å®šãŒinfã§è¨å®šã•ã‚Œã¦ã„ã‚‹ã“ã¨ã¨ã€ã€Œsymmetricalã€ãŒtrue(デフォルト)
> ã«ãªã£ã¦ã„ã‚‹ã“ã¨ãŒåŽŸå› ã®ã‚ˆã†ã§ã™ã€‚
>
> ãŠãらãã€1ç³»ã®shutdownã«ä¼´ã†1ç³»ã®ã‚¯ãƒãƒ¼ãƒ³ãƒªã‚½ãƒ¼ã‚¹ã®åœæ¢ã§ã€
> ã“ã®order制約ãŒåƒãã€ä¸¡ç³»ã®DRBDã‚’(一旦)åœæ¢ã—よã†ã¨ã—ãŸã¨
> æ€ã‚ã‚Œã¾ã™ã€‚
>
> 以下ã€ã€Œorder回é¿æ¡ˆã€ã®ã‚ˆã†ã«order制約ã®ã‚¹ã‚³ã‚¢ã‚’0ã«ã—ã€
> 「symmetrical=falseã€ã‚’è¨å®šã—ã¦ã¿ã¦ãã ã•ã„。
>
> ---- orderå¤‰æ›´å‰ ----
> order odr_app-01 inf: cl_diskd_db ms_drbd_app
> order odr_app-02 inf: cl_diskd_os ms_drbd_app
> order odr_app-03 inf: cl_pingd_ope ms_drbd_app
> ---------------------
>   ↓以下ã®é€šã‚Šå¤‰æ›´ã—ã¦ã¿ã¦ãã ã•ã„。
> ---- order回é¿æ¡ˆ ----
> order odr_app-01 0: cl_diskd_db ms_drbd_app symmetrical=false
> order odr_app-02 0: cl_diskd_os ms_drbd_app symmetrical=false
> order odr_app-03 0: cl_pingd_ope ms_drbd_app symmetrical=false
> ---------------------
>
>
> #外ã—ã¦ã„ãŸã‚‰ã”ã‚ã‚“ãªã•ã„。
>
> #ãªãŠã€Pacemaker1.1ç³»ã§ã¯ã€ä¸Šè¨˜orderã§ã‚‚ã€1ç³»ã®ã‚¯ãƒãƒ¼ãƒ³åœæ¢ã«
>  2ç³»ã®DRBDãŒé“連れã«ãªã‚‹ã€ã¨ã„ã†ã“ã¨ã¯ç„¡ã„よã†ã§ã™ã€‚
>  制約ã®ä»•æ§˜ãŒPacemaker1.0ã¨1.1ã§å¾®å¦™ã«å¤‰ã‚ã£ã¦ã„るよã†ã§ã™ã・・
>
>
> 以上ã§ã™ã€‚
> よã‚ã—ããŠé¡˜ã„ã„ãŸã—ã¾ã™ã€‚
>
> ----- å…ƒã®ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ -----
> From: momoko@mail.t-momoko.org
> 宛先: linux-ha-japan@lists.osdn.me
> é€ä¿¡æ¸ˆã¿: 2016å¹´1月26æ—¥, ç«æ›œæ—¥ åˆå¾Œ 10:30:08
> 件å: Re: [Linux-ha-jp] スタンãƒã‚¤å´ã‚’切り離ã™ã¨DRBDãŒFailã‚’èµ·ã“ã—ã¦ã—ã¾ã†
>
> ã²ãŒã—ã•ã¾
>
>
> ãŠä¸–話ã«ãªã£ã¦ãŠã‚Šã¾ã™ã€åºƒç€¬ã§ã™ã€‚
> 添付ã¨ã—ã¾ã™ãŒã€ã”指示通りã«ha-logã¨messagesã®ãƒã‚°ã‚’ãã‚Œãžã‚Œ
> å–å¾—ã„ãŸã—ã¾ã—ãŸã€‚解決ã®ç³¸å£ãŒã‚ã‚Œã°ã‚ˆã„ã®ã§ã™ãŒãƒ»ãƒ»ãƒ»
>
> å°šã€ã“ã®ãƒã‚°å‡ºåŠ›å‰ã«ãŠã“ãªã£ãŸã“ã¨ã§ã™ãŒã€ä»¥ä¸‹ã®é€šã‚Šã§ã™ã€‚
>
>
> â—†æ£å¸¸çŠ¶æ…‹
> �1å·æ©Ÿå´ã§ã€rg_appグループãŒèµ·å‹•ä¸
>
> �2å·æ©Ÿå´ã§ã€rg_mysqldグループãŒèµ·å‹•ä¸
>
>
> ◆マイグレーション
>
> �上記ã€æ£å¸¸çŠ¶æ…‹ã‹ã‚‰1å·æ©Ÿã§ç¨¼åƒã—ã¦ã„ãŸrg_appグループをã€2å·æ©Ÿ
>  ã«migrateコマンドã§ç§»å‹•ï¼œunmigrateã¯è¡Œã‚ãš
>
> �æ£å¸¸ã«ç§»å‹•ã—ãŸã“ã¨ã‚’確èª
>
>
>  ⇒ã“ã®çŠ¶æ…‹ã‹ã‚‰ã€ãƒã‚°ã®åã出ã—ãŒè½ã¡ç€ã„ãŸã‚¿ã‚¤ãƒŸãƒ³ã‚°ã§ã€ãƒã‚°
>   リãƒãƒ¼ãƒ ã—ã¦ã€ä»¥é™ã®æ–°è¦ãƒã‚°ã‚’今回ã”æ示ã•ã›ã¦é ‚ãã¾ã—ãŸã€‚
>
>  ⇒上記ã®ãƒã‚°ã¯2å·æ©Ÿå´ã®ã¿ã¨ãªã‚Šã¾ã™ï¼œ1å·æ©Ÿå´ã‚‚å¿…è¦ãªå ´åˆã¯ã”æ示å¯èƒ½ã§ã™
>
>
> ◆完全ã«ã‚¹ã‚¿ãƒ³ãƒã‚¤ã¨åŒ–ã—ãŸ1å·æ©Ÿã®åœæ¢
>
> �heartbeatåœæ¢ã‚’実施
>
>  ⇒2å·æ©Ÿå´ã§crm_mon -fAを実行ã—ã¾ã™ãŒã€ã™ãã«DRBDã®demote処ç†ã§
>   エラーをåã出ã—ãŸæ¨¡æ§˜ï¼œãªãŠã€ç™ºç”Ÿã—ãŸã®ã¯ä½•æ•…ã‹2å·æ©Ÿå´ã®DRBD
>   リソース<1å·æ©Ÿã®ãƒªã‚½ãƒ¼ã‚¹ã§ã¯ç„¡ã„
>
> �時間ã¯ä¿‚ã‚‹ã‚‚ã®ã®ã€1å·æ©Ÿã®HAã¯æœ€çµ‚çš„ã«ã¯åœæ¢ã—ã¾ã™
>
>
>  ⇒ãƒã‚°ã¯æ¦‚ã1å·æ©Ÿå´ãŒåœæ¢ã—ã€ãƒã‚°ãŒè½ã¡ç€ã„ãŸå½“ãŸã‚Šã¾ã§ã§ã™
>
>
> 以上ã¨ãªã‚Šã¾ã™ã€‚よã‚ã—ããŠé¡˜ã„ã„ãŸã—ã¾ã™ã€‚
>
> ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼
> 追伸
>
> 上記対応直後ã®crm_mon -fAçµæžœã¯ä»¥ä¸‹ã¨ãªã‚Šã¾ã™
>
> Online: [ appwd02p.local ]
> OFFLINE: [ appwd01p.local ]
>
> Resource Group: rg_app
> res_vip_chk_app (ocf::heartbeat:VIPcheck): Started appwd02p.local
> res_vip_app (ocf::heartbeat:IPaddr2): Started appwd02p.local
> res_app_svr (ocf::heartbeat:appserver): Started appwd02p.local
> res_app_jgw (lsb:javagateway): Started appwd02p.local
> res_MailTo_app (ocf::heartbeat:MailTo): Started appwd02p.local
> Master/Slave Set: ms_drbd_app
> res_drbd_app:0 (ocf::linbit:drbd): Slave appwd02p.local (unmanaged) FAILED
> Stopped: [ res_drbd_app:1 ]
> Clone Set: cl_diskd_db
> Started: [ appwd02p.local ]
> Stopped: [ res_diskd_db:1 ]
> Clone Set: cl_diskd_os
> Started: [ appwd02p.local ]
> Stopped: [ res_diskd_os:1 ]
> Clone Set: cl_pingd_ope
> Started: [ appwd02p.local ]
> Stopped: [ res_pingd_ope:1 ]
>
> Node Attributes:
> * Node appwd02p.local:
> + disk_chk_db : normal
> + disk_chk_os : normal
> + master-res_drbd_app:0 : 10000
> + ope_l3sw_chk : 100
>
> Migration summary:
> * Node appwd02p.local:
> res_drbd_app:0: migration-threshold=1 fail-count=1000000
>
> Failed actions:
> res_drbd_app:0_demote_0 (node=appwd02p.local, call=71, rc=-2, status=Timed Out): unknown exec
> error
> res_drbd_app:0_stop_0 (node=appwd02p.local, call=76, rc=-2, status=Timed Out): unknown exec e
> rror
> ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼
>
>
>
>
>
> kazuh@goo.jpã•ã‚“:
> > 広瀬様
> >
> > ã²ãŒã—ã¨ç”³ã—ã¾ã™ã€‚ãŠä¸–話ã«ãªã‚Šã¾ã™ã€‚
> >
> > > ã—ã‹ã—ãªãŒã‚‰ã€ã©ã¡ã‚‰ã‹ã²ã¨ã¤ã®ã‚µãƒ¼ãƒã«ï¼’グループ全部寄ã›ãŸã‚ã¨ã€å®Œå…¨ã«ã‚¹ã‚¿
> > > ンãƒã‚¤æ©Ÿã¨åŒ–ã—ãŸã‚µãƒ¼ãƒå´ã®Heartbeatã‚’åœæ¢ã™ã‚‹ã¨ã€DRBDãŒã‚³ã‚±ã¦ã—ã¾ã„çµæžœçš„
> > > ã«MySQLãŒæ»äº¡ã™ã‚‹ã“ã¨ã«ãªã‚‹ã®ã§ã€HAãŒå´©å£Šã—ã¾ã™
> > ç§ãŒDRBDã«ã‚ã¾ã‚Šæ˜Žã‚‹ããªã„ã›ã„ã‚‚ã‚ã‚Šã€è¨å®šã‚’見ãŸã ã‘ã§ã¯
> > ã¡ã‚‡ã£ã¨åŽŸå› ãŒã‚ã‹ã‚Šã¾ã›ã‚“ã§ã—ãŸã€‚
> >
> > 「DRBDãŒã‚³ã‚±ã‚‹ã€ã¨ã‚ã‚‹ã®ã§ã€ä½•ã‚‰ã‹ã®ã‚¨ãƒ©ãƒ¼ãŒçµ¡ã‚“ã§ã„ã‚‹ã®
> > ã§ã¯ãªã„ã‹ã¨æ€ã„ã¾ã™ã€‚
> >
> > 解æžã®ãŸã‚ã€å½“該事象発生時ã®Pacemakerã®ãƒã‚°(ha-logã¾ãŸã¯/var/log/messages)ã¨
> > OSãƒã‚°(/var/log/messages)ã‚’ã„ãŸã ã‘ãªã„ã§ã—ょã†ã‹ã€‚
> >
> >
> > 以上ã§ã™ã€‚
> > よã‚ã—ããŠé¡˜ã„ã„ãŸã—ã¾ã™ã€‚
> >
> > ----- å…ƒã®ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ -----
> > From: momoko@mail.t-momoko.org
> > 宛先: linux-ha-japan@lists.osdn.me
> > é€ä¿¡æ¸ˆã¿: 2016å¹´1月26æ—¥, ç«æ›œæ—¥ åˆå‰ 1:33:45
> > 件å: [Linux-ha-jp] スタンãƒã‚¤å´ã‚’切り離ã™ã¨DRBDãŒFailã‚’èµ·ã“ã—ã¦ã—ã¾ã†
> >
> > 広瀬ã¨ç”³ã—ã¾ã™
> >
> >
> > ★環境
> >  CentOS6.7 x86_64
> >  Pacemaker(1.0.13-2.el6.x86_64)
> >  Heartbeat(3.0.5-1.1.el6.x86_64)
> >
> >
> > 上記環境ã«ãŠã„ã¦ã€1å·æ©Ÿå´ã§ã¯ã‚¢ãƒ—リケーションAã€2å·æ©Ÿå´ã§ã¯MySQL+DRBDã‚’
> > Activeã¨ã—ãŸã€é…置制約é•ã„ã®ä¸¡ç³»Act/Act構æˆã‚’ã¨ã‚Šã¾ã—ãŸ(コンフィグã¯æœ€å¾Œ
> > ã«å¼µã‚Šä»˜ã‘ã¾ã™)
> >
> >
> > 具体的ã«ã¯rg_mysqldグループã¯2å·æ©Ÿã§èµ·å‹•ã•ã›ã€rg_applicationグループã¯1å·
> > æ©Ÿã§èµ·å‹•ã•ã›ã€ã©ã¡ã‚‰ã‹ãŒæ•…éšœã€åœæ¢ã—ãŸå ´åˆã¯ç”Ÿã残ã£ã¦ã„るサーãƒå´ã«å¯„ã‚‹
> > よã†ã«æ§‹æˆã—ã¾ã—ãŸ(HA起動時ã®å„ªå…ˆèµ·å‹•é †ã¨ã—ã¦)
> > 構æˆã¨ã—ã¦ã¯ã€å…¬é–‹ã•ã‚Œã¦ã„ã‚‹LinuxHA-JPã®éŽåŽ»ã®OSCã®å…¬é–‹è³‡æ–™ã«ã‚ã‚‹æ±ã•ã¾ã®
> > 「雷ã€ãƒ‘ターンã«è¿‘ã„ã¨è€ƒãˆã¦ã„ãŸã ã‘ã‚Œã°ã¨æ€ã„ã¾ã™ã€‚
> >
> >  ※「CRM-CLIã§HAクラスタを自在ã«åˆ¶å¾¡ã—よã†ï¼ã€å‚考
> >
> > ãŸã ã—ã€ä¸Šè¨˜è³‡æ–™ã®å ´åˆã¯ã‚°ãƒ«ãƒ¼ãƒ—化ã¯ã›ãšã€å˜ä¸€ãƒªã‚½ãƒ¼ã‚¹ã‚’ãƒãƒ©ãƒãƒ©ã«èµ·å‹•ã•ã›
> > ãŸã„å ´åˆã€ä¸”ã¤DRBDã¯å˜åœ¨ã—ãªã„å‰æã®ãŸã‚ã€MSリソースを絡ã‚ãŸå„種ã®åˆ¶ç´„æ¡ä»¶
> > 定義ã¯ç‹¬è‡ªã®è§£é‡ˆã«åŸºã¥ã„ãŸã‚‚ã®ã¨ãªã‚Šã¾ã™ã€‚
> >
> >
> > ★グループ定義
> > group rg_mysqld res_vip_chk_db res_vip_db res_fs_db res_mysql_app res_MailTo_db
> > group rg_app res_vip_chk_app res_vip_app res_app_svr res_app_jgw res_MailTo_app
> >
> >
> > ★é…置制約定義
> > location loc_app rg_app \
> > rule $id="l_app-01" $role="master" 200: #uname eq appwd01p.local \
> > rule $id="l_app-02" $role="master" 100: #uname eq appwd02p.local \
> >
> >
> > location loc_mysql ms_drbd_app \
> > rule $id="l_sql-01" $role="master" 200: #uname eq appwd02p.local \
> > rule $id="l_sql-02" $role="master" 100: #uname eq appwd01p.local \
> >
> >
> > 基本的ãªã€locationã€colocationã€orderã®åˆ¶ç´„ã«é–¢ã—ã¦ã¯æœŸå¾…通りã®èµ·å‹•ã€ä¸¦ã³ã«
> > マイグレーション動作をã—ã¾ã™
> > ã—ã‹ã—ãªãŒã‚‰ã€ã©ã¡ã‚‰ã‹ã²ã¨ã¤ã®ã‚µãƒ¼ãƒã«ï¼’グループ全部寄ã›ãŸã‚ã¨ã€å®Œå…¨ã«ã‚¹ã‚¿
> > ンãƒã‚¤æ©Ÿã¨åŒ–ã—ãŸã‚µãƒ¼ãƒå´ã®Heartbeatã‚’åœæ¢ã™ã‚‹ã¨ã€DRBDãŒã‚³ã‚±ã¦ã—ã¾ã„çµæžœçš„
> > ã«MySQLãŒæ»äº¡ã™ã‚‹ã“ã¨ã«ãªã‚‹ã®ã§ã€HAãŒå´©å£Šã—ã¾ã™
> >
> >
> > èµ·å› ã¯DRBDã®çŠ¶æ…‹ã«ã‚ã‚‹ã¨ã¿ã¦ã„ã‚‹ã®ã§ã€MSリソースã®åŒå±…制約ã€é…ç½®ã«ãªã‚“らã‹
> > ã®å•é¡ŒãŒã‚ã‚‹ã¨ã¿ã¦ã„ã¾ã™(Diskdも関係ã™ã‚‹ã‹ãƒ»ãƒ»ãƒ»)
> > ç§ã¨ã—ã¦ã‚‚難易度ã®é«˜ã„構æˆã«ã—ãŸãªãã¨å°‘ã—後悔気味ã§ã™ãŒã€MySQLを主軸ã¨ã™ã‚‹
> > グループã¨ã€Javaを主軸ã¨ã™ã‚‹ã‚¢ãƒ—リケーショングループã®ãƒ¡ãƒ¢ãƒªã®åˆ©ç”¨çŽ‡ãŒã¨ã‚‚
> > ã«é«˜ã„ã®ã§ã€åˆ†é›¢ã•ã›ãŸæ¬¡ç¬¬ã§ã™(ã¾ãã€ã‚ã¨ã‚¹ã‚¿ãƒ³ãƒã‚¤æ©ŸãŒéŠã‚“ã§ã„ã‚‹ã¨ã‚‚ã£ãŸã„
> > ãªã„ã®ã§)
> >
> >
> > 簡便ãªã”質å•å†…容ã§å¤§å¤‰ç”³ã—訳ã”ã–ã„ã¾ã›ã‚“ãŒã€æœ¬ä»¶ä½•ã‹ã”指摘ã„ãŸã ã‘る部分ãŒ
> > 御座ã„ã¾ã—ãŸã‚‰ã€ã”è¿”ç”ã„ãŸã ã‘ã‚‹ã¨åŠ©ã‹ã‚Šã¾ã™
> >
> >
> > 以上ã€ã‚ˆã‚ã—ããŠé¡˜ã„ã„ãŸã—ã¾ã™
> >
> > ★以下パラメータ(primitiveã®è©³ç´°ã¯ãŠãらã関係ãŒç„¡ã„ã®ã§çœã„ã¦ã¾ã™)
> > ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼
> > primitive res_MailTo_db ocf:heartbeat:MailTo \
> > primitive res_MailTo_app ocf:heartbeat:MailTo \
> > primitive res_diskd_db ocf:pacemaker:diskd \
> > primitive res_diskd_os ocf:pacemaker:diskd \
> > primitive res_drbd_app ocf:linbit:drbd \
> > primitive res_fs_db ocf:heartbeat:Filesystem \
> > primitive res_mysql_app ocf:heartbeat:mysql \
> > primitive res_pingd_ope ocf:pacemaker:pingd \
> > primitive res_vip_chk_db ocf:heartbeat:VIPcheck \
> > primitive res_vip_chk_app ocf:heartbeat:VIPcheck \
> > primitive res_vip_db ocf:heartbeat:IPaddr2 \
> > primitive res_vip_app ocf:heartbeat:IPaddr2 \
> > primitive res_app_jgw lsb:java_application \
> > primitive res_app_svr ocf:heartbeat:application \
> >
> > group rg_mysqld res_vip_chk_db res_vip_db res_fs_db res_mysql_app res_MailTo_db
> > group rg_app res_vip_chk_app res_vip_app res_app_svr res_app_jgw res_MailTo_app
> >
> > ms ms_drbd_app res_drbd_app \
> > meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1" notify="true"
> >
> > clone cl_diskd_db res_diskd_db \
> > meta clone-max="2" clone-node-max="1"
> > clone cl_diskd_os res_diskd_os \
> > meta clone-max="2" clone-node-max="1"
> > clone cl_pingd_ope res_pingd_ope \
> > meta clone-max="2" clone-node-max="1"
> >
> > location loc_mysql ms_drbd_app \
> > rule $id="l_sql-01" $role="master" 200: #uname eq appwd02p.local \
> > rule $id="l_sql-02" $role="master" 100: #uname eq appwd01p.local \
> > rule $id="l_sql-03" $role="master" -inf: defined ope_l3sw_chk and ope_l3sw_chk lt 100 \
> > rule $id="l_sql-04" -inf: defined os_disk_chk and os_disk_chk eq ERROR \
> > rule $id="l_sql-05" -inf: defined db_disk_chk and db_disk_chk eq ERROR
> > location loc_apprg_app \
> > rule $id="l_app-01" $role="master" 200: #uname eq appwd01p.local \
> > rule $id="l_app-02" $role="master" 100: #uname eq appwd02p.local \
> > rule $id="l_app-03" $role="master" -inf: defined ope_l3sw_chk and ope_l3sw_chk lt 100 \
> > rule $id="l_app-04" -inf: defined os_disk_chk and os_disk_chk eq ERROR \
> > rule $id="l_app-05" -inf: defined db_disk_chk and db_disk_chk eq ERROR
> >
> > colocation col_app-01 inf: ms_drbd_app cl_diskd_db
> > colocation col_app-02 inf: ms_drbd_app cl_diskd_os
> > colocation col_app-03 inf: ms_drbd_app cl_pingd_ope
> > colocation col_app-04 inf: rg_mysqld ms_drbd_app:Master
> >
> > order odr_app-01 inf: cl_diskd_db ms_drbd_app
> > order odr_app-02 inf: cl_diskd_os ms_drbd_app
> > order odr_app-03 inf: cl_pingd_ope ms_drbd_app
> > order odr_app-04 inf: ms_drbd_app:promote rg_mysqld rg_app:start
> >
> > property $id="cib-bootstrap-options" \
> > default-resource-stickiness="200" \
> > no-quorum-policy="ignore" \
> > stonith-enabled="false" \
> > dc-version="1.0.13-a83fae5" \
> > cluster-infrastructure="Heartbeat"
> > ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼ï¼
> >
> > _______________________________________________
> > Linux-ha-japan mailing list
> > Linux-ha-japan@lists.osdn.me
> > http://lists.osdn.me/mailman/listinfo/linux-ha-japan
> >
> > _______________________________________________
> > Linux-ha-japan mailing list
> > Linux-ha-japan@lists.osdn.me
> > http://lists.osdn.me/mailman/listinfo/linux-ha-japan
>
> _______________________________________________
> Linux-ha-japan mailing list
> Linux-ha-japan@lists.osdn.me
> http://lists.osdn.me/mailman/listinfo/linux-ha-japan
> _______________________________________________
> Linux-ha-japan mailing list
> Linux-ha-japan@lists.osdn.me
> http://lists.osdn.me/mailman/listinfo/linux-ha-japan
_______________________________________________
Linux-ha-japan mailing list
Linux-ha-japan@lists.osdn.me
http://lists.osdn.me/mailman/listinfo/linux-ha-japan