Mailing List Archive

Could not establish attrd connection: Connection refused (111)
お世話になっております。
岸野と申します。

表題の件についてご教示ください。

VM上にハードウェアバージョン7の仮想マシンを用意し
以下のバージョンで2台構成を組んでいます。

pacemaker.combinedで起動した直後に
pacemaker.log, corosync.logに以下のログが出力されております。

crmコマンドも使えており、動きには問題なさそうですが
ログがエラーを示唆しているのかがわからないため
影響の特定と原因の解決にお力をお貸しいただけますでしょうか?

============
<サーバ情報>
サーバ1
【ホスト名】test_host1
【IPアドレス】192.168.0.106

サーバ2
【ホスト名】test_host2
【IPアドレス】192.168.0.107

CentOS 6.6 x86_64
pacemaker-1.1.12-1
corosync-2.3.4-1
(pacemaker-repo-1.1.12-1.1.el6.x86_64.rpmを使いインストールし
SELinuxはdisabled, iptablesは起動しておりません。)
============

# cat /var/log/pacemaker.log
Oct 13 09:26:25 [1146] test_host1 ifcheckd: notice:
_cs_cmap_connections_key_changed: Stop monitoring interface. Notified of
Pacemaker stop event
Oct 13 09:26:26 [1146] test_host1 ifcheckd: notice:
_regular_attr_init: Start to monitor interface after Pacemaker
restarted
Oct 13 09:26:59 [1146] test_host1 ifcheckd: notice:
_cs_cmap_connections_key_changed: Stop monitoring interface. Notified of
Pacemaker stop event
Oct 13 09:26:59 [1146] test_host1 ifcheckd: notice: _cs_cmap_destroy:
Stop monitoring interface. cmap connection is destroyed
Oct 13 09:27:44 [1146] test_host1 ifcheckd: notice: crm_ipc_send:
Connection to attrd closed
Oct 13 09:27:44 [1146] test_host1 ifcheckd: info:
attrd_update_delegate: Connecting to cluster... 4 retries remaining
Oct 13 09:27:44 [1146] test_host1 ifcheckd: info: crm_ipc_connect:
Could not establish attrd connection: Connection refused (111)
Oct 13 09:27:45 [28069] test_host1 pacemakerd: info: crm_log_init:
Changed active directory to /var/lib/heartbeat/cores/root
Oct 13 09:27:45 [28069] test_host1 pacemakerd: info: crm_ipc_connect:
Could not establish pacemakerd connection: Connection refused (111)
Oct 13 09:27:45 [28069] test_host1 pacemakerd: info: get_cluster_type:
Detected an active 'corosync' cluster
Oct 13 09:27:45 [28069] test_host1 pacemakerd: info: mcp_read_config:
Reading configure for stack: corosync
Oct 13 09:27:45 [28069] test_host1 pacemakerd: notice: crm_add_logfile:
Switching to /var/log/cluster/corosync.log
Oct 13 09:27:45 [1146] test_host1 ifcheckd: info:
attrd_update_delegate: Connecting to cluster... 3 retries remaining
Oct 13 09:27:45 [1146] test_host1 ifcheckd: info: crm_ipc_connect:
Could not establish attrd connection: Connection refused (111)
Oct 13 09:27:47 [1146] test_host1 ifcheckd: info:
attrd_update_delegate: Connecting to cluster... 2 retries remaining
Oct 13 09:27:48 [1146] test_host1 ifcheckd: notice:
_regular_attr_init: Start to monitor interface
Oct 13 09:27:56 [1146] test_host1 ifcheckd: notice:
_cs_cmap_connections_key_changed: Stop monitoring interface. Notified of
Pacemaker stop event
Oct 13 09:27:57 [1146] test_host1 ifcheckd: notice:
_regular_attr_init: Start to monitor interface after Pacemaker
restarted
Oct 13 09:27:58 [1146] test_host1 ifcheckd: notice:
_cs_cmap_connections_key_changed: Stop monitoring interface. Notified of
Pacemaker stop event
Oct 13 09:27:59 [1146] test_host1 ifcheckd: notice:
_regular_attr_init: Start to monitor interface after Pacemaker
restarted

/var/log/cluster/corosync.log抜粋

Oct 13 09:27:45 [28078] test_host1 crmd: info: crm_ipc_connect:
Could not establish cib_shm connection: Connection refused (111)
Oct 13 09:27:45 [28078] test_host1 crmd: debug:
cib_native_signon_raw: Connection unsuccessful (0 (nil))
Oct 13 09:27:45 [28078] test_host1 crmd: debug:
cib_native_signon_raw: Connection to CIB failed: Transport endpoint is
not connected
Oct 13 09:27:45 [28078] test_host1 crmd: debug:
cib_native_signoff: Signing out of the CIB Service

Oct 13 09:27:45 [28074] test_host1 stonithd: info: crm_ipc_connect:
Could not establish cib_rw connection: Connection refused (111)
Oct 13 09:27:45 [28074] test_host1 stonithd: debug:
cib_native_signon_raw: Connection unsuccessful (0 (nil))
Oct 13 09:27:45 [28074] test_host1 stonithd: debug:
cib_native_signon_raw: Connection to CIB failed: Transport endpoint is
not connected
Oct 13 09:27:45 [28074] test_host1 stonithd: debug:
cib_native_signoff: Signing out of the CIB Service

Oct 13 09:27:45 [28078] test_host1 crmd: info: crm_ipc_connect:
Could not establish cib_shm connection: Connection refused (111)
Oct 13 09:27:45 [28078] test_host1 crmd: debug:
cib_native_signon_raw: Connection unsuccessful (0 (nil))
Oct 13 09:27:45 [28078] test_host1 crmd: debug:
cib_native_signon_raw: Connection to CIB failed: Transport endpoint is
not connected
Oct 13 09:27:45 [28078] test_host1 crmd: debug:
cib_native_signoff: Signing out of the CIB Service

corosyncの設定は以下のようにしております。

# cat /etc/corosync/corosync.conf

totem {
version: 2

crypto_cipher: none
crypto_hash: none
secauth: off
rrp_mode: none

interface {
ringnumber: 0
bindnetaddr: 192.168.0.106
mcastport: 5405
ttl: 1
}
transport: udpu
}

logging {
fileline: off
to_logfile: yes
to_syslog: no
logfile: /var/log/cluster/corosync.log
debug: on
timestamp: on
logger_subsys {
subsys: QUORUM
debug: on
}
}

nodelist {
node {
ring0_addr: 192.168.0.106
}

node {
ring0_addr: 192.168.0.107
}
}

quorum {
provider: corosync_votequorum
expected_votes: 2
two_node: 1
}
Re: Could not establish attrd connection: Connection refused (111) [ In reply to ]
野さん


こんばんは、山内です。

あまり今まで気にしていませんでしたが・・・
手元の仮想マシンで試してみましたが、同様のログは出ます。

多分、Connection refusedを気にされているのだと思いますが、起動時の各プロセスがIPC通信を確立している最中に出るもので、問題はないと思います。
#起動時に接続(主にcibとの接続の箇所だと思いますが)対象のプロセスがまだ接続可能ではない時に出ていると思います。
#ログもinfoレベルですので、あくまでも情報ですね。

起動後、crm_monのコマンドなどでクラスタのノードがOnlineで表示されて認識されていれば問題ありません。

[root@cent66-01 corosync]# crm_mon -1 -Af
Last updated: Thu Oct 15 20:11:03 2015
Last change: Thu Oct 15 20:04:48 2015
Stack: corosync
Current DC: cent66-01 (3232238090) - partition with quorum
Version: 1.1.12-561c4cf
2 Nodes configured
0 Resources configured

Online: [ cent66-01 cent66-02 ]
(snip)


また、attrdなどであれば、以下のコマンドを実行してちゃんと属性が表示されれば、cibとの接続も出来ていることになります。

[root@cent66-01 corosync]# attrd_updater -n test -v 100

[root@cent66-01 corosync]# crm_mon -1 -Af
Last updated: Thu Oct 15 20:20:09 2015
Last change: Thu Oct 15 20:04:48 2015
Stack: corosync
Current DC: cent66-01 (3232238090) - partition with quorum
Version: 1.1.12-561c4cf
2 Nodes configured
0 Resources configured


Online: [ cent66-01 cent66-02 ]



Node Attributes:

* Node cent66-01:
    + test                             : 100       ★attrd_updaterを実行したノードに追加した属性がセットされる。
* Node cent66-02:
Migration summary:

* Node cent66-01: 
以上です。



----- Original Message -----
>From: Yuji Kishino <ykishino1226@gmail.com>
>To: linux-ha-japan@lists.osdn.me
>Date: 2015/10/15, Thu 14:05
>Subject: [Linux-ha-jp] Could not establish attrd connection: Connection refused (111)
>
>
>お世話になっております。
>岸野と申します。
>表題の件についてご教示ください。
>VM上にハードウェアバージョン7の仮想マシンを用意し
>以下のバージョンで2台構成を組んでいます。
>pacemaker.combinedで起動した直後に
>pacemaker.log, corosync.logに以下のログが出力されております。
>crmコマンドも使えており、動きには問題なさそうですが
>ログがエラーを示唆しているのかがわからないため
>影響の特定と原因の解決にお力をお貸しいただけますでしょうか?
>============
><サーバ情報>
>サーバ1
>【ホスト名】test_host1
>【IPアドレス】192.168.0.106
>サーバ2
>【ホスト名】test_host2
>【IPアドレス】192.168.0.107
>CentOS 6.6 x86_64
>pacemaker-1.1.12-1
>corosync-2.3.4-1
>(pacemaker-repo-1.1.12-1.1.el6.x86_64.rpmを使いインストールし
>SELinuxはdisabled, iptablesは起動しておりません。)
>============
># cat /var/log/pacemaker.log
>Oct 13 09:26:25 [1146] test_host1   ifcheckd:   notice: _cs_cmap_connections_key_changed:   Stop monitoring interface. Notified of Pacemaker stop event
>Oct 13 09:26:26 [1146] test_host1   ifcheckd:   notice: _regular_attr_init:         Start to monitor interface after Pacemaker restarted
>Oct 13 09:26:59 [1146] test_host1   ifcheckd:   notice: _cs_cmap_connections_key_changed:   Stop monitoring interface. Notified of Pacemaker stop event
>Oct 13 09:26:59 [1146] test_host1   ifcheckd:   notice: _cs_cmap_destroy:   Stop monitoring interface. cmap connection is destroyed
>Oct 13 09:27:44 [1146] test_host1   ifcheckd:   notice: crm_ipc_send:       Connection to attrd closed
>Oct 13 09:27:44 [1146] test_host1   ifcheckd:     info: attrd_update_delegate:      Connecting to cluster... 4 retries remaining
>Oct 13 09:27:44 [1146] test_host1   ifcheckd:     info: crm_ipc_connect:    Could not establish attrd connection: Connection refused (111)
>Oct 13 09:27:45 [28069] test_host1 pacemakerd:     info: crm_log_init:      Changed active directory to /var/lib/heartbeat/cores/root
>Oct 13 09:27:45 [28069] test_host1 pacemakerd:     info: crm_ipc_connect:   Could not establish pacemakerd connection: Connection refused (111)
>Oct 13 09:27:45 [28069] test_host1 pacemakerd:     info: get_cluster_type:  Detected an active 'corosync' cluster
>Oct 13 09:27:45 [28069] test_host1 pacemakerd:     info: mcp_read_config:   Reading configure for stack: corosync
>Oct 13 09:27:45 [28069] test_host1 pacemakerd:   notice: crm_add_logfile:   Switching to /var/log/cluster/corosync.log
>Oct 13 09:27:45 [1146] test_host1   ifcheckd:     info: attrd_update_delegate:      Connecting to cluster... 3 retries remaining
>Oct 13 09:27:45 [1146] test_host1   ifcheckd:     info: crm_ipc_connect:    Could not establish attrd connection: Connection refused (111)
>Oct 13 09:27:47 [1146] test_host1   ifcheckd:     info: attrd_update_delegate:      Connecting to cluster... 2 retries remaining
>Oct 13 09:27:48 [1146] test_host1   ifcheckd:   notice: _regular_attr_init:         Start to monitor interface
>Oct 13 09:27:56 [1146] test_host1   ifcheckd:   notice: _cs_cmap_connections_key_changed:   Stop monitoring interface. Notified of Pacemaker stop event
>Oct 13 09:27:57 [1146] test_host1   ifcheckd:   notice: _regular_attr_init:         Start to monitor interface after Pacemaker restarted
>Oct 13 09:27:58 [1146] test_host1   ifcheckd:   notice: _cs_cmap_connections_key_changed:   Stop monitoring interface. Notified of Pacemaker stop event
>Oct 13 09:27:59 [1146] test_host1   ifcheckd:   notice: _regular_attr_init:         Start to monitor interface after Pacemaker restarted
>/var/log/cluster/corosync.log抜粋
>Oct 13 09:27:45 [28078] test_host1       crmd:     info: crm_ipc_connect:   Could not establish cib_shm connection: Connection refused (111)
>Oct 13 09:27:45 [28078] test_host1       crmd:    debug: cib_native_signon_raw:     Connection unsuccessful (0 (nil))
>Oct 13 09:27:45 [28078] test_host1       crmd:    debug: cib_native_signon_raw:     Connection to CIB failed: Transport endpoint is not connected
>Oct 13 09:27:45 [28078] test_host1       crmd:    debug: cib_native_signoff:        Signing out of the CIB Service
>Oct 13 09:27:45 [28074] test_host1   stonithd:     info: crm_ipc_connect:   Could not establish cib_rw connection: Connection refused (111)
>Oct 13 09:27:45 [28074] test_host1   stonithd:    debug: cib_native_signon_raw:     Connection unsuccessful (0 (nil))
>Oct 13 09:27:45 [28074] test_host1   stonithd:    debug: cib_native_signon_raw:     Connection to CIB failed: Transport endpoint is not connected
>Oct 13 09:27:45 [28074] test_host1   stonithd:    debug: cib_native_signoff:        Signing out of the CIB Service
>Oct 13 09:27:45 [28078] test_host1       crmd:     info: crm_ipc_connect:   Could not establish cib_shm connection: Connection refused (111)
>Oct 13 09:27:45 [28078] test_host1       crmd:    debug: cib_native_signon_raw:     Connection unsuccessful (0 (nil))
>Oct 13 09:27:45 [28078] test_host1       crmd:    debug: cib_native_signon_raw:     Connection to CIB failed: Transport endpoint is not connected
>Oct 13 09:27:45 [28078] test_host1       crmd:    debug: cib_native_signoff:        Signing out of the CIB Service
>corosyncの設定は以下のようにしております。
># cat /etc/corosync/corosync.conf
>totem {
>        version: 2
>        crypto_cipher: none
>        crypto_hash: none
>        secauth: off
>        rrp_mode: none
>        interface {
>                ringnumber: 0
>                bindnetaddr: 192.168.0.106
>                mcastport: 5405
>                ttl: 1
>        }
>        transport: udpu
>}
>logging {
>        fileline: off
>        to_logfile: yes
>        to_syslog: no
>        logfile: /var/log/cluster/corosync.log
>        debug: on
>        timestamp: on
>        logger_subsys {
>                subsys: QUORUM
>                debug: on
>        }
>}
>nodelist {
>        node {
>                ring0_addr: 192.168.0.106
>        }
>        node {
>                ring0_addr: 192.168.0.107
>        }
>}
>quorum {
>        provider: corosync_votequorum
>        expected_votes: 2
>        two_node: 1
>}
>_______________________________________________
>Linux-ha-japan mailing list
>Linux-ha-japan@lists.osdn.me
>http://lists.osdn.me/mailman/listinfo/linux-ha-japan
>
>
>

_______________________________________________
Linux-ha-japan mailing list
Linux-ha-japan@lists.osdn.me
http://lists.osdn.me/mailman/listinfo/linux-ha-japan