Mailing List Archive: [lvs-users] Problem with building cluster with servers in different networks

Hello,

I have 3 dedicated servers: 62.75.229.111, 217.172.186.175, 85.25.139.108
and I want to build cluster.
So I need tunneled ipvs connection. I try to build it, but I'm not sure
what VIP is. So I read the docs and it says that VIP should be the
external. But also should not be the same with director device's IP.
I enables ip_forward on every machine. I install on realservers nginx.
So, below my configs:

62.75.229.111:
ldirectord.Óf

logfile="/var/log/ldirectord.log"
checktimeout=100000
checkinterval=200
autoreload=no
logfile="local0"
#quiescent=no
virtual=62.75.229.111:80
real=217.172.186.175:80 ipip 1
real=85.25.139.108:80 ipip 1
service=http
scheduler=wlc
protocol=tcp

Ifconfig:
62.75.229.111:~# ifconfig
eth0 Link encap:Ethernet HWaddr 00:19:99:b2:43:9c
inet addr:62.75.229.111 Bcast:62.75.229.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:306522 errors:0 dropped:0 overruns:0 frame:0
TX packets:17899 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:26316962 (25.0 MiB) TX bytes:2133892 (2.0 MiB)
Interrupt:18

lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

62.75.229.111:~# ipvsadm
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port Scheduler Flags
-> RemoteAddress:Port Forward Weight ActiveConn InActConn
TCP 62.75.229.111.server4you.net:www wlc
-> austria175.server4you.net:ww Tunnel 1 0 0
-> echo631.server4you.net:www Tunnel 1 0 0

Realserver 217.172.186.175:

217.172.186.175:~# tcpdump -i tunl0 'port 80'
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on tunl0, link-type RAW (Raw IP), capture size 65535 bytes
07:38:17.493788 IP 62.118.67.42.55366 > titan455.server4you.net.www: Flags
[S],
seq 3293257190, win 8192, options [mss 1460,nop,wscale 2,nop,nop,sackOK],
length
0
07:38:17.494037 IP 62.118.67.42.55366 > titan455.server4you.net.www: Flags
[S],
seq 3293257190, win 8192, options [mss 1460,nop,wscale 2,nop,nop,sackOK],
length
0
07:38:17.494295 IP 62.118.67.42.55366 > titan455.server4you.net.www: Flags
[S],
seq 3293257190, win 8192, options [mss 1460,nop,wscale 2,nop,nop,sackOK],
length
0

217.172.186.175:~# ifconfig
eth0 Link encap:Ethernet HWaddr 00:25:22:15:3b:8d
inet addr:217.172.186.175 Bcast:217.172.186.255
Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:2682 errors:0 dropped:0 overruns:0 frame:0
TX packets:634 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:208491 (203.6 KiB) TX bytes:83107 (81.1 KiB)
Interrupt:27 Base address:0x4000

lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

tunl0 Link encap:IPIP Tunnel HWaddr
inet addr:192.168.1.100 Mask:255.255.255.0
UP RUNNING NOARP MTU:1480 Metric:1
RX packets:394 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:19808 (19.3 KiB) TX bytes:0 (0.0 B)

The second realserver have the same settings.

The problem is: When I try in browser to go to 62.75.229.111 I see the
packets on real machine 217. as you can see above.. But I don't get nginx
welcome page in browser.

Can anyone help me?

P.S. if I try tunl0 inet address as local I see packets(as above), but if I
try 62.75.229.111 as tunl0 inet addr then in ipvsadm I didn't see that
realserver.
_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users@LinuxVirtualServer.org
Send requests to lvs-users-request@LinuxVirtualServer.org
or go to http://lists.graemef.net/mailman/listinfo/lvs-users

Hello Alex,

From your ldirectord.conf :
VIP=62.75.229.111
DIP1=217.172.186.175
DIP2=85.25.139.108

Simply to LVS-TUN Guide (i.e
http://www.austintek.com/LVS/LVS-HOWTO/HOWTO/LVS-HOWTO.LVS-Tun.html) :
The VIP at tunl0 must be the same as at ldirectord.conf "virtual"
tunl0 must set to non-arping i.e at sysctl.conf

Regulary LVS setup shuld be anyway 4 systems not 3 - 2 LVS and 2
realservers to not confuse the LVS and kernel and its Routing.
The LVS systems can bee smal systems like an i386 .

To build an LVS Cluster with your env use corosync / pacemakerfor for
failover ldirectord.
see http://clusterlabs.org/wiki/Using_ldirectord

pps : the usage of rfc1912 addresses at VIP may failed to no direct
internet routing of rfc1912 :-) on Extranets
Hope this helps :-)

--
Mit freundlichen GrÃ¼ÃŸen / Best Regards
Horst Venzke ; PGP NET : 1024G/082F2E6D ; http://www.remsnet.de
Legal Notice: This transmittal and/or attachments may be privileged or
confidential.
It is intended solely for the addressee named above. Any review,
dissemination, or copying is strictly prohibited.
If you received this transmittal in error, please notify us immediately by
reply and immediately delete this message and all its attachments.
Thank you.
_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users@LinuxVirtualServer.org
Send requests to lvs-users-request@LinuxVirtualServer.org
or go to http://lists.graemef.net/mailman/listinfo/lvs-users