Posts: 187
Threads: 13
Joined: Oct 2009
Reputation:
0
Hi Velocity2k,
After careful analysis of network traffic it is clear to me that the incidence of a connection reset or remote close of connection is directly proportionate to the number of games simutaneously being hosted by the BOT.
I have been disconnected almost consistently while there are 4+ RANKED games running simultaneously and 4+ QUALIFY games running.
I can also see that I am losing connection while the 4th game is starting on the BOT.
I just got dropped from a QUALIFY game the moment a 4th simultaneous RANKED game loaded. (BTanks League RANKED #24748) It's very clear the BOT cannot successfully manage that many TCP/IP connections without losing or corrupting packets or full segments. The game is way more choppy, and this is a RECENT issue to the past 2-3 weeks.
It is clear to me that the BOT is having difficulty as many players are unable to maintain connection when the BOT is loaded with lots of TCP/IP traffic.
It is also clear that when BOT is not loaded I don't ever get disconnections.
Some may argue that since some players don't disconnect that the problem must be the players. I disagree categorically. It's not that particular players drop, it's the fact that SOMEONE is going to get dropped when the bot is loaded, and the most vulnerable are dropped first until traffic stabilizes.
During peak hours many games are ruined by this. It would be better to have less games but not drop than have lots of games and having most of them ruined because the BOT is hosting too many games at once.
PLEASE put a maximum number of games hosted at once. Don't let 6 or 7 qualify games run at the same time...Please wait to host the next one when another game finishes...or use a different BOT for qualify.
I also notice when over 4 RANKED games are running at once, we're going to see more ERRORCONRESETS.
Have a look youself, the evidence is there. More games at once means many drops.
- Rob
Former Chieftain of Clan toaf on US EAST *Retired*
Just playing for the fun of it now.
Posts: 332
Threads: 44
Joined: Dec 2008
Reputation:
4
(2011-11-14, 15:55:03)Velocity2k Wrote: (2011-11-14, 00:49:07)GEN_Schwarzkopf Wrote: I just got dropped from a QUALIFY game the moment a 4th simultaneous RANKED game loaded. (BTanks League RANKED #24748)
No, you didn't. You got disconnected after the game has started. And during this situation no new tcp conntections got established.
You are writing that this problem started few weeks ago. Nothing changed on the bot. We even had more simultaneously hosted games in the past months/years.
And if you take 25 games for example, no leavers so far (very unlikely) there would be 25*10 = 250 TCP connections. That's almost nothing for an up to date computer system...
Yesterday i pinged the server for a long time during the busy hour and not a single ping got dropped.
And finally just a short list of disconnects on the qualify bot:
Code:
[Sat Nov 12 03:32:47 2011] [GAME: BTanks League QUALIFY #69643] [Local]: Admn has lost the connection (connection closed by remote host).
[Sat Nov 12 03:36:19 2011] [GAME: BTanks League QUALIFY #69643] [Local]: daxz has lost the connection (connection closed by remote host).
[Sat Nov 12 05:29:35 2011] [GAME: BTanks League QUALIFY #69647] [Local]: Admn has lost the connection (connection closed by remote host).
[Sat Nov 12 05:49:56 2011] [GAME: BTanks League QUALIFY #69650] [Local]: alooy has lost the connection (connection closed by remote host).
[Sat Nov 12 06:01:02 2011] [GAME: BTanks League QUALIFY #69650] [Local]: Admn has lost the connection (connection closed by remote host).
[Sat Nov 12 06:24:04 2011] [GAME: BTanks League QUALIFY #69651] [Local]: alooy has lost the connection (connection closed by remote host).
[Sat Nov 12 07:29:18 2011] [GAME: BTanks League QUALIFY #69654] [Local]: Admn has lost the connection (connection closed by remote host).
[Sat Nov 12 08:34:54 2011] [GAME: BTanks League QUALIFY #69656] [Local]: Admn has lost the connection (connection closed by remote host).
[Sat Nov 12 13:40:18 2011] [GAME: BTanks League QUALIFY #69684] [Local]: I-LOVE-VNX has lost the connection (connection closed by remote host).
[Sat Nov 12 16:46:56 2011] [GAME: BTanks League QUALIFY #69709] [Local]: oma978 has lost the connection (connection closed by remote host).
[Sat Nov 12 17:00:19 2011] [GAME: BTanks League QUALIFY #69711] [Local]: oma978 has lost the connection (connection closed by remote host).
[Sat Nov 12 18:59:43 2011] [GAME: BTanks League QUALIFY #69708] [Local]: torijin has lost the connection (connection closed by remote host).
[Sat Nov 12 21:00:18 2011] [GAME: BTanks League QUALIFY #69741] [Local]: Admn has lost the connection (connection closed by remote host).
[Sat Nov 12 21:20:26 2011] [GAME: BTanks League QUALIFY #69747] [Local]: alooy has lost the connection (connection closed by remote host).
[Sat Nov 12 21:27:39 2011] [GAME: BTanks League QUALIFY #69746] [Local]: Admn has lost the connection (connection closed by remote host).
[Sat Nov 12 22:04:19 2011] [GAME: BTanks League QUALIFY #69749] [Local]: Admn has lost the connection (connection closed by remote host).
[Sat Nov 12 22:43:37 2011] [GAME: BTanks League QUALIFY #69754] [Local]: Admn has lost the connection (connection closed by remote host).
[Sun Nov 13 02:36:57 2011] [GAME: BTanks League QUALIFY #69776] [Local]: 111121 has lost the connection (connection closed by remote host).
[Sun Nov 13 04:33:23 2011] [GAME: BTanks League QUALIFY #69784] [Local]: alooy has lost the connection (connection closed by remote host).
[Sun Nov 13 09:06:33 2011] [GAME: BTanks League QUALIFY #69805] [Local]: GEN_Schwarzkopf has lost the connection (connection closed by remote host).
[Sun Nov 13 17:11:49 2011] [GAME: BTanks League QUALIFY #69861] [Local]: torijin has lost the connection (connection closed by remote host).
[Sun Nov 13 20:47:12 2011] [GAME: BTanks League QUALIFY #69905] [Local]: capt.awesome has lost the connection (connection closed by remote host).
[Sun Nov 13 21:38:38 2011] [GAME: BTanks League QUALIFY #69914] [Local]: alooy has lost the connection (connection closed by remote host).
[Sun Nov 13 21:58:15 2011] [GAME: BTanks League QUALIFY #69917] [Local]: Admn has lost the connection (connection closed by remote host).
[Sun Nov 13 22:01:17 2011] [GAME: BTanks League QUALIFY #69918] [Local]: capt.awesome has lost the connection (connection closed by remote host).
[Sun Nov 13 23:32:25 2011] [GAME: BTanks League QUALIFY #69925] [Local]: Admn has lost the connection (connection closed by remote host).
[Mon Nov 14 00:14:14 2011] [GAME: BTanks League QUALIFY #69933] [Local]: Admn has lost the connection (connection closed by remote host).
[Mon Nov 14 00:29:22 2011] [GAME: BTanks League QUALIFY #69936] [Local]: Admn has lost the connection (connection closed by remote host).
[Mon Nov 14 01:26:04 2011] [GAME: BTanks League QUALIFY #69939] [Local]: Admn has lost the connection (connection closed by remote host).
[Mon Nov 14 08:03:13 2011] [GAME: BTanks League QUALIFY #69965] [Local]: mr.turtles has lost the connection (connection closed by remote host).
[Mon Nov 14 08:31:22 2011] [GAME: BTanks League QUALIFY #69965] [Local]: ChEsEbUrGeR has lost the connection (connection closed by remote host).
Out of this 31 disconnects 15 times it has been you who got disconnected. For me the log looks more like a problem on the players side (-> the remote host)...
P.S.: Why don't you use gproxy++?
closed by remote host = the error you get from the socket?
If so, there's still the kernel involved, as the bot is user level.
I also think that most of the drops are client side, but it also seems to be some other problem as well, maybe regarding timing. AFAIK the database operations on the bot are already executed in a different thread, as is every connection. Maybe you could try installing the 1000hz patch on the machine, if you haven't already? Fixed some problems for me not to long ago, which also seemed to stem from client side, while in fact it was a timing problem between client sending packages and server sending ack for those packages, and as far as I know, the bot is running via TCP not UDP, so ack timeout can be a serious problem with 250 connections already.
If you're interested in stuff like that, I recommend looking at trustleap.com , where you can find - besides a really great server - a forum where stuff like that is being discussed ( server listed there clearly shows how bad the linux kernel performs regarding tcp connection handling, and you can find some nice tcp tuning stuff in the forum threads )
Best Regards
Getting used to the Sand everywhere. At least it brings us map updates.
Posts: 187
Threads: 13
Joined: Oct 2009
Reputation:
0
I have had no disconnects so far since the rash of disconnects last weekend. I've made no changes at my end.
- Rob
Former Chieftain of Clan toaf on US EAST *Retired*
Just playing for the fun of it now.
Posts: 1,019
Threads: 24
Joined: Jun 2007
Reputation:
13
And also absolutely no changes at the bots end (and the uptime is @ 42 days).
