Go Back   EQEmulator Home > EQEmulator Forums > General > General::News

General::News EQemu news posts.

Closed Thread
 
Thread Tools Display Modes
  #1  
Old 03-22-2009, 11:19 AM
Doodman's Avatar
Doodman
Developer
 
Join Date: Aug 2003
Posts: 246
Default Past, Present and Future

I just wanted to post about the event over the last few weeks in regards to the stability (or lack thereof) of the site and the login server.

The site and loginserver were running pretty well over the last few months or more until a few weeks ago. Starting the the site was completely unusable and the loginserver was crashing all the time. Seems odd that after months of running well it all fell apart.

The site was being hammered by numerous bots (bad bots, ignoring robots.txt, etc) and was slaughtering the site. I spent a lot of time over the last couple of weeks watching logs, banning IPs and implementing defenses against the attacks. I finally resorted to, as I'm sure you noticed, making the forums require logging to even be viewed. This seemed to turn the tide for the site.

The loginserver was running pretty well for a long time, until someone in the community found a buffer overrun bug in the loginserver and decided to exploit the fact that they could make it crash. It wasn't a random crash. It was crashing in the same spot, from the same user, sending the same information. I hastily implemented a fix to prevent the attack, which ended up fixing the issue but introducing the "incorrect password" issue that was seen for a day or so. That is also now fixed. The login server has been up (except for a restart by me) w/o crash for day in a half. Which, sadly, considering the past few weeks is quite a bit.

During this time (mainly because of the DoS attack) it became painfully obvious that the box we signed up for 2 years about is showing its age. The machine is was undersized as far as CPU and RAM and badly need to be upgraded to newer hardware.

We've asked KLS to investigate a new server (based on donations) and to take the lead in being responsible for the server. The rationale here is several-fold.

1) I don't do anything with EQEmu except some minor maintenance on the server.
2) I'm too busy with other things to give it the attention it needs
3) Since I don't do anything with EQEmu, I'm done footing the bill personally.

I know people are frustrated with the level of service over the last few weeks (or more). Trust me, so am I. I did what I could to keep it under control when it was happening and it seems to have paid off.

I know an alternate loginserver has been offered and, frankly, I don't blame anyone who moves to that server. I think it is a bad idea to have two separate loginservers, but there is nothing I can or will do about it. You are free to make your own choices.

I won't speak for the other admins, but I'm not going anywhere. It's just the time for changing of the guards.

I'll be here if needed and will do what I can to help support the project. Even though I don't work with EQEmu anymore, my heart still belong to EQ and EQEmu. Feel free to PM me or catch me on IRC is you need anything.
  #2  
Old 03-22-2009, 05:52 PM
trevius's Avatar
trevius
Developer
 
Join Date: Aug 2006
Location: USA
Posts: 5,946
Default

Doodman? Who's that? JK!

Thanks for the update, Doodman. It does appear that some of the most recent changes you made did have a positive impact on performance. Hopefully it will be enough to keep things running smooth until the transition of ownership happens. There seems to be multiple options for solutions popping up and I am sure we should have things finalized soon enough.

With the new Login Server alternative that was introduced last night by Image and Devn00b, it brings new options for the community, which can have positive and negative affects depending on how things are handled from here. I think that once the new hosting of the current LS is in place, there will be little need for an alternative one. But, if both teams worked together, it might be possible to create code that allows servers to connect to both Login Servers at the same time and if done right, they could maybe even use the same accounts from either LS.

I think the best option would be to adjust the new Mini-Login (also provided by Image and Devn00b last night) to be usable by public servers as a backup for if/when the primary LS goes down for any reason. This too would require allowing the server code to be able to stay connected to 2 Login Servers at a time. They would stay connected to the public one when it is up and also would always remain connected to their own Private LS as a backup option. Then, players would be able to log into the server from the Public LS and once in game, they could use a new command (something like #setpassword) to set a password to be associated with their account for use from the Private LS connection. Then, the private LS would have direct access to the Server's accounts table and would authenticate via the username and password set there. This password could be stored as MD5 to reduce server admins being able to read people's account passwords easily, but it would also be recommended that they set it to something other than their public LS password for security reasons.

With the addition of the new LS option, and the move of the current LS to new ownership, that will be 2 options for Public Login Servers. IMO, It is definitely a bad idea to split the project and have 2 completely separate LS's. That would mean that accounts on the current LS would not work on the new one and visa versa. Which means people would have to chose one and stick with it. Hopefully there can be a good solution to this issue. I do think that a mirror backup of the LS would be a great idea if it was possible. That would mean that both would run on a sync'd database and the same accounts would work for either public Login Server. Though, I think there are probably some issues with setting something like that up, one of them maybe being security reasons.

Either way, I think as long as people can remain patient and we can all discuss our options openly without getting into big arguments, the new changes will be nothing but positive for the project. Once things are finalized, the Login Server will be at the bottom of our concerns list and things can go back to business as usual. Then, we can all go back to working towards a better emulator, adding new features, fixing bugs, and having a great place for this great community

BTW, Doodman, I wanted to personally thank you for paying for the hosting of the LS all of this time. Without the public LS, this project wouldn't be what it is today. Even though there have been valid reasons to make complaints about it for a while now, it was at least tolerable for a long time before that all started. I am sure that most of the feedback you ever heard was negative, but that is only because people are more likely to voice themselves when they are unhappy than when they are content. Too keep paying a bill like that month after month with little thanks is definitely something worth appreciation. So, thanks!
__________________
Trevazar/Trevius Owner of: Storm Haven
Everquest Emulator FAQ (Frequently Asked Questions) - Read It!

Last edited by trevius; 03-23-2009 at 01:55 AM..
  #3  
Old 03-22-2009, 09:24 PM
Sylaei
Hill Giant
 
Join Date: Jan 2007
Posts: 124
Default

Doodman, I just wanted to add my 2 cents to Trevius'. I thought the LS was being hosted for free, and part of the problem was being unable to complain about the service because it was free. I have read your post on the main eqemu site, and wanted to Thank you for, paying for it, and for fixing it.
__________________
Syl

"The significant problems we have cannot be solved at the same level of thinking with which we created them."
Albert Einstein
  #4  
Old 03-23-2009, 01:58 AM
Ikeren
Hill Giant
 
Join Date: Aug 2008
Location: Canada
Posts: 131
Default

Quote:
I hastily implemented a fix to prevent the attack, which ended up fixing the issue but introducing the "incorrect password" issue that was seen for a day or so. That is also now fixed. The login server has been up (except for a restart by me) w/o crash for day in a half. Which, sadly, considering the past few weeks is quite a bit.
The incorrect password issue is running right now on 3 of my accounts and the login server is down. I'm not complaining; but so you know, the problems cropped up again.
  #5  
Old 03-24-2009, 10:03 PM
KLS
Administrator
 
Join Date: Sep 2006
Posts: 1,348
Default

In case anyone's wondering why I took donations down or want any kind of update. I didn't feel the transfer was going fast enough and felt bad to continue taking people's money and be able to give them nothing to show for it right now. We got quite a bit, wont cover a whole year but it will cover most of a year I estimate.

We're busy currently trying to contact our current host and will decide if it's practical to just upgrade the server or move to a new one, so hopefully we will begin a transfer or upgrade soon.
  #6  
Old 03-24-2009, 10:15 PM
trevius's Avatar
trevius
Developer
 
Join Date: Aug 2006
Location: USA
Posts: 5,946
Default

Thanks for the update, KLS! I know this is a rough situation right now from many angles. I am sure everyone will be happy when it is all over and taken care of. Once the change of ownership happens, make sure to get those donations setup again so we can ensure that we won't have to worry about hosting again for a long time, if ever. It probably wouldn't take long before people stopped donating once the LS is stable again, so we might as well get what we can up-front. Otherwise, we would probably have to be asking for donations more often throughout the year, which is something that would be nice to be able to avoid for everyone's sake
__________________
Trevazar/Trevius Owner of: Storm Haven
Everquest Emulator FAQ (Frequently Asked Questions) - Read It!
  #7  
Old 03-24-2009, 10:16 PM
devn00b's Avatar
devn00b
Demi-God
 
Join Date: Jan 2002
Posts: 15,658
Default

Quote:
Originally Posted by KLS View Post
In case anyone's wondering why I took donations down or want any kind of update. I didn't feel the transfer was going fast enough and felt bad to continue taking people's money and be able to give them nothing to show for it right now. We got quite a bit, wont cover a whole year but it will cover most of a year I estimate.

We're busy currently trying to contact our current host and will decide if it's practical to just upgrade the server or move to a new one, so hopefully we will begin a transfer or upgrade soon.
Not sure whats the hold up of contacting the current host. I can request a server upgrade and get it within 24hours. So whats the hold up?

I can call my host say hey how much for xyz, then call the next company and ask the same. that takes what 20mins. Another day to decide at most. Shouldn't take a month to get this resolved.
__________________
(Former)Senior EQEMu Developer
GuildWars Co-Founder / World Builder.
World Builder and Co-Founder Zek [PVP/Guild Wars/City Takeovers]
Member of the "I hate devn00b" Club
Most Senior EQEMu Member.

Current Work: EverQuest 2 Emulator. Zeklabs Server
Closed Thread


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is On

Forum Jump

   

All times are GMT -4. The time now is 02:44 AM.


 

Everquest is a registered trademark of Daybreak Game Company LLC.
EQEmulator is not associated or affiliated in any way with Daybreak Game Company LLC.
Except where otherwise noted, this site is licensed under a Creative Commons License.
       
Powered by vBulletin®, Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Template by Bluepearl Design and vBulletin Templates - Ver3.3