Very Hot Topic (More than 25 Replies) What happened to the site? (Read 25392 times)
Fernando Semprun
Senior Member
****
Offline


Be nice to others. Life
is to be enjoyed!

Posts: 402
Location: Madrid
Joined: 04/29/03
Gender: Male
Re: What happened to the site?
Reply #26 - 01/10/08 at 21:55:23
Post Tools
My advice to the bunch of complainers:

Set up a business (that is put your own money at risk), work hard, pray that people buy the services you are offering, charge little, get low return AND then, once you've been in other people's shoes, carry on with your complaining.

My bet is you would understand...


Having said that, I do not like when I believe sections are not really delivering or are rather cheeky. But it is obvious for the number of people who STAY in this site that it is not so well paid as to be worth the effort...
  

Fernando Semprun
Back to top
 
IP Logged
 
GMTonyKosten
YaBB Administrator
*****
Offline


Mr Dynamic?

Posts: 3192
Location: Clermont-Ferrand
Joined: 12/19/02
Gender: Male
Re: What happened to the site?
Reply #25 - 12/10/07 at 21:37:31
Post Tools
Off-Topic replies have been moved to this Topic.
  
Back to top
IP Logged
 
Dragan Glas
Senior Member
****
Offline


"If I, like Solomon, ...
could have my wish -
"

Posts: 424
Location: Ireland
Joined: 06/25/06
Gender: Male
Re: What happened to the site?
Reply #24 - 11/17/07 at 06:50:12
Post Tools
Greetings,

GMTonyKosten wrote on 10/29/07 at 22:05:56:
Markovich wrote on 10/29/07 at 18:27:50:
Yes, I'd be very interested to know if this was a Unix/Linux/BSD machine or a Windows one. In fairness though, I think there are external things you can do to bring a not-too-well-defended Unix server down.

The real issue is security on the server.  I wonder what vulnerability was exploited, and why the system was vulnerable in the first place.


It is a Unix with Apache, and the IT guys suspected some vulnerability in the Forum software. I went to the YaBB Forum to ask if this was possible and they denied there were any holes, or at least no more than you would expect from free software! Wink

Anyway, this is why the Forum has moved to another site. If it gets hacked again it won't bring down the main site! Roll Eyes

Bearing in mind the above and the earlier posts by Alien chess and others...

On a UNIX system, hackers gain access to the "root" (equivalent to the Windows "admin" level user) - hence the term, "rootkit" - through compromised passwords or by exploiting a known vulnerability in a service running on the system. Once they have root access, they can do pretty much anything they want - they can come and go as they choose by use of a installed "backdoor"; the rootkit is installed as a means of hiding such activity.

Once the system has been compromised, removing a rootkit from UNIX is nigh impossible - a format/reinstall is necessary.

One must, therefore, have a good security policy in place to prevent, in the first instance, and recover from such compromising of the system.

The UNIX system must be locked-down as much as possible - only run the needed services/scripts, the fewer such running on a system, the less opportunity is afforded the hacker. Lock down user accounts - no shell access unless required.

Compile services from source (including Apache) oneself.

It is critical to have a update notification service - for any/all available updates - and ensure that these are installed.

Run rootkit scanners daily - Tripwire ("payware") or AIDE (free equivalent of Tripwire - NOT a free version of Tripwire!), chrootkit and/or RKHunter - and send the output to people who'll act upon the reports.

Install and run network monitoring software on the whole network - nmap and/or SNORT. Again, send the output to those who'll act upon it. [They'll show up backdoors for a start.]

Ensure that you have a hardware firewall as well as IPTables (for filtering packets based on rules).

Take separate daily backups of the operating system, applications and data. That way, you'll only "lose" one day's data, at worst.

The above is just a quick rules-of-thumb guide for your "IT guy" - it isn't definitive!

Speaking of updates...

I note you're currently running 2.1 - I don't know what version you were running beforehand, most likely this version from what I've seen on the site.

However, they've just released (8 Nov) a newer version - YaBB 2.2 - which includes several security and anti-spam enhancements.

NOTE: If your site includes lots of 2.1 "mods", these won't work under 2.2 (from what I've read there). They also recommend backing up the whole forum - several times for safety reasons - before installing the new version in it's own separate directory.

See also http://www.yabbforum.com/community/?board=general;action=display;num=1194579334.

Kindest regards,

Dragan Glas
  
Back to top
 
IP Logged
 
Willempie
God Member
*****
Offline


I love ChessPublishing
.com!

Posts: 4312
Location: Holland
Joined: 01/07/05
Re: What happened to the site?
Reply #23 - 10/30/07 at 07:43:49
Post Tools
Yer doubters of the Great Bill Gates Grin
  

If nothing else works, a total pig-headed unwillingness to look facts in the face will see us through.
Back to top
 
IP Logged
 
GMTonyKosten
YaBB Administrator
*****
Offline


Mr Dynamic?

Posts: 3192
Location: Clermont-Ferrand
Joined: 12/19/02
Gender: Male
Re: What happened to the site?
Reply #22 - 10/29/07 at 22:05:56
Post Tools
Markovich wrote on 10/29/07 at 18:27:50:
Yes, I'd be very interested to know if this was a Unix/Linux/BSD machine or a Windows one. In fairness though, I think there are external things you can do to bring a not-too-well-defended Unix server down.

The real issue is security on the server.  I wonder what vulnerability was exploited, and why the system was vulnerable in the first place.


It is a Unix with Apache, and the IT guys suspected some vulnerability in the Forum software. I went to the YaBB Forum to ask if this was possible and they denied there were any holes, or at least no more than you would expect from free software! Wink

Anyway, this is why the Forum has moved to another site. If it gets hacked again it won't bring down the main site! Roll Eyes
  
Back to top
IP Logged
 
Markovich
God Member
*****
Offline



Posts: 6099
Location: Columbus, Ohio
Joined: 09/17/04
Re: What happened to the site?
Reply #21 - 10/29/07 at 18:27:50
Post Tools
thibdb13 wrote on 10/27/07 at 18:04:04:
You should perhaps ask your IT guy to change his server's operating system.
Those problems happen quite often with servers using an OS coming from Redmond.
A rescue plan should also exist and communication should bettered in the future  for in case the server would shut down again.
But to be honnest my happiness now the forum is back is bigger than my disappointment when ot was down. Wink 


Yes, I'd be very interested to know if this was a Unix/Linux/BSD machine or a Windows one. In fairness though, I think there are external things you can do to bring a not-too-well-defended Unix server down.

The real issue is security on the server.  I wonder what vulnerability was exploited, and why the system was vulnerable in the first place.
  

The Great Oz has spoken!
Back to top
 
IP Logged
 
GMTonyKosten
YaBB Administrator
*****
Offline


Mr Dynamic?

Posts: 3192
Location: Clermont-Ferrand
Joined: 12/19/02
Gender: Male
Re: What happened to the site?
Reply #20 - 10/29/07 at 14:40:29
Post Tools
Yes, Willempie is quite right, we have no credit card details on the server at all as the payment is carried out on the WorldPay site, which is a part of the NatWest/Royal Bank of Scotland group, I believe.
I reckon we will lose many thousands of dollars because of this so I will definitely ask the techies if they can work out who might be responsable, but I am not holding out too much hope!
  
Back to top
IP Logged
 
Willempie
God Member
*****
Offline


I love ChessPublishing
.com!

Posts: 4312
Location: Holland
Joined: 01/07/05
Re: What happened to the site?
Reply #19 - 10/29/07 at 08:38:36
Post Tools
lnn2 wrote on 10/29/07 at 02:18:07:
Yes I am also wondering about the safety of my credit card information at chesspub.
But I seem to remember that when I subscribed months ago, payment was done at another site, so hopefully its safe.  Undecided

Payments are not done via the site itself, but via a "creditcard-site", so the creditcard info is nowhere on chesspub.
They can be hacked as well though, but at least your credit card is insured against bogus withdrawals. Though atm the favoured method is to use generated credit card numbers iso hacking into a site.

I concur with TopNotch though that filing a report at the police may be an idea. If nothing else, you can make them work a little for you taxes.
  

If nothing else works, a total pig-headed unwillingness to look facts in the face will see us through.
Back to top
 
IP Logged
 
lnn2
God Member
*****
Offline



Posts: 1504
Location: nc
Joined: 09/22/04
Re: What happened to the site?
Reply #18 - 10/29/07 at 02:18:07
Post Tools
Yes I am also wondering about the safety of my credit card information at chesspub.
But I seem to remember that when I subscribed months ago, payment was done at another site, so hopefully its safe.  Undecided
  
Back to top
 
IP Logged
 
TopNotch
God Member
*****
Offline


I only look 1 move ahead,
but its always the best

Posts: 2211
Joined: 01/04/03
Gender: Male
Re: What happened to the site?
Reply #17 - 10/29/07 at 00:17:02
Post Tools
I really appreciate all the candid questions and forthcoming answers presented here, which is just another advantage of having a well run and participated in forum.

What strikes me most is the expertise and lengths that someone went to in order to hack this site, and it leads me to wonder what the real agenda was, that is, was it about accessing Chess theory for free or more likely an attempt to attain Credit Card and other personal information of subscribers. Should the latter be the case is a quite worrying prospect. Not being a techy myself this may sound like a silly question, but is there some way to try and track down the culprit via perhaps an ip address or some such process and then take it from there.

Toppy Smiley

  

The man who tries to do something and fails is infinitely better than he who tries to do nothing and succeeds - Lloyd Jones Smiley
Back to top
 
IP Logged
 
GMTonyKosten
YaBB Administrator
*****
Offline


Mr Dynamic?

Posts: 3192
Location: Clermont-Ferrand
Joined: 12/19/02
Gender: Male
Re: What happened to the site?
Reply #16 - 10/28/07 at 22:32:21
Post Tools
I suppose one good thing about now having the forum in a completely different place is that if the site does get hacked again then at least we can discuss the problems here!
  
Back to top
IP Logged
 
thibdb13
God Member
*****
Offline


Tal was the best

Posts: 974
Location: Mechelen
Joined: 01/25/07
Gender: Male
Re: What happened to the site?
Reply #15 - 10/28/07 at 19:35:25
Post Tools
GMTonyKosten wrote on 10/28/07 at 19:24:04:

Regarding informing members, I have now got hold of the current list of members and will definitely email them all should anything similar happen again.

That's a good measure and a very good news.  Wink
  

Yusupov once said that “The problem with the Dutch Defence is that later in many positions the best move would be ...f5-f7” but he is surely wrong.
Back to top
 
IP Logged
 
GMTonyKosten
YaBB Administrator
*****
Offline


Mr Dynamic?

Posts: 3192
Location: Clermont-Ferrand
Joined: 12/19/02
Gender: Male
Re: What happened to the site?
Reply #14 - 10/28/07 at 19:24:04
Post Tools
OK, Alien, according to the IT guys someone managed to get control of the server and install a rootkit, which are invisible as you are no doubt aware. All the recent backups were possibly compromised as absolutely anything could have got on them (a bit like foot and mouth disease for cows - once one cow has it they slaughter the whole herd). 
Even if they had a safe backup they told me it would be too risky to use, as the security hole that was originally used would still be there, and the hacker would get on again.
Now, this is what they told me, but I have no way of verifying this as I am not a Systems administrator. If you can explain to me how they could have used an older backup (and please be as technical as you like) then I will forward this to them and post their reply here.

Regarding informing members, I have now got hold of the current list of members and will definitely email them all should anything similar happen again. I am just a chess player and we rely entirely on experts to keep the site running, I thought we had a 'foolproof' backup system in place so that nothing like this could ever happen (I am aware that hard discs die occasionally but made sure this wouldn't effect the site too much).
  
Back to top
IP Logged
 
Alien chess
YaBB Newbies
*
Offline


I Love ChessPublishing!

Posts: 25
Location: Scotland
Joined: 02/26/07
Gender: Male
Re: What happened to the site?
Reply #13 - 10/28/07 at 14:12:54
Post Tools
GMTonyKosten wrote on 10/28/07 at 11:17:55:
Quote:
Not if you make backups daily, weekly and monthly to magnetic tape or a hard drive that isn't connected to a network at all.


Do you know what you are talking about?


Yes I do.

GMTonyKosten wrote on 10/28/07 at 11:17:55:
Quote:
A site with paying members being down for a week with nobody being told anything is wrong


Anyone who contacted us (and there were several hundred) would have received the latest info on the situation ASAP.


Why should they have to contact you? Your job to contact them. Your the people being payed.
  

Chess articles, forum, annotated games, book reviews and more at Chess Chit Chat.com&&FEN to diagram tool
Back to top
WWW  
IP Logged
 
Bibs
God Member
*****
Offline



Posts: 2342
Joined: 10/24/06
Re: What happened to the site?
Reply #12 - 10/28/07 at 13:00:55
Post Tools
Regarding the last post, I for one didnt know who to contact. Everything down, dont think have anyone's personal emails. Bit of a poor show. But back up, not to worry too much. Perhaps just British fatalism. Oh, raining again.

Looks like better IT bods required. Seems a few posting here - any of them want to take over?

That said, nothing to get too het up about from my point of view. Just a chess web site (with all due repect to those who toil there). Not life or death or anything - a way to idle away time and get a couple of ideas on how to win the odd game. 

Imagine  a number of people's bosses, colleagues, wives and kids were pleasantly surprised last week by the upturn of non-screen-chess interest. Perhaps MnB and SF even found time to go to the park.

Best of luck remaining secure henceforth. Look forward to this month's posts.

Bibs
  
Back to top
 
IP Logged
 
GMTonyKosten
YaBB Administrator
*****
Offline


Mr Dynamic?

Posts: 3192
Location: Clermont-Ferrand
Joined: 12/19/02
Gender: Male
Re: What happened to the site?
Reply #11 - 10/28/07 at 11:17:55
Post Tools
Quote:
Not if you make backups daily, weekly and monthly to magnetic tape or a hard drive that isn't connected to a network at all.


Do you know what you are talking about?

Quote:
A site with paying members being down for a week with nobody being told anything is wrong


Anyone who contacted us (and there were several hundred) would have received the latest info on the situation ASAP.
  
Back to top
IP Logged
 
Alien chess
YaBB Newbies
*
Offline


I Love ChessPublishing!

Posts: 25
Location: Scotland
Joined: 02/26/07
Gender: Male
Re: What happened to the site?
Reply #10 - 10/27/07 at 22:58:00
Post Tools
GMTonyKosten wrote on 10/27/07 at 22:28:50:
Firstly, regarding backups, when the ChessPub.exe server failed I had the hard drive replaced and a sophisticated backup system put in place, with my own servers plus another outside one. I also had a lot of the code updated with the latest patches (incidentally we use Unix servers). I thought I was safe!
It turns out the backups are useless for the simple reason that the invisible Trojan horse, or whatever it was, could have infested the backups too!


Not if you make backups daily, weekly and monthly to magnetic tape or a hard drive that isn't connected to a network at all.

A site with paying members being down for a week with nobody being told anything is wrong (and payers can take sites to court for not delivering goods I guess). At least give members some bonus content in return...
  

Chess articles, forum, annotated games, book reviews and more at Chess Chit Chat.com&&FEN to diagram tool
Back to top
WWW  
IP Logged
 
GMTonyKosten
YaBB Administrator
*****
Offline


Mr Dynamic?

Posts: 3192
Location: Clermont-Ferrand
Joined: 12/19/02
Gender: Male
Re: What happened to the site?
Reply #9 - 10/27/07 at 22:28:50
Post Tools
Firstly, regarding backups, when the ChessPub.exe server failed I had the hard drive replaced and a sophisticated backup system put in place, with my own servers plus another outside one. I also had a lot of the code updated with the latest patches (incidentally we use Unix servers). I thought I was safe!
It turns out the backups are useless for the simple reason that the invisible Trojan horse, or whatever it was, could have infested the backups too! I know, it sounds crazy, I never knew such problems existed (well, yes I heard that the Chinese had been hacking into the Pentagon, but who would be interested in chess theory?)
I personally answered all the emails we received, either here or at improveyourchess.com, and gave the latest information from the sys admin guy (which regularly turned out to to be rather optimistic!) If anyone didn't get an answer that was either because their email didn't get through, or ours was stopped.
It never occurred to me to put a notice on the IYC site, as I couldn't imagine anyone looking there, without first emailing chesspublishing...
I have always been very careful to keep backups of the games database, but from now on I will also backup the list of subscribers... Smiley
I would like to thank all those who wrote words of support during the ordeal, about how to deal with the IT guys, and I particularly appreciated the advice to get myself a good hard drink!
  
Back to top
IP Logged
 
Alien chess
YaBB Newbies
*
Offline


I Love ChessPublishing!

Posts: 25
Location: Scotland
Joined: 02/26/07
Gender: Male
Re: What happened to the site?
Reply #8 - 10/27/07 at 20:53:32
Post Tools
Jings dont you guys know what a backup is? Its not hard to unpulg a server, put in the new one, transfer backup from magnetic tape to new server, and your site is fine. Sorry but whoever you have as your techies really need sacked.

And these attacks are not common on well and properly configured websites/servers.
  

Chess articles, forum, annotated games, book reviews and more at Chess Chit Chat.com&&FEN to diagram tool
Back to top
WWW  
IP Logged
 
Antillian
God Member
*****
Offline


Brilliance without dazzle!

Posts: 1757
Joined: 01/05/03
Gender: Male
Re: What happened to the site?
Reply #7 - 10/27/07 at 19:57:28
Post Tools
Like TopNotch, I also searched around the internet hoping to find some clue of what was going on and I also emailed the admin guys at ImproveYourChess.com. However i got ZERO response. I would hate to jump to the conclusion that non titled paying subscribers are treated differently
  

"Breakthrough results come about by a series of good decisions, diligently executed and accumulated one on top of another." Jim Collins --- Good to Great
Back to top
 
IP Logged
 
thibdb13
God Member
*****
Offline


Tal was the best

Posts: 974
Location: Mechelen
Joined: 01/25/07
Gender: Male
Re: What happened to the site?
Reply #6 - 10/27/07 at 18:04:04
Post Tools
You should perhaps ask your IT guy to change his server's operating system.
Those problems happen quite often with servers using an OS coming from Redmond.
A rescue plan should also exist and communication should bettered in the future  for in case the server would shut down again.
But to be honnest my happiness now the forum is back is bigger than my disappointment when ot was down. Wink
  

Yusupov once said that “The problem with the Dutch Defence is that later in many positions the best move would be ...f5-f7” but he is surely wrong.
Back to top
 
IP Logged
 
Willempie
God Member
*****
Offline


I love ChessPublishing
.com!

Posts: 4312
Location: Holland
Joined: 01/07/05
Re: What happened to the site?
Reply #5 - 10/27/07 at 13:23:50
Post Tools
GMTonyKosten wrote on 10/26/07 at 21:03:56:
Some 'script kiddie' hacked onto the server, apparently, and it had to be removed from the network to protect other people (and ourselves, from possible criminal pursuit Shocked) According to the system admin guy the server had to be completely rebuilt, and our backup servers were useless as the invisible 'rootkit' would have got onto them as well. Obviously I wanted the site back online as quickly as possible but apparently this whole business is really time-consuming, as then they had to try and fix any potential security holes - if they didn't there is the obvious risk that the idiot who did the original damage would renew his 'exploit'.
A further problem was that the sys admin guy kept assuring me that it would be ready before end of business each day, before discovering further problems with some of the older code. There are still some problems, but at least the site is back online.
The site was totally offline so there was no page on which to explain anything, and I had no access to the subscriber database so I couldn't send out any explanatory email.
I have been assured that this sort of attack is actually more common than you might think and has brought much bigger businesses than ours to their knees (including one well publicised security company!)
Naturally we are completely powerless as we just try to get good chess content out and rely totally on the experts for the actual running of the servers.

Glad it is back up Smiley

Yes these attacks are indeed quite more common than advertised (I wonder why Wink) and they are hard to defend against.

One thing to ask the IT guys is if they can make a weekly text dump (ie a semicolon seperated text file) of the members of both the forum and chesspub with their email. So that you can put that dump on a local pc (unattached to chesspub) so that you will always have a list of emails to keep users informed if there is something similar (or just an upgrade which needs to put the server offline for a couple of hours). May also be an idea for your pgn-files (I suspect you already do, but it will never hurt).
  

If nothing else works, a total pig-headed unwillingness to look facts in the face will see us through.
Back to top
 
IP Logged
 
lnn2
God Member
*****
Offline



Posts: 1504
Location: nc
Joined: 09/22/04
Re: What happened to the site?
Reply #4 - 10/27/07 at 05:11:28
Post Tools
i emailed the chesspub admin and got a reply saying the server was hacked and they were trying to restore it. That satisfied me somewhat, but i think in future the chesspub admin should take the initiative to send an email to all subscribers informing them of what happened.
(tony please keep the email addresses of all subscribers somewhere safe!!)
  
Back to top
 
IP Logged
 
TopNotch
God Member
*****
Offline


I only look 1 move ahead,
but its always the best

Posts: 2211
Joined: 01/04/03
Gender: Male
Re: What happened to the site?
Reply #3 - 10/27/07 at 04:38:49
Post Tools
It's a relief to have the site up and running again, but I have to side with Dink on this one.
I googled the web to try and find out what was going on using all kinds of key words, and remarkably got absolutely no useful information.

In a further effort to find out what was going on, I eventually on a whim sent an email to the admins on improveyourchess.com, which more or less comprises the same staff as chesspublishing.com. Thankfully they responded promptly and put my mind at ease.

I wonder if Dink and I are the only subscribers concerned by the circumstances surrounding this latest attack, curiously looking around the forum everyone seems hunkydory and satisfied without criticism just to have the site back online. While in the interim on other chess forums such as Pete Tamburo's Chess For Amateurs for instance, a thread was started by someone as anxious as I to know what was going on.  

Hopefully when and if the next attack strikes, heaven forbid, a notice advising subscribers of the situation could be posted on an alternative website, say improveyourchess.com for instance, that way a simple google search could put an end to any wild speculation and place my and perhaps other subscribers minds at ease.

Unlike Dink though, I think I will renew my subscription as my tolerance level is fairly high and so far for me the pros far outweigh the cons. However, there are lessons to be learnt from this latest unfortuante attack, and should such an unavoidable crash occur again I would hope it's handled much more efficiently from a PR and Customer service point of view.

Regards,

Toppy Smiley
  

The man who tries to do something and fails is infinitely better than he who tries to do nothing and succeeds - Lloyd Jones Smiley
Back to top
 
IP Logged
 
Dink Heckler
God Member
*****
Offline


Love-Forty

Posts: 900
Joined: 02/01/07
Gender: Male
Re: What happened to the site?
Reply #2 - 10/26/07 at 22:50:35
Post Tools
Point taken, but it sounds like you need some new IT guys.
  

'Am I any good at tactics?'
'Computer says No!'
Back to top
 
IP Logged
 
GMTonyKosten
YaBB Administrator
*****
Offline


Mr Dynamic?

Posts: 3192
Location: Clermont-Ferrand
Joined: 12/19/02
Gender: Male
Re: What happened to the site?
Reply #1 - 10/26/07 at 21:03:56
Post Tools
Some 'script kiddie' hacked onto the server, apparently, and it had to be removed from the network to protect other people (and ourselves, from possible criminal pursuit Shocked) According to the system admin guy the server had to be completely rebuilt, and our backup servers were useless as the invisible 'rootkit' would have got onto them as well. Obviously I wanted the site back online as quickly as possible but apparently this whole business is really time-consuming, as then they had to try and fix any potential security holes - if they didn't there is the obvious risk that the idiot who did the original damage would renew his 'exploit'.
A further problem was that the sys admin guy kept assuring me that it would be ready before end of business each day, before discovering further problems with some of the older code. There are still some problems, but at least the site is back online.
The site was totally offline so there was no page on which to explain anything, and I had no access to the subscriber database so I couldn't send out any explanatory email.
I have been assured that this sort of attack is actually more common than you might think and has brought much bigger businesses than ours to their knees (including one well publicised security company!)
Naturally we are completely powerless as we just try to get good chess content out and rely totally on the experts for the actual running of the servers.
  
Back to top
IP Logged
 
Dink Heckler
God Member
*****
Offline


Love-Forty

Posts: 900
Joined: 02/01/07
Gender: Male
What happened to the site?
10/26/07 at 15:34:03
Post Tools
Something's not right here. A web-based business simply disappears for over a week, without so much as a 'site under construction - come back later'. That's absolutely shambolic, and subscribers deserve a lot better.

I've never seen a commercial site suffering such an outage. And when the thing gets back up, nary an explanation. If thats the way customers are being treated, I decline to renew.
  

'Am I any good at tactics?'
'Computer says No!'
Back to top
 
IP Logged
 
Bookmarks: del.icio.us Digg Facebook Google Google+ Linked in reddit StumbleUpon Twitter Yahoo