Posts: 1,264
Joined: Sep 2009
Reputation:
34
Is there any chance of recovering last month's messages through an index such as google cache?
I know it's a stretch, but maybe? the forum was being indexed by google several times a day, and everything was text based. . .
Posts: 1,104
Joined: Oct 2007
Reputation:
2
theuni
Team-XBMC Communication Manager
Posts: 1,104
You can't just cram text into the db. There may be extreme ways of salvaging posts from google cache, but nothing I'm willing to do. Sorry guys, 2 sleepless nights is enough for me.
The info will be back in no time anyway...
TheUni
Posts: 33
Joined: Mar 2010
Reputation:
0
sebak
Junior Member
Posts: 33
2010-03-17, 23:10
(This post was last modified: 2010-03-17, 23:12 by sebak.)
It's not that easy as just scraping off googles cache.
First you should make a script that does just that, but then there are still a lot of problems.
You can't just put the data in the database right away. If you post a reply or thread, a lot of things change (post count, cache, ...) and to maintain integrity of the system, you need to use the API.
However, for example posts posted by users that are now also gone (users registererd within the last month) will give problems, because guests are not allowed to post. And there might be a lot of these kind of problems.
Edit: theuni was faster
Posts: 696
Joined: Aug 2004
Reputation:
27
I would say not much can realistically be done now about lost data, but I am willing to help if xbmc want to set up offsite database replication. It is a good way of not only handling backups (backing up from slave database rather than primary, and having no "delay" whilst non innodb tables are locked, and also having a copy which is always at most a few seconds/minutes behind the main database.
Posts: 5,292
Joined: Jun 2006
Reputation:
62
Jezz_X
Team-XBMC Skinner
Posts: 5,292
I just think everyone should be grateful we didn't go with option 1 which was start the forum from scratch and decided to go with option 2 (use the backup before the site move)
Posts: 165
Joined: May 2007
Reputation:
0
mr.b
Senior Member
Posts: 165
I appreciate sleepless nights as well (I've been there). Also, i wasn't advocating reimporting into the database, rather, an html capture and attachment to a new thread.
Posts: 63
Joined: Dec 2009
Reputation:
0
I don't think that is that useful. If you find some important post of you is missing, you can grab the cache info and repost.
That will do and will not put into trouble the administrators.
Posts: 46
Joined: Apr 2009
Reputation:
0
Hi,
I administrate a similarly sized forum (less visitors but over half a million posts) and I run full backup every day and keep a few days worth of binary log (hourly rotated to avoid corruption). Very simple to setup and very effective, the daily snapshot takes a couple of minutes and nobody notices anything (the forum continues to work as is without any issues, the database guarantees data integrity for the exact moment where the dump has started)
With these backups and almost a week's worth of binary logs I can rollback to any point in time in the past week and can easily recover after a major crash.
Additionally - daily dumps are compressed and copied to an off site storage server so even if my server burns and turns to dust, in my worst case scenario I have lost a day's worth of data (I don't replicate the binary logs).
If you need help setting up a similar mechanism - just drop me a note.
Posts: 4,058
Joined: Oct 2007
Reputation:
89
zag
Team-Kodi Member
Posts: 4,058
2010-03-29, 12:25
(This post was last modified: 2010-03-29, 12:29 by zag.)
I would be very interested in how to backup mysql regularly. I have read about scripting mysqldump but not really implemented it outside a test site.
I administer a popular forum and backup once every 2 weeks manually at the moment using phpmyadmin.
I've also seen phpmybackup, but not used it myself yet.