FUDforum
Fast Uncompromising Discussions. FUDforum will get your users talking.

Home » FUDforum » FUDforum Suggestions » Storing Forum Messages....
Show: Today's Messages :: Polls :: Message Navigator
Switch to threaded view of this topic Create a new topic Submit Reply
Storing Forum Messages.... [message #9273] Wed, 19 March 2003 20:01 Go to next message
forrie is currently offline  forrie   United States
Messages: 47
Registered: August 2002
Location: Derry, NH
Karma: 0
Member
I ran into a problem where my MySQL data got corrupted (removed!) and was left with a msg_1 file.

Upon looking at this file, it was clear that no identifying information (ie: some type of headers) was present and I was otherwise going to have to figure it out manually or ask people to repost their messages (the latter being more realistic).

This is a point of failure/weakness in the forum design. I have seen suggestions about putting the posts in the actual database, some disagree. Perhaps it can be enabled to do this, and the admin can "choose" to have articles on-disk instead... if the articles are stored in raw text format on the disk, then at the very least I would suggest some form of posting information that could identify the post/forum/user,etc.

In my case, if that data were present, I might possibly been able to use a recover script or something to re-import the data into the forums, walla.

Something to consider for disaster recovery, which would be very useful to have available.

I would be for putting the forum posts into the database - it could allow for a more powerful search, and a way to organize the data. Problem being: what to do with attachments? Put them IN the database as blobs or correlate a URL or PATH to where it's stored on disk (problems with both I can see).



_F

Re: Storing Forum Messages.... [message #9331 is a reply to message #9273] Mon, 24 March 2003 15:42 Go to previous messageGo to next message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
Had the data been in MySQL you wouldn't have even raised this question since it would have been lost as well. The storage mechanism is chosen for a number of reasons and I see no reason to alter it's operation.

FUDforum Core Developer
Re: Storing Forum Messages.... [message #9335 is a reply to message #9331] Mon, 24 March 2003 16:14 Go to previous messageGo to next message
Anonymous   United States
I understand your viewpoint; I think the most important thing for me here would have been some identifying information in the on-disk forum postings that one might have used a script to recreate the posts from. So you could have data in the mysql database and out of it.

If I had replication going on with Mysql, I would have had the mysql data available on another database (possibly in another location on the net). This certainly is a handy feature that cannot presently be implemented with the forum.

Some type of disaster recovery process would eventually be handy :-)

Re: Storing Forum Messages.... [message #9336 is a reply to message #9335] Mon, 24 March 2003 16:14 Go to previous messageGo to next message
forrie is currently offline  forrie   United States
Messages: 47
Registered: August 2002
Location: Derry, NH
Karma: 0
Member
Oops, I didn't log in - that last reply was from me. Sorry.
Re: Storing Forum Messages.... [message #9342 is a reply to message #9335] Mon, 24 March 2003 17:25 Go to previous message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
Disaster recovery is best accomplished via frequent (daily) backups using the forum datadump tool, which can be used via a crontab.
As far as data retrieval, I doubt replication would make it any faster since, network IO + MySQL overhead will exceed any benefits gained by you from replication in this case since data is fetched RAW and immidiately used as is. Replication will mostly help you when queries are CPU intensive and you can multiply performance by using multiple servers. Keep in mind that replication process also makes data insertion slow, since it needs to be duplicated across multiple servers.
For performance reasons the data is stored as is and internal offsets in MySQL are used to retrieve it, going via some manual mechanism would be infinately slower.


FUDforum Core Developer
  Switch to threaded view of this topic Create a new topic Submit Reply
Previous Topic: New statistic request
Next Topic: Mailing List
Goto Forum:
  

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ]

Current Time: Wed Nov 27 13:04:25 GMT 2024

Total time taken to generate the page: 0.22294 seconds