FUDforum: General Chit Chat

Home » General » General Chit Chat » FUD Question (

) 1 Vote

Show: Today's Messages :: Polls :: Message Navigator

Re: FUD Question [message #674 is a reply to message #657]

Fri, 22 February 2002 05:09

ironstorm

Messages: 89
Registered: February 2002
Location: Toronto, Ontario, Canada

Karma:

Member

My two cents, FUD is very well designed with repect to the storage of threads and such...

It's a very good idea to stay away from storing large blocks of text in database fields for tables with a lot of rows... Most DB servers have no choice but to dump memo/text/blob fields into a big file...

When you hit 10,000 threads there is no way that all of that data is going to fit into the DB's memory (at least until we get 64-bit processors to address more then 4GB Wink

)... so that means that the DB server must open up and find your text body within that very large file...

IMO you'll find that most OS's are much better at dealing with 10,000 small files adding up to 3GB then 1 big file adding up to 3GB, especially when you have to rewrite the file when you are "compacting" all the rows that have been deleted (typically a DB will just mark a record's memo space as delete and wait till compact is issued to rewrite the memo file cause of performace hit on rewriting large files).

There are other draw backs too, like putting all your eggs in one basket, I don't know how well you can recover a 3GB memo/blob/text file if you find you have a couple of bad sectors on your HDD (where seperate files just means you lose some threads). Grin

Report message to a moderator

[Message index]

		FUD Question By: B@rt on Thu, 21 February 2002 16:22
		Re: FUD Question By: Ilia on Thu, 21 February 2002 16:41
		Re: FUD Question By: B@rt on Thu, 21 February 2002 16:48
		Re: FUD Question By: Ilia on Thu, 21 February 2002 17:03
		Re: FUD Question By: B@rt on Thu, 21 February 2002 17:11
		Re: FUD Question By: Ilia on Thu, 21 February 2002 17:12
		Re: FUD Question By: hackie on Fri, 22 February 2002 02:27
		Re: FUD Question By: ironstorm on Fri, 22 February 2002 05:09
		Re: FUD Question By: snafu on Fri, 03 May 2002 15:46
		Re: FUD Question By: Ilia on Fri, 03 May 2002 16:03

Previous Topic:	Bug: Freshmeat screwed up
Next Topic:	Meaning of FUD

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

]

Current Time: Wed Sep 18 13:33:53 GMT 2024

Total time taken to generate the page: 0.07249 seconds