FUDforum
Fast Uncompromising Discussions. FUDforum will get your users talking.

Home » FUDforum Development » FUDforum 3.0+ » scalability
Show: Today's Messages :: Unread Messages :: Show Polls :: Message Navigator
| Subscribe to topic | Bookmark topic 
Switch to threaded view of this topic Create a new topic Submit Reply
scalability [message #17125] Wed, 17 March 2004 14:00 Go to next message
MathForum is currently offline  MathForum   United States
Messages: 4
Registered: March 2004
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
I don't see a forum for general questions, so I'll ask here.

I'm evaluating forum software for the Math Forum, and this is one of few packages that provide the features we need.

How well does FUDforum scale to our level? The Math Forum currently has about 1.3 million messages. The largest single discussion has over 500,000 messages and around 100,000 pageviews per day, in a threaded view, with heavy use of search.

Can you point me to any example site on a similar scale?

http://mathforum.org/
Re: scalability [message #17126 is a reply to message #17125] Wed, 17 March 2004 14:12 Go to previous messageGo to next message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
add to buddy list
ignore all messages by this user
MediaMiner.org Forum ~ 1/2 million messages & 200,000 pages views per day

http://online.startribune.com/forum/

http://www.linux.com.pl/forum/

There are more on Google Smile.

Personally, I have dealt with forums (FUDforum) that had several million messages on internal systems or systems where messages were imported from mailing lists or NNTP.
Re: scalability [message #17127 is a reply to message #17126] Wed, 17 March 2004 14:42 Go to previous messageGo to next message
MathForum is currently offline  MathForum   United States
Messages: 4
Registered: March 2004
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
Thanks! Looking at the 250,000 message discussion in your first link, I thought I saw a bit of a slowdown compared to the smaller discussions, but nothing serious.

Can you say something about search scaling? On a big forum, search can be the only way to find what you're looking for.
Re: scalability [message #17129 is a reply to message #17127] Wed, 17 March 2004 15:13 Go to previous messageGo to next message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
add to buddy list
ignore all messages by this user
On big forum you are actually likely to see speed up in searching compared to a smaller forum. It may sound 'weird' but it is true. FUDforum uses a caching algorithm to store found search results, so repeated search for the same subject matter (very common on large forums) appear instantly after the results have been found once. On small(er) forums there is a greater quantity of unique searches, so there is a much smaller benefit from caching.
Re: scalability [message #17131 is a reply to message #17125] Wed, 17 March 2004 15:39 Go to previous messageGo to next message
MathForum is currently offline  MathForum   United States
Messages: 4
Registered: March 2004
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
Caching, cool. That brings up a related question: Clustering.

We don't need more than one server just for discussions. But for the totality of Math Forum services, we do, and the preferred strategy is for all application server boxes in the cluster to be identical. It's simpler for each server to provide all services.

Is there anything in FUDforum that complicates that strategy? Either caching, or storing dynamic data in the filesystem instead of the database, could make the simple strategy more complicated.
Re: scalability [message #17132 is a reply to message #17131] Wed, 17 March 2004 15:46 Go to previous messageGo to next message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
add to buddy list
ignore all messages by this user
FUDforum stores a certain amount of disk for performance reasons. These being the file attachments and bodies of public & private messages.
Re: scalability [message #17133 is a reply to message #17125] Wed, 17 March 2004 15:54 Go to previous messageGo to next message
MathForum is currently offline  MathForum   United States
Messages: 4
Registered: March 2004
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
Thanks for the info! Those files can be put in network-mounted storage and mounted across the cluster, so unless there are synchronization issues (which there may be for moderation), it's only a minor complication.

You've been very helpful, which is always a good sign. (Pause while I resist the urge to insert a cute smiley.)
Re: scalability [message #17134 is a reply to message #17133] Wed, 17 March 2004 16:04 Go to previous message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
add to buddy list
ignore all messages by this user
The files can be safely put on a network mounted partition, FUDforum does not do any file system locks using SQL locks for concurrency so this is quite safe to do.
Quick Reply
Formatting Tools:   
  Switch to threaded view of this topic Create a new topic
Previous Topic: Virusi a thought.
Next Topic: Brake inn
Goto Forum:
  

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ]

Current Time: Tue Oct 17 22:04:45 EDT 2017

Total time taken to generate the page: 0.00598 seconds