FUDforum: FUDforum 3.0+

Home » FUDforum Development » FUDforum 3.0+ » scalability

Show: Today's Messages :: Polls :: Message Navigator

scalability [message #17125]

Wed, 17 March 2004 19:00

MathForum

Messages: 4
Registered: March 2004

Karma: 0

Junior Member

I don't see a forum for general questions, so I'll ask here.

I'm evaluating forum software for the Math Forum, and this is one of few packages that provide the features we need.

How well does FUDforum scale to our level? The Math Forum currently has about 1.3 million messages. The largest single discussion has over 500,000 messages and around 100,000 pageviews per day, in a threaded view, with heavy use of search.

Can you point me to any example site on a similar scale?

http://mathforum.org/

Report message to a moderator

Re: scalability [message #17126 is a reply to message #17125]

Wed, 17 March 2004 19:12

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

MediaMiner.org Forum ~ 1/2 million messages & 200,000 pages views per day

http://online.startribune.com/forum/

http://www.linux.com.pl/forum/

There are more on Google Smile

.

Personally, I have dealt with forums (FUDforum) that had several million messages on internal systems or systems where messages were imported from mailing lists or NNTP.

Report message to a moderator

Re: scalability [message #17127 is a reply to message #17126]

Wed, 17 March 2004 19:42

MathForum

Messages: 4
Registered: March 2004

Karma: 0

Junior Member

Thanks! Looking at the 250,000 message discussion in your first link, I thought I saw a bit of a slowdown compared to the smaller discussions, but nothing serious.

Can you say something about search scaling? On a big forum, search can be the only way to find what you're looking for.

Report message to a moderator

Re: scalability [message #17129 is a reply to message #17127]

Wed, 17 March 2004 20:13

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

On big forum you are actually likely to see speed up in searching compared to a smaller forum. It may sound 'weird' but it is true. FUDforum uses a caching algorithm to store found search results, so repeated search for the same subject matter (very common on large forums) appear instantly after the results have been found once. On small(er) forums there is a greater quantity of unique searches, so there is a much smaller benefit from caching.

Report message to a moderator

Re: scalability [message #17131 is a reply to message #17125]

Wed, 17 March 2004 20:39

MathForum

Messages: 4
Registered: March 2004

Karma: 0

Junior Member

Caching, cool. That brings up a related question: Clustering.

We don't need more than one server just for discussions. But for the totality of Math Forum services, we do, and the preferred strategy is for all application server boxes in the cluster to be identical. It's simpler for each server to provide all services.

Is there anything in FUDforum that complicates that strategy? Either caching, or storing dynamic data in the filesystem instead of the database, could make the simple strategy more complicated.

Report message to a moderator

Re: scalability [message #17132 is a reply to message #17131]

Wed, 17 March 2004 20:46

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

FUDforum stores a certain amount of disk for performance reasons. These being the file attachments and bodies of public & private messages.

Report message to a moderator

Re: scalability [message #17133 is a reply to message #17125]

Wed, 17 March 2004 20:54

MathForum

Messages: 4
Registered: March 2004

Karma: 0

Junior Member

Thanks for the info! Those files can be put in network-mounted storage and mounted across the cluster, so unless there are synchronization issues (which there may be for moderation), it's only a minor complication.

You've been very helpful, which is always a good sign. (Pause while I resist the urge to insert a cute smiley.)

Report message to a moderator

Re: scalability [message #17134 is a reply to message #17133]

Wed, 17 March 2004 21:04

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

The files can be safely put on a network mounted partition, FUDforum does not do any file system locks using SQL locks for concurrency so this is quite safe to do.

Report message to a moderator

Re: scalability [message #188308 is a reply to message #17134]

Mon, 06 March 2023 20:48

Jhonii
Messages: 1
Registered: March 2023

Karma: 0

Junior Member

Although it may sound "strange," it is true. Since FUDforum employs a caching method to save search results, repeated searches for the same topic (which are frequent on busy forums) get results right away. Because there are more unique queries on small(er) forums, caching has a significantly lower impact.

Report message to a moderator

Previous Topic:	looking for json api
Next Topic:	FUDforum's IRC chat channel

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

]

Current Time: Sat Apr 27 21:59:41 GMT 2024

Total time taken to generate the page: 0.04838 seconds