| Forum Benchmark [message #356] |
Thu, 07 February 2002 22:25  |
Ilia
Messages: 13241
Registered: January 2002
Karma:
|
Senior Member
Administrator
Core Developer |
|
|
The purpose of this benchmark is to examine the various features offered by various forums and compare how all these forums perform under similar loads. Hopefully, this will give you an idea of the benefits of each forum software, so that you may choose the one which suits your needs the best, whether it be speed, features or something in between.
The idea originally came from the benchmarks done by Aurora developers and published at http://ikonboard.com/aurora/brochure/bench.html
unfortunately, those benchmarks tell virtually nothing about the forums tested and what kinds of data sets were present in each forum and were they equal.
ie. 100 posts in Aurora & 1000 posts in VBulletin.
We intend to examine most of the commonly used forum packages available today. All of the benchmarks will be performed on the same system and as similar conditions as possible. The conditions cannot be absolutely identical because various forums offer different features on their pages, which may not be available on other forums.
There will be 3 common sets of data: small, medium & large these will be generated. This data will be arranged in an easy to read/parse format to allow anyone to easily import it in to a forum of their choice & try this benchmark for themselves.
The benchmarking tool that we will use is called "httperf", which is written by David Mosberger and Tai Jin of Hewlett-Packard Research Labs and released under the GPL. This tool can be obtained from: http://www.hpl.hp.com/personal/David_Mosberger/httperf.html
Here is the list of intended benchmarks that would be run on the forums:
* Every one of those benchmarks will be run in 3 separate conditions based on the user
- New User coming to a page ( no session or cookie )
- Anonymous user ( a user who has visited the forum before, but is not registered )
- Registered user who is logged in
- Forum's index page generation
- Small Forum ( 3 categories & 3 forums per category )
- Medium Forum ( 6 categories & 5 forums per category )
- Large Forum ( 10 categories & 10 forums per category )
- Forum thread list ( 40 threads per page )
- Small Forum ( 100 threads in a forum )
- Medium Forum ( 1000 thread in a forum )
- Large Forum ( 20000 threads in a forum )
- Message display (flat view)
- Small Forum ( 10 messages in a thread )
- Medium Forum ( 100 messages in a thread )
- Large Forum ( 500 messages in a thread )
- Message display (threaded view)
- Small Forum ( 10 messages in a thread )
- Medium Forum ( 100 messages in a thread )
- Large Forum ( 500 messages in a thread )
- Search Engine Messages (if available)
* A test will be done searching 1st in just the subjects and the in the entire message
- Small Forum ( 9000 messages )
- Medium Forum ( 300000 messages )
- Large Forum ( 1000000 messages )
- Search Engine Users (if available)
* One search benchmark will go through login names & second will go through email address'
- Small Forum ( 100 users )
- Medium Forum ( 1000 users )
- Large Forum ( 10000 users )
In addition to the benchmark there would be a complete list of information that the forum provides for each page, such as login indicators, icons, user options, etc...
We are currently looking for suggestion for other benchmarks & comparisons that can be run between the various forum packages.
If you have such suggestions, please let us know by replying to this message or sending an email to forum(at)prohost(dot)org.
FUDforum Core Developer
|
|
|
|
Calendar
Search
Help
Members
Register
Login
Home
]