| nntp import of large groups creates troubles [message #20202] |
Fri, 01 October 2004 22:29  |
devnull
Messages: 16
Registered: September 2004
Karma:
|
Junior Member |
|
|
After making a custom theme and installing FudForum on a new server, I configured the newsgroups I wanted to import.
Some groups are pretty big (over 5000 posts) what causes the nntp.php script to fail. I'm not sure if it's a timeout or if it just crashes.
The problem is that after I restart it, it imports old news again; I end up with hundreds of duplicate entries. For now, I quit the import until I find a solution. Accoring to a previous post here, crashed newsgroup imports will leave a .lock in errors/.nntp. For almost every bigger group, I have one in there.
Here my two ideas (it's 00:30am, so there might be more  ):
1) Could the nntp.php script easily be changed to stop after eg 1000 posts? When running from cron, the board would fill slowly over several updates.
2) Is the number in the newsfiles in errors/.nntp the topic ID? It would involve more work, but no sourcechanges would be needed. Run nntp.php for one group until it stops and fix the file in .nntp manually, then re-run.
I do hope #1 is possible tho 
|
|
|
|
Calendar
Search
Help
Members
Register
Login
Home
]