FUDforum
Fast Uncompromising Discussions. FUDforum will get your users talking.

Home » FUDforum Development » Bug Reports » Can't rebuild, compact or do datadump, and NNTP sync fails
Show: Today's Messages :: Unread Messages :: Show Polls :: Message Navigator
| Subscribe to topic | Bookmark topic 
Switch to threaded view of this topic Create a new topic Submit Reply
Can't rebuild, compact or do datadump, and NNTP sync fails [message #159065] Fri, 01 May 2009 20:49 Go to next message
kerryg is currently offline  kerryg   Canada
Messages: 157
Registered: September 2008
Karma: 0
Senior Member
add to buddy list
ignore all messages by this user
Attempting to compact gives this error:

Quote:
Please wait while forum is being compacted.
This may take a while depending on the size of your forum.
Compacting normal messages...
An error was generated in file /home/kerrygal/FUDforum/include/theme/default/fileio.inc on line 23.

The error message was: fopen(/home/kerrygal/FUDforum/messages/msg_120000) [function.fopen]: failed to open stream: No such file or directory


Attempting to rebuild search index gives this repeatedly before it fails -

Quote:
Warning: fopen(/home/kerrygal/FUDforum/messages/msg_-70000) [function.fopen]: failed to open stream: No such file or directory in /home/kerrygal/FUDforum/include/theme/default/fileio.inc on line 23

Warning: fseek(): supplied argument is not a valid stream resource in /home/kerrygal/FUDforum/include/theme/default/fileio.inc on line 26

Warning: fread(): supplied argument is not a valid stream resource in /home/kerrygal/FUDforum/include/theme/default/fileio.inc on line 27



etc ending with this:

Quote:
Fatal error: Out of memory (allocated 47710208) (tried to allocate 71 bytes) in /home/kerrygal/FUDforum/include/theme/default/isearch.inc on line 64


an attempted forum data dump fails with this message:

Quote:
Warning: mysql_fetch_row(): supplied argument is not a valid MySQL result resource in /home/kerrygal/FUDforum/include/theme/default/db.inc on line 27
(/home/kerrygal/FUDforum/include/theme/default/db.inc:77
/home/kerrygal/FUDforum/include/theme/default/db.inc:149
/home/kerrygal/public_html/ParisForums/adm/admdump.php:169
) 2006: MySQL server has gone away
Query: SHOW TABLES LIKE 'fud26_%'
_POST: array ( 'SQ' => '6352b6a6116f581e129876872607bfd5', 'path' => '/home/kerrygal/FUDforum/tmp/FUDforum_01_05_2009_05_45.fud.gz', 'compress' => '1', 'btn_submit' => 'Make Backup', 'submitted' => '1', )


and NNTP sync just went away one day, with cron giving this error -

Quote:
Unable to establish connection to news.parisnewsgroup.com on port 119 failed With Error #110 : Connection timed out


- although I can access the NG normally using a usenet browser so it's not down. Any ideas? I've tried repairing the db but that hasn't helped.


Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159066 is a reply to message #159065] Sat, 02 May 2009 04:12 Go to previous messageGo to next message
naudefj is currently offline  naudefj   South Africa
Messages: 3624
Registered: December 2004
Karma: 17
Senior Member
Administrator
Core Developer
remove from buddy list
ignore all messages by this user
Are you still on 2.8.0? Have you made any recent changes? Can you restore?

> failed to open stream: No such file or directory

Check if the file is there. Does FUDforum have permissions to read/write to it?

> Fatal error: Out of memory (

Looks like PHP's memory limit was reached. Please increase it.

> ) 2006: MySQL server has gone away

This is a MySQL problem. You may need to restart the DB. Also check for errors in MySQL's log files.

> Unable to establish connection to news.parisnewsgroup.com on port 119 failed With Error #110 : Connection timed out

Can you access this newsgroup from your FUDforum server? If so, it may have been a temporary failure (probably the network).

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159074 is a reply to message #159066] Sat, 02 May 2009 14:16 Go to previous messageGo to next message
kerryg is currently offline  kerryg   Canada
Messages: 157
Registered: September 2008
Karma: 0
Senior Member
add to buddy list
ignore all messages by this user
Thanks Frank, I've increased php's memory to 256 meg and loosened some timeouts.

I checked and found that the files appear to be there but have subtly different names than the script says it can't find (note no hyphen) -

index.php?t=getfile&id=5582&private=0

I was on 2.8.0 when I started getting these problems but upgraded to 2.8.1 on the off chance it might resolve them. I haven't been able to do a datadump for a while so my first preference would be to solve this "in situ" (although worst-case I can re-sync the forums to the NG and retrieve the posts that way).

The NG is up and running, I can access it via a USENET reader. I use a hosting service (Hostmonster), I'm not quite sure how to test if they can similarly access it.

[Updated on: Sat, 02 May 2009 14:27]

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159075 is a reply to message #159074] Sat, 02 May 2009 14:34 Go to previous messageGo to next message
kerryg is currently offline  kerryg   Canada
Messages: 157
Registered: September 2008
Karma: 0
Senior Member
add to buddy list
ignore all messages by this user
This thread is related too:

http://fudforum.org/forum/index.php?t=msg&th=118332&unread=1& - ToniCE seems to have experienced something related in terms of hyphens.


Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159080 is a reply to message #159075] Sat, 02 May 2009 16:56 Go to previous messageGo to next message
naudefj is currently offline  naudefj   South Africa
Messages: 3624
Registered: December 2004
Karma: 17
Senior Member
Administrator
Core Developer
remove from buddy list
ignore all messages by this user
Please run this SQL statement from the "SQL Manager" control panel and post the output here:

SELECT file_id, count(*) FROM fud28_msg GROUP BY file_id;
Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159082 is a reply to message #159080] Sat, 02 May 2009 17:44 Go to previous messageGo to next message
kerryg is currently offline  kerryg   Canada
Messages: 157
Registered: September 2008
Karma: 0
Senior Member
add to buddy list
ignore all messages by this user
OK, I think I figured out how to do that - hope this is right -

http://kerrygalloway.com/troubleshooting/fud26_msg.zip
Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159085 is a reply to message #159082] Sun, 03 May 2009 01:54 Go to previous messageGo to next message
naudefj is currently offline  naudefj   South Africa
Messages: 3624
Registered: December 2004
Karma: 17
Senior Member
Administrator
Core Developer
remove from buddy list
ignore all messages by this user
The SQL Manager is a new control panel in FUDforum 2.8.1. See documentation at http://cvs.prohost.org/index.php/SQL_Manager
Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159109 is a reply to message #159085] Tue, 05 May 2009 01:16 Go to previous messageGo to next message
kerryg is currently offline  kerryg   Canada
Messages: 157
Registered: September 2008
Karma: 0
Senior Member
add to buddy list
ignore all messages by this user
Hm, well if that ain't the darndest thing. That's why I had trouble finding it.

I'd installed 2.8.1 RC1 clean in a new directory. In that new forum, I can see the SQL manager link on the left when in the admin CP. But when I go back to my old forum, which was upgraded to 2.8.1 RC1 via the upgrade script, the link to the SQL manager isn't in the admin CP, despite rebuilding all the themes and trying them one after the other. I'm inspecting the themes to see if I've got anything corrupted in there.
Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159117 is a reply to message #159109] Wed, 06 May 2009 13:45 Go to previous messageGo to next message
kerryg is currently offline  kerryg   Canada
Messages: 157
Registered: September 2008
Karma: 0
Senior Member
add to buddy list
ignore all messages by this user
OK, not having much luck here. I can't get the SQL Manager link to show up on the left side of my Admin Control panel despite recompiling the themes, and I'm wondering if if I've corrupted my default theme somehow during a misguided attempt to figure out the theming process. This would mean that everything I build from it will be corrupted too. Is there a way to download the entire "default" theme templates from CVS to replace my own to test this out?

edited to add: in case this is useful info - my themes all say Powered by: FUDforum 2.8.0 at the bottom, despite the upgrade I've now performed twice.

[Updated on: Wed, 06 May 2009 13:58]

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159121 is a reply to message #159117] Wed, 06 May 2009 14:15 Go to previous messageGo to next message
naudefj is currently offline  naudefj   South Africa
Messages: 3624
Registered: December 2004
Karma: 17
Senior Member
Administrator
Core Developer
remove from buddy list
ignore all messages by this user
Hi Kerry,

Are you sure you are on 2.8.1RC1?

The admin control panel files are not compiled. You can simply download the latest versions from CVS (http://cvs.prohost.org/c/index.cgi/FUDforum/dirview?d=install/www_root/adm).

Best regards.

Frank
Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159124 is a reply to message #159121] Wed, 06 May 2009 14:27 Go to previous messageGo to next message
kerryg is currently offline  kerryg   Canada
Messages: 157
Registered: September 2008
Karma: 0
Senior Member
add to buddy list
ignore all messages by this user
Hi Frank - I ran the updater twice, and it seemed to complete successfully, but the themes disagree - they're not just the wrong version number but also the new SQL manager link is missing in the ACP.
Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159131 is a reply to message #159124] Thu, 07 May 2009 14:24 Go to previous messageGo to next message
kerryg is currently offline  kerryg   Canada
Messages: 157
Registered: September 2008
Karma: 0
Senior Member
add to buddy list
ignore all messages by this user
Happy to report that one aspect of the problem - the broken NNTP sync - has been resolved. Right around the same time I started experiencing these issues, my hosting service suddenly decided to restrict all access below port 1024 without notifying anyone (grrrrrrrrr) and it was solved with a phone call (they whitelisted the port for me).

So now there's the two (possibly related) issues to resolve - why the upgrade script is telling me it's done its job but the forums don't reflect that, and why the re-index/compact/data dump functions fail.

I checked and the data dump is indeed creating a file, so since I had installed another FUDforum in a test directory I imported that data dump into it. The problems immediately get duplicated at the new forum, so I'm thinking I might simply have a corrupted database.

[Updated on: Thu, 07 May 2009 14:24]

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159144 is a reply to message #159131] Fri, 08 May 2009 12:20 Go to previous messageGo to next message
kerryg is currently offline  kerryg   Canada
Messages: 157
Registered: September 2008
Karma: 0
Senior Member
add to buddy list
ignore all messages by this user
Further exploration - yep, the update script is failing. The installer runs, completes and writes an UPDATE STATUS file. But in the ACP system info still says FUDForum 2.8.0, the templates are unchanged (version number stays the same and the new functions don't appear) and the file modification dates internally are unchanged.
Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159147 is a reply to message #159144] Sat, 09 May 2009 01:27 Go to previous messageGo to next message
naudefj is currently offline  naudefj   South Africa
Messages: 3624
Registered: December 2004
Karma: 17
Senior Member
Administrator
Core Developer
remove from buddy list
ignore all messages by this user
Are you sure you have the right upgrade script? Please do a md5sum on it and compare it with the values at http://fudforum.org/download.php?di=139&u=1

Example:
# md5sum FUDforum_upgrade_zl_2-8-1RC1.zip
8d4dde50488f0364f704e61b9aa7f306
Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159174 is a reply to message #159147] Sun, 10 May 2009 15:36 Go to previous messageGo to next message
kerryg is currently offline  kerryg   Canada
Messages: 157
Registered: September 2008
Karma: 0
Senior Member
add to buddy list
ignore all messages by this user
Spot on, that was it. Maybe I was being absentminded that day and downloaded the wrong script.

[sfx: head banging on desk]

The database remains a problem - the MySQL query gives this result -

(/home/kerrygal/FUDforum/include/theme/default/db.inc:73
/home/kerrygal/public_html/ParisForums/adm/admsql.php:56
) 1146: Table 'kerrygal_parisforumsdata09.fud28_msg' doesn't exist
Query: SELECT file_id, count(*) FROM fud28_msg GROUP BY file_id;
_POST: array ( 'SQ' => '3959a727ab29b050fab3c7eac96eef83', 'sql' => 'SELECT file_id, count(*) FROM fud28_msg GROUP BY file_id;', )
Server Version: 5.0.75-community-log
[Referring Page] http://kerrygalloway.com/ParisForums/adm/admsql.php?&SQ=3959a727ab29b050fab3c7eac96eef83


but if I change it to my own db prefix it's this -

SQL Results

file_id	count(*)
-80000	1
-70000	43
-60000	3
60000	48465
70000	48
80000	1635
100000	2
120000	2
130000	4

9 row(s) returned.


That MySQL manager's going to be *very* handy.

[Updated on: Sun, 10 May 2009 15:37]

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #161172 is a reply to message #159065] Sat, 21 November 2009 09:23 Go to previous messageGo to next message
G0mez is currently offline  G0mez   United Kingdom
Messages: 5
Registered: April 2008
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
Hi, did this ever get resolved? I appear to have the same problem. I'm on 2.8.1 although following a failed upgrade to 3.0.0

SELECT file_id, count(*) FROM fud26_msg GROUP BY file_id;


gives...

file_id	count(*)
-20000	85291
20000	29908
50000	250
60000	975
70000	20

5 row(s) returned.


and I have this in the forum's message directory.
total 93692
-rw-------  1 54825067 2009-11-21 05:31 msg_20000
-rw-------  1        0 2009-07-04 17:13 msg_30000
-rw-------  1   289502 2009-08-23 10:45 msg_50000
-rw-------  1   345616 2009-11-18 09:00 msg_60000
-rw-------  1   230973 2009-08-16 13:37 msg_70000
-rw-------  1   621205 2009-11-21 05:54 private
-rw-r--r--  1 39499386 2009-11-21 04:46 tmp_msg_20000

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #161173 is a reply to message #159065] Sat, 21 November 2009 09:40 Go to previous messageGo to next message
G0mez is currently offline  G0mez   United Kingdom
Messages: 5
Registered: April 2008
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
It's a nasty hack, but I copied tmp_msg_20000 to msg_-20000 and the blank posts 'unblanked'

Didn't leave it like that as I'm hoping this means once the issue that's causing compact to fail is resolved that the messages will sort themselves too and I thought it might try and write to that file causing more confusion, because it's clear the forum does still have the right links to the right messages, it's just a little confused as to where they are right now.
Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #161174 is a reply to message #161173] Sat, 21 November 2009 10:39 Go to previous message
naudefj is currently offline  naudefj   South Africa
Messages: 3624
Registered: December 2004
Karma: 17
Senior Member
Administrator
Core Developer
remove from buddy list
ignore all messages by this user
The only (free of charge) support you will get is if you are on the latest version (FUDforum 3.0.0) or trying to upgrade to the latest version. Please restore your forum, upgrade, and open a new topic if this is still a problem.
Quick Reply
Formatting Tools:   
  Switch to threaded view of this topic Create a new topic
Previous Topic: nntp import notice
Next Topic: NNTP Topic is Truncated sometimes with German Characters
Goto Forum:
  

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ]

Current Time: Sun Oct 22 02:34:59 EDT 2017

Total time taken to generate the page: 0.00844 seconds