FUDforum: Bug Reports » Can't rebuild, compact or do datadump, and NNTP sync fails

Home » FUDforum Development » Bug Reports » Can't rebuild, compact or do datadump, and NNTP sync fails

Show: Today's Messages :: Polls :: Message Navigator

Can't rebuild, compact or do datadump, and NNTP sync fails [message #159065]

Sat, 02 May 2009 00:49

kerryg

Messages: 157
Registered: September 2008

Karma: 0

Senior Member

Attempting to compact gives this error:

Quote:

Please wait while forum is being compacted.
This may take a while depending on the size of your forum.
Compacting normal messages...
An error was generated in file /home/kerrygal/FUDforum/include/theme/default/fileio.inc on line 23.

The error message was: fopen(/home/kerrygal/FUDforum/messages/msg_120000) [function.fopen]: failed to open stream: No such file or directory

Attempting to rebuild search index gives this repeatedly before it fails -

Quote:

Warning: fopen(/home/kerrygal/FUDforum/messages/msg_-70000) [function.fopen]: failed to open stream: No such file or directory in /home/kerrygal/FUDforum/include/theme/default/fileio.inc on line 23

Warning: fseek(): supplied argument is not a valid stream resource in /home/kerrygal/FUDforum/include/theme/default/fileio.inc on line 26

Warning: fread(): supplied argument is not a valid stream resource in /home/kerrygal/FUDforum/include/theme/default/fileio.inc on line 27

etc ending with this:

Quote:

Fatal error: Out of memory (allocated 47710208) (tried to allocate 71 bytes) in /home/kerrygal/FUDforum/include/theme/default/isearch.inc on line 64

an attempted forum data dump fails with this message:

Quote:

Warning: mysql_fetch_row(): supplied argument is not a valid MySQL result resource in /home/kerrygal/FUDforum/include/theme/default/db.inc on line 27
(/home/kerrygal/FUDforum/include/theme/default/db.inc:77
/home/kerrygal/FUDforum/include/theme/default/db.inc:149
/home/kerrygal/public_html/ParisForums/adm/admdump.php:169
) 2006: MySQL server has gone away
Query: SHOW TABLES LIKE 'fud26_%'
_POST: array ( 'SQ' => '6352b6a6116f581e129876872607bfd5', 'path' => '/home/kerrygal/FUDforum/tmp/FUDforum_01_05_2009_05_45.fud.gz', 'compress' => '1', 'btn_submit' => 'Make Backup', 'submitted' => '1', )

and NNTP sync just went away one day, with cron giving this error -

Quote:

Unable to establish connection to news.parisnewsgroup.com on port 119 failed With Error #110 : Connection timed out

- although I can access the NG normally using a usenet browser so it's not down. Any ideas? I've tried repairing the db but that hasn't helped.

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159066 is a reply to message #159065]

Sat, 02 May 2009 08:12

naudefj

Messages: 3771
Registered: December 2004

Karma: 28

Senior Member
Administrator
Core Developer

Are you still on 2.8.0? Have you made any recent changes? Can you restore?

> failed to open stream: No such file or directory

Check if the file is there. Does FUDforum have permissions to read/write to it?

> Fatal error: Out of memory (

Looks like PHP's memory limit was reached. Please increase it.

> ) 2006: MySQL server has gone away

This is a MySQL problem. You may need to restart the DB. Also check for errors in MySQL's log files.

> Unable to establish connection to news.parisnewsgroup.com on port 119 failed With Error #110 : Connection timed out

Can you access this newsgroup from your FUDforum server? If so, it may have been a temporary failure (probably the network).

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159074 is a reply to message #159066]

Sat, 02 May 2009 18:16

kerryg

Messages: 157
Registered: September 2008

Karma: 0

Senior Member

Thanks Frank, I've increased php's memory to 256 meg and loosened some timeouts.

I checked and found that the files appear to be there but have subtly different names than the script says it can't find (note no hyphen) -

index.php?t=getfile&id=5582&private=0

index.php?t=getfile&id=5582&private=0

I was on 2.8.0 when I started getting these problems but upgraded to 2.8.1 on the off chance it might resolve them. I haven't been able to do a datadump for a while so my first preference would be to solve this "in situ" (although worst-case I can re-sync the forums to the NG and retrieve the posts that way).

The NG is up and running, I can access it via a USENET reader. I use a hosting service (Hostmonster), I'm not quite sure how to test if they can similarly access it.

Attachment: directory view.jpg
(Size: 27.42KB, Downloaded 1508 times)

[Updated on: Sat, 02 May 2009 18:27]

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159075 is a reply to message #159074]

Sat, 02 May 2009 18:34

kerryg

Messages: 157
Registered: September 2008

Karma: 0

Senior Member

This thread is related too:

http://fudforum.org/forum/index.php?t=msg&th=118332&unread=1& - ToniCE seems to have experienced something related in terms of hyphens.

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159080 is a reply to message #159075]

Sat, 02 May 2009 20:56

naudefj

Messages: 3771
Registered: December 2004

Karma: 28

Senior Member
Administrator
Core Developer

Please run this SQL statement from the "SQL Manager" control panel and post the output here:

SELECT file_id, count(*) FROM fud28_msg GROUP BY file_id;

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159082 is a reply to message #159080]

Sat, 02 May 2009 21:44

kerryg

Messages: 157
Registered: September 2008

Karma: 0

Senior Member

OK, I think I figured out how to do that - hope this is right -

http://kerrygalloway.com/troubleshooting/fud26_msg.zip

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159085 is a reply to message #159082]

Sun, 03 May 2009 05:54

naudefj

Messages: 3771
Registered: December 2004

Karma: 28

Senior Member
Administrator
Core Developer

The SQL Manager is a new control panel in FUDforum 2.8.1. See documentation at http://cvs.prohost.org/index.php/SQL_Manager

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159109 is a reply to message #159085]

Tue, 05 May 2009 05:16

kerryg

Messages: 157
Registered: September 2008

Karma: 0

Senior Member

Hm, well if that ain't the darndest thing. That's why I had trouble finding it.

I'd installed 2.8.1 RC1 clean in a new directory. In that new forum, I can see the SQL manager link on the left when in the admin CP. But when I go back to my old forum, which was upgraded to 2.8.1 RC1 via the upgrade script, the link to the SQL manager isn't in the admin CP, despite rebuilding all the themes and trying them one after the other. I'm inspecting the themes to see if I've got anything corrupted in there.

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159117 is a reply to message #159109]

Wed, 06 May 2009 17:45

kerryg

Messages: 157
Registered: September 2008

Karma: 0

Senior Member

OK, not having much luck here. I can't get the SQL Manager link to show up on the left side of my Admin Control panel despite recompiling the themes, and I'm wondering if if I've corrupted my default theme somehow during a misguided attempt to figure out the theming process. This would mean that everything I build from it will be corrupted too. Is there a way to download the entire "default" theme templates from CVS to replace my own to test this out?

edited to add: in case this is useful info - my themes all say Powered by: FUDforum 2.8.0 at the bottom, despite the upgrade I've now performed twice.

[Updated on: Wed, 06 May 2009 17:58]

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159121 is a reply to message #159117]

Wed, 06 May 2009 18:15

naudefj

Messages: 3771
Registered: December 2004

Karma: 28

Senior Member
Administrator
Core Developer

Hi Kerry,

Are you sure you are on 2.8.1RC1?

The admin control panel files are not compiled. You can simply download the latest versions from CVS (http://cvs.prohost.org/c/index.cgi/FUDforum/dirview?d=install/www_root/adm).

Best regards.

Frank

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159124 is a reply to message #159121]

Wed, 06 May 2009 18:27

kerryg

Messages: 157
Registered: September 2008

Karma: 0

Senior Member

Hi Frank - I ran the updater twice, and it seemed to complete successfully, but the themes disagree - they're not just the wrong version number but also the new SQL manager link is missing in the ACP.

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159131 is a reply to message #159124]

Thu, 07 May 2009 18:24

kerryg

Messages: 157
Registered: September 2008

Karma: 0

Senior Member

Happy to report that one aspect of the problem - the broken NNTP sync - has been resolved. Right around the same time I started experiencing these issues, my hosting service suddenly decided to restrict all access below port 1024 without notifying anyone (grrrrrrrrr) and it was solved with a phone call (they whitelisted the port for me).

So now there's the two (possibly related) issues to resolve - why the upgrade script is telling me it's done its job but the forums don't reflect that, and why the re-index/compact/data dump functions fail.

I checked and the data dump is indeed creating a file, so since I had installed another FUDforum in a test directory I imported that data dump into it. The problems immediately get duplicated at the new forum, so I'm thinking I might simply have a corrupted database.

[Updated on: Thu, 07 May 2009 18:24]

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159144 is a reply to message #159131]

Fri, 08 May 2009 16:20

kerryg

Messages: 157
Registered: September 2008

Karma: 0

Senior Member

Further exploration - yep, the update script is failing. The installer runs, completes and writes an UPDATE STATUS file. But in the ACP system info still says FUDForum 2.8.0, the templates are unchanged (version number stays the same and the new functions don't appear) and the file modification dates internally are unchanged.

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159147 is a reply to message #159144]

Sat, 09 May 2009 05:27

naudefj

Messages: 3771
Registered: December 2004

Karma: 28

Senior Member
Administrator
Core Developer

Are you sure you have the right upgrade script? Please do a md5sum on it and compare it with the values at http://fudforum.org/download.php?di=139&u=1

Example:

# md5sum FUDforum_upgrade_zl_2-8-1RC1.zip
8d4dde50488f0364f704e61b9aa7f306

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #159174 is a reply to message #159147]

Sun, 10 May 2009 19:36

kerryg

Messages: 157
Registered: September 2008

Karma: 0

Senior Member

Spot on, that was it. Maybe I was being absentminded that day and downloaded the wrong script.

[sfx: head banging on desk]

The database remains a problem - the MySQL query gives this result -

(/home/kerrygal/FUDforum/include/theme/default/db.inc:73
/home/kerrygal/public_html/ParisForums/adm/admsql.php:56
) 1146: Table 'kerrygal_parisforumsdata09.fud28_msg' doesn't exist
Query: SELECT file_id, count(*) FROM fud28_msg GROUP BY file_id;
_POST: array ( 'SQ' => '3959a727ab29b050fab3c7eac96eef83', 'sql' => 'SELECT file_id, count(*) FROM fud28_msg GROUP BY file_id;', )
Server Version: 5.0.75-community-log
[Referring Page] http://kerrygalloway.com/ParisForums/adm/admsql.php?&SQ=3959a727ab29b050fab3c7eac96eef83

but if I change it to my own db prefix it's this -

SQL Results

file_id	count(*)
-80000	1
-70000	43
-60000	3
60000	48465
70000	48
80000	1635
100000	2
120000	2
130000	4

9 row(s) returned.

That MySQL manager's going to be *very* handy.

[Updated on: Sun, 10 May 2009 19:37]

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #161172 is a reply to message #159065]

Sat, 21 November 2009 14:23

G0mez

Messages: 5
Registered: April 2008

Karma: 0

Junior Member

Hi, did this ever get resolved? I appear to have the same problem. I'm on 2.8.1 although following a failed upgrade to 3.0.0

SELECT file_id, count(*) FROM fud26_msg GROUP BY file_id;

gives...

file_id	count(*)
-20000	85291
20000	29908
50000	250
60000	975
70000	20

5 row(s) returned.

and I have this in the forum's message directory.

total 93692
-rw-------  1 54825067 2009-11-21 05:31 msg_20000
-rw-------  1        0 2009-07-04 17:13 msg_30000
-rw-------  1   289502 2009-08-23 10:45 msg_50000
-rw-------  1   345616 2009-11-18 09:00 msg_60000
-rw-------  1   230973 2009-08-16 13:37 msg_70000
-rw-------  1   621205 2009-11-21 05:54 private
-rw-r--r--  1 39499386 2009-11-21 04:46 tmp_msg_20000

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #161173 is a reply to message #159065]

Sat, 21 November 2009 14:40

G0mez

Messages: 5
Registered: April 2008

Karma: 0

Junior Member

It's a nasty hack, but I copied tmp_msg_20000 to msg_-20000 and the blank posts 'unblanked'

Didn't leave it like that as I'm hoping this means once the issue that's causing compact to fail is resolved that the messages will sort themselves too and I thought it might try and write to that file causing more confusion, because it's clear the forum does still have the right links to the right messages, it's just a little confused as to where they are right now.

Report message to a moderator

Re: Can't rebuild, compact or do datadump, and NNTP sync fails [message #161174 is a reply to message #161173]

Sat, 21 November 2009 15:39

naudefj

Messages: 3771
Registered: December 2004

Karma: 28

Senior Member
Administrator
Core Developer

The only (free of charge) support you will get is if you are on the latest version (FUDforum 3.0.0) or trying to upgrade to the latest version. Please restore your forum, upgrade, and open a new topic if this is still a problem.

Report message to a moderator

Previous Topic:	nntp import notice
Next Topic:	NNTP Topic is Truncated sometimes with German Characters

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

]

Current Time: Thu Nov 21 15:27:22 GMT 2024

Total time taken to generate the page: 0.02317 seconds