FUDforum: Bug Reports » Error running compactor for private messages in 2.7.1

Home » FUDforum Development » Bug Reports » Error running compactor for private messages in 2.7.1

Show: Today's Messages :: Polls :: Message Navigator

Error running compactor for private messages in 2.7.1 [message #27250]

Thu, 01 September 2005 01:51

boosty

Messages: 16
Registered: April 2005
Location: Germany

Karma: 0

Junior Member

I get the following error when using "Compact messages" in FUDforum 2.7.1 but I am sure that I have enough webspace left.

All fine until...

Quote:

ETA: 0,111111111111 seconds
100% done
ETA: 0 seconds
100% Done
Compacting private messages...

Warning: fopen(/path/to/forum/messages/private): failed to open stream: Datei oder Verzeichnis nicht gefunden in /path/to/forum/include/theme/default/private.inc on line 197

Warning: fseek(): supplied argument is not a valid stream resource in /path/to/forum/include/theme/default/private.inc on line 198

Warning: fread(): supplied argument is not a valid stream resource in /path/to/forum/include/theme/default/private.inc on line 199

Warning: fclose(): supplied argument is not a valid stream resource in /path/to/forum/include/theme/default/private.inc on line 200
FATAL ERROR: system has ran out of disk space

Any ideas/suggestions?
Thanks in advance.

Sebastian

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27254 is a reply to message #27250]

Thu, 01 September 2005 10:16

boosty

Messages: 16
Registered: April 2005
Location: Germany

Karma: 0

Junior Member

Sorry, I forgot to mention that this happened after upgrading from the recent version to 2.7.1.
The private message bodies are empty now...

Sebastian

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27259 is a reply to message #27254]

Thu, 01 September 2005 18:36

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

Fixed in CVS.

FUDforum Core Developer

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27264 is a reply to message #27259]

Thu, 01 September 2005 19:01

boosty

Messages: 16
Registered: April 2005
Location: Germany

Karma: 0

Junior Member

Ilia wrote on Thu, 01 September 2005 20:36

Fixed in CVS.

Cool

Smile

Is there something I can do to get the message bodies back or do I have to recover from a backup?

Sebastian

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27265 is a reply to message #27264]

Thu, 01 September 2005 19:06

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

I'd recommend doing it from backup, it is possible to recover them without a backup, but the process would be far more complex.

One thing I should definately mention is that this problem was caused by permissions. The compact script did not have permissions to open the "private" file inside the messages directory and failed in a rather spectacular manner. Make sure that this file is writable by the web server.

FUDforum Core Developer

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27382 is a reply to message #27250]

Tue, 06 September 2005 16:56

bneu

Messages: 6
Registered: September 2005

Karma: 0

Junior Member

I think I've got a similar problem after upgrading from 2.6 to 2.7.2 I get a lot of error messages and all my postings are empty!

Warning: fopen(/var/www/FUDforum2/data/messages/msg_20000): failed to open stream: Datei oder Verzeichnis nicht gefunden in /var/www/FUDforum2/theme/default/msg.php on line 528

Warning: fseek(): supplied argument is not a valid stream resource in /var/www/FUDforum2/theme/default/msg.php on line 541

Warning: fread(): supplied argument is not a valid stream resource in /var/www/FUDforum2/theme/default/msg.php on line 542

Warning: fseek(): supplied argument is not a valid stream resource in /var/www/FUDforum2/theme/default/msg.php on line 541

Warning: fread(): supplied argument is not a valid stream resource in /var/www/FUDforum2/theme/default/msg.php on line 542

Warning: fseek(): supplied argument is not a valid stream resource in /var/www/FUDforum2/theme/default/msg.php on line 541

Warning: fread(): supplied argument is not a valid stream resource in /var/www/FUDforum2/theme/default/msg.php on line 542

This all aperead after compacting the messages.

The sad thing is that there is no backup.
I know you can blame me for this, but this there any way to get the postings back?

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27394 is a reply to message #27382]

Tue, 06 September 2005 21:36

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

What files do you have inside the messages/ directory?

FUDforum Core Developer

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27395 is a reply to message #27250]

Tue, 06 September 2005 21:49

bneu

Messages: 6
Registered: September 2005

Karma: 0

Junior Member

limes:/var/www/FUDforum2/data/messages# ls -la
insgesamt 20
drwxrwxrwx   2 www-data www-data 4096 2005-09-06 19:01 .
drwxrwxrwx  13 www-data www-data 4096 2004-06-02 11:03 ..
-rw-rw-rw-   1 www-data www-data   14 2004-06-02 11:03 .htaccess
-rw-r--r--   1 www-data www-data    4 2005-09-06 19:01 msg_150000
-rw-r--r--   1 www-data www-data   92 2005-09-06 16:51 msg_80000
-rw-r--r--   1 www-data www-data    0 2005-09-06 16:03 private_tmp

the files msg_150000 and msg_80000 contain each one posting which took place after the update

[Updated on: Tue, 06 September 2005 21:51]

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27396 is a reply to message #27395]

Tue, 06 September 2005 22:00

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

Do you have backups of the original msg_1 file in that dir?

FUDforum Core Developer

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27397 is a reply to message #27250]

Tue, 06 September 2005 22:16

bneu

Messages: 6
Registered: September 2005

Karma: 0

Junior Member

no there is no backup.

The largest directory in the data directory is the errors directory .
Especially the .backup with about 6MB

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27398 is a reply to message #27397]

Wed, 07 September 2005 02:34

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

Then I am sorry to say the data is lost.

FUDforum Core Developer

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27400 is a reply to message #27250]

Wed, 07 September 2005 06:35

bneu

Messages: 6
Registered: September 2005

Karma: 0

Junior Member

i thought you would say that.

thanks for the help.

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27406 is a reply to message #27400]

Wed, 07 September 2005 11:26

bneu

Messages: 6
Registered: September 2005

Karma: 0

Junior Member

i have removed all messages from all forums but I still can't compact the messages without an error. any suggestions?

Quote:

ay take a while depending on the size of your forum.
Compacting normal messages...
100% Done
Compacting private messages...
FATAL ERROR: system has ran out of disk space

Quote:

df -h
Dateisystem Gr��e Benut Verf Ben% Eingeh�ngt auf
/dev/hda1 6,0G 2,8G 2,9G 50% /
/dev/hda3 6,3G 301M 5,7G 5% /var/www

I've posted a normal and a private test message which at least don't disapear after compacting messages.

May it be that I've got not enough RAM in my machine (80MB)?

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27427 is a reply to message #27250]

Wed, 07 September 2005 17:02

boosty

Messages: 16
Registered: April 2005
Location: Germany

Karma: 0

Junior Member

I still have the same problem. The compactor simply does not run without this error, so I cannot use it anymore.

Sebastian

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27433 is a reply to message #27427]

Wed, 07 September 2005 21:26

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

What is the precise error that you are seeing?

FUDforum Core Developer

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27435 is a reply to message #27250]

Wed, 07 September 2005 22:40

boosty

Messages: 16
Registered: April 2005
Location: Germany

Karma: 0

Junior Member

I get the same error as described in my first post I opened this thread with (message #27250).
While the private messages created after the last compactor run work, I was not able to recreate the old ones. I end up with a missing private file and an empty private_tmp file on each attempt to run the compactor.

Sebastian

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27436 is a reply to message #27435]

Thu, 08 September 2005 01:05

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

Did you get permission error? That implies not a bug in the forum but rather the fact that the forum has no rights to open a file.

FUDforum Core Developer

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27442 is a reply to message #27250]

Thu, 08 September 2005 06:05

bneu

Messages: 6
Registered: September 2005

Karma: 0

Junior Member

I only get

ay take a while depending on the size of your forum.
Compacting normal messages...
100% Done
Compacting private messages...
FATAL ERROR: system has ran out of disk space

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27443 is a reply to message #27250]

Thu, 08 September 2005 06:26

boosty

Messages: 16
Registered: April 2005
Location: Germany

Karma: 0

Junior Member

I do not think it has to do with permissions, the file private is owned by the webserver and the permissions of the directory and the file seem as fine as the other files.
Additionally, the line

Quote:

Warning: fopen(/path/to/forum/messages/private): failed to open stream: Datei oder Verzeichnis nicht gefunden in /path/to/forum/include/theme/default/private.inc on line 197

indicates that as soon as the compactor comes to the private messages, the private file is missing (which is "Datei oder Verzeichnis nicht gefunden" in german).
This reflects what is left after the error: A missing private file and an empty private_tmp file.

Thanks for your help Smile

Smile

Sebastian

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27451 is a reply to message #27443]

Thu, 08 September 2005 14:07

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

This patch should fix this:
http://cvs.prohost.org/c/index.cgi/FUDforum/chngview?cn=7306

FUDforum Core Developer

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27468 is a reply to message #27250]

Fri, 09 September 2005 07:07

boosty

Messages: 16
Registered: April 2005
Location: Germany

Karma: 0

Junior Member

I have updated my forum to FUDforum 2.7.2.

Unfortunately the compactor is still not working here, with or without the patch applied.

I start with a messages directory containing the following files (all writeable by the webserver):

msg_100000
msg_110000
msg_120000
msg_130000
msg_140000
msg_20000
msg_30000
msg_40000
msg_50000
msg_60000
msg_70000
msg_80000
msg_90000
private
private_tmp

Running the compactor without the patch:

Quote:

Please wait while forum is being compacted.
This may take a while depending on the size of your forum.
Compacting normal messages...

Warning: mysql_fetch_row(): supplied argument is not a valid MySQL result resource in /path/to/forum/include/theme/default/db.inc on line 128
100% Done
Compacting private messages...

Warning: fopen(/path/to/forum/messages/private): failed to open stream: Datei oder Verzeichnis nicht gefunden in /path/to/forum/include/theme/default/private.inc on line 197

Warning: fseek(): supplied argument is not a valid stream resource in /path/to/forum/include/theme/default/private.inc on line 198

Warning: fread(): supplied argument is not a valid stream resource in /path/to/forum/include/theme/default/private.inc on line 199

Warning: fclose(): supplied argument is not a valid stream resource in /path/to/forum/include/theme/default/private.inc on line 200
FATAL ERROR: system has ran out of disk space

After that, the only file left is private_tmp!

Running the compactor on the same messages directory with the patch applied:

Quote:

Please wait while forum is being compacted.
This may take a while depending on the size of your forum.
Compacting normal messages...

Warning: mysql_fetch_row(): supplied argument is not a valid MySQL result resource in /path/to/forum/include/theme/default/db.inc on line 128
100% Done
Compacting private messages...
10% done
ETA: 0 seconds
20% done
ETA: 0 seconds
30% done
ETA: 0 seconds
40% done
ETA: 0 seconds
50% done
ETA: 0 seconds
100% Done
Done in 0,00 minutes

After that, the only file left is private!

Could it be that all this annoying errors come from any previous updates? Has the message storage format or the like changed in the past?

Sebastian

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27490 is a reply to message #27468]

Fri, 09 September 2005 14:22

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

With the latest patch the compact code works just fine on my test system.

You can try adding debug code before every unlink() function to see if you can trackdown for the "private" file removal.

FUDforum Core Developer

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27509 is a reply to message #27250]

Fri, 09 September 2005 17:18

boosty

Messages: 16
Registered: April 2005
Location: Germany

Karma: 0

Junior Member

When I have the patch applied, the private file is not removed, but all the others are.

Sebastian

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27510 is a reply to message #27509]

Fri, 09 September 2005 20:02

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

What all others, the msg_* should be removed and then replaced with tmp_msg_*.

FUDforum Core Developer

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27519 is a reply to message #27250]

Sat, 10 September 2005 09:59

boosty

Messages: 16
Registered: April 2005
Location: Germany

Karma: 0

Junior Member

Unfortunately they are not Sad

Sad

Please see my quotes above.
I guess it happens here:

Quote:

...
Compacting normal messages...

Warning: mysql_fetch_row(): supplied argument is not a valid MySQL result resource in /path/to/forum/include/theme/default/db.inc on line 128
100% Done
Compacting private messages.
...

Sebastian

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27520 is a reply to message #27250]

Sat, 10 September 2005 12:56

pier

Messages: 3
Registered: May 2005
Location: Italy

Karma: 0

Junior Member

Lost all my msgs too Sad

Sad

*cry*

I'm running 2.7.2 and when I tried to compact my messages after the upgrade it zapped all my stuff Sad

Sad

Sad

Sad

*CRY*

[Updated on: Sat, 10 September 2005 13:01]

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27560 is a reply to message #27519]

Mon, 12 September 2005 14:57

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

Can you add a print "{$f}<br>\n" in the remove old message files loop, right above the unlink() line.

FUDforum Core Developer

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27613 is a reply to message #27560]

Thu, 15 September 2005 13:05

boosty

Messages: 16
Registered: April 2005
Location: Germany

Karma: 0

Junior Member

Here it is. I run it on 2.7.2.

With patch:

Compacting normal messages...

Warning: mysql_fetch_row(): supplied argument is not a valid MySQL result resource in /path/to/forum/include/theme/default/db.inc on line 128
/path/to/forum/messages/msg_100000
/path/to/forum/messages/msg_110000
/path/to/forum/messages/msg_120000
/path/to/forum/messages/msg_130000
/path/to/forum/messages/msg_140000
/path/to/forum/messages/msg_20000
/path/to/forum/messages/msg_30000
/path/to/forum/messages/msg_40000
/path/to/forum/messages/msg_50000
/path/to/forum/messages/msg_60000
/path/to/forum/messages/msg_70000
/path/to/forum/messages/msg_80000
/path/to/forum/messages/msg_90000
100% Done
Compacting private messages...
10% done
ETA: 0 seconds
20% done
ETA: 0 seconds
30% done
ETA: 0 seconds
40% done
ETA: 0 seconds
50% done
ETA: 0 seconds
100% Done
Done in 0,00 minutes

Without patch:

Compacting normal messages...

Warning: mysql_fetch_row(): supplied argument is not a valid MySQL result resource in /path/to/forum/include/theme/default/db.inc on line 128
/path/to/forum/messages/msg_100000
/path/to/forum/messages/msg_110000
/path/to/forum/messages/msg_120000
/path/to/forum/messages/msg_130000
/path/to/forum/messages/msg_140000
/path/to/forum/messages/msg_20000
/path/to/forum/messages/msg_30000
/path/to/forum/messages/msg_40000
/path/to/forum/messages/msg_50000
/path/to/forum/messages/msg_60000
/path/to/forum/messages/msg_70000
/path/to/forum/messages/msg_80000
/path/to/forum/messages/msg_90000
/path/to/forum/messages/private
/path/to/forum/messages/private_tmp
100% Done
Compacting private messages...

Warning: fopen(/path/to/forum/messages/private): failed to open stream: Datei oder Verzeichnis nicht gefunden in /path/to/forum/include/theme/default/private.inc on line 197

Warning: fseek(): supplied argument is not a valid stream resource in /path/to/forum/include/theme/default/private.inc on line 198

Warning: fread(): supplied argument is not a valid stream resource in /path/to/forum/include/theme/default/private.inc on line 199

Warning: fclose(): supplied argument is not a valid stream resource in /path/to/forum/include/theme/default/private.inc on line 200
FATAL ERROR: system has ran out of disk space

Sebastian

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27665 is a reply to message #27613]

Mon, 19 September 2005 15:08

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

Get latest compact from cvs and try again.

FUDforum Core Developer

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27667 is a reply to message #27250]

Mon, 19 September 2005 15:45

boosty

Messages: 16
Registered: April 2005
Location: Germany

Karma: 0

Junior Member

Hmm, the latest check in is still the one from the 8th of September?!
http://cvs.prohost.org/c/index.cgi/FUDforum/chngview?cn=7306

Sebastian

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27668 is a reply to message #27667]

Mon, 19 September 2005 19:44

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

Yes, it works fine on my systems here... If it does not work for you, modify the script so that everytime it executes unlink() function it prints the name of the file being removed.

FUDforum Core Developer

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27669 is a reply to message #27250]

Mon, 19 September 2005 20:21

boosty

Messages: 16
Registered: April 2005
Location: Germany

Karma: 0

Junior Member

Well, that is exactly what resulted in the output posted above Smile

Smile

The output "with patch" means that the code from CVS was used.

Sebastian

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27675 is a reply to message #27669]

Mon, 19 September 2005 23:50

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

Well, with the patch it does not remove any bogus files so, it should work fine (as it does on my test system)...

FUDforum Core Developer

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27679 is a reply to message #27250]

Tue, 20 September 2005 07:12

boosty

Messages: 16
Registered: April 2005
Location: Germany

Karma: 0

Junior Member

Ok, could you explain what the desired/wanted behaviour of the following lines exactly is, so that I can try to fix my system on my own? What files should be deleted by this code?

foreach (glob($MSG_STORE_DIR.'msg_*') as $f) {
    if (strncmp(basename($f), 'tmp_', 4)) {
        unlink($f);
    }
}

Additionally it would be nice if you gave me a hint on the mysql error that also occurs (posted above).

Thanks for your patience Smile

Smile

Sebastian

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27683 is a reply to message #27679]

Tue, 20 September 2005 12:58

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

The perpouse of this code is to remove the original versions of the msg_* files so that new versions can be put in their place.

FUDforum Core Developer

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27686 is a reply to message #27250]

Tue, 20 September 2005 13:59

boosty

Messages: 16
Registered: April 2005
Location: Germany

Karma: 0

Junior Member

Ok, and any ideas on the

Warning: mysql_fetch_row(): supplied argument is not a valid MySQL result resource in /path/to/forum/include/theme/default/db.inc on line 128

?

Sebastian

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27695 is a reply to message #27686]

Tue, 20 September 2005 14:35

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

Can't really say with just this error. You can put var_dump(debug_backtrace()) into the fetch code which generates the warning and maybe you'll see the error. I don't see anything of this sort of my system here...

FUDforum Core Developer

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27767 is a reply to message #27695]

Sun, 25 September 2005 19:09

hari

Messages: 23
Registered: November 2003
Location: Los Angeles, California, ...

Karma: 0

Junior Member

I can report the exact same error that boosty has been seeing. I just upgraded my forum from 2.6.15 to 2.7.2.

The files in ~/FUDforum/messages all have permissions 666. After running the compact script, the only file there is private_tmp with length 0. This file was not there before.

The script reports "FATAL ERROR: system has ran out of disk space" but there is plenty of space.

One odd thing is that my browser scrollbar is stuck at the bottom of the screen. I can drag it up to see the mysql_fetch_row() error, but when I let go it snaps back to the bottom. This is with Firefox 1.0.6 on Mac OS X.

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27779 is a reply to message #27767]

Mon, 26 September 2005 13:44

Ilia

Messages: 13241
Registered: January 2002

Karma: 0

Senior Member
Administrator
Core Developer

There have been fixed to this affect made in 2.7.3RC1

FUDforum Core Developer

Report message to a moderator

Re: Error running compactor for private messages in 2.7.1 [message #27974 is a reply to message #27779]

Mon, 03 October 2005 22:21

Juanisan

Messages: 24
Registered: July 2002
Location: Conshohocken, PA

Karma: 0

Junior Member

I am still getting this behaviour exactly as stated by the others in 2.7.3RC1 Confused

Confused

right down to the window in firefox snapping back up making it hard to see the error.

Please wait while forum is being compacted.
This may take a while depending on the size of your forum.
Compacting normal messages...
100% Done
Compacting private messages...
FATAL ERROR: system has ran out of disk space

Powered by: FUDforum 2.7.3RC1.

Never ask a geek why, just nod your head and slowly back away.

[Updated on: Mon, 03 October 2005 22:23]

Report message to a moderator

Pages (2): [1 2 › »]

Previous Topic:	Removing poll option resets total_votes
Next Topic:	Undefined variable: forum_title error when replying

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

]

Current Time: Fri Nov 01 00:01:24 GMT 2024

Total time taken to generate the page: 0.03032 seconds