FUDforum
Fast Uncompromising Discussions. FUDforum will get your users talking.

Home » FUDforum » FUDforum Installation Issues » Upgrade from 2.0.5 to 2.7.5 results in all msgs getting corrupt
Show: Today's Messages :: Polls :: Message Navigator
Switch to threaded view of this topic Create a new topic Submit Reply
Upgrade from 2.0.5 to 2.7.5 results in all msgs getting corrupt [message #33476] Mon, 04 September 2006 04:24 Go to next message
frysco is currently offline  frysco   Canada
Messages: 9
Registered: September 2006
Location: Vancouver, BC
Karma: 0
Junior Member
Hi - I'm hoping someone here might be able to help me figure this out.

What I have is this (on an old server):
FUDForum 2.0.5, Apache 1.3.26, PHP 4.1.2, MySQL 3.23.49

What I want to go to is this (on the new server):
FUDForum 2.7.5, Apache 2.0.54, PHP 5.0.4, MySQL 4.1.20

My upgrade process was this:
- export forum data via mysqldump
- rsync over the /forums/ and data folders, keeping the locations the same between servers
- altered $WWWROOT in GLOBALS.php to use the new server name
- the domain name is remaining the same, so $COOKIE_DOMAIN remains untouched
- copied the 2.7.5 upgrade.php to /forums/ and did a chmod 666
- performed a chown -R apache:apache on the /forums/ and data folders
- ran the upgrade - there were no errors to the browser, the data/errors/ directory or the webserver log files
- logged in as my admin user and ran the database consistency checks

Then when I go to look at any message in any thread on the upgraded forum, each is corrupted in exactly the same way. Each message appears to contain however many bytes it should be long, but made up entirely of the data from data/messages/msg_1

In one of my upgrade attempts, I even tried the compact messages tool, but it makes no difference to the end result.

I've started from scratch at least 10 times now, and always the end result is the same.

I've looked through the forums for any mention of others having similar issues, but not found anything. Has anyone experienced this before, or can give me advice to what I might be missing from this upgrade?

Thanks.
-Frysco
Re: Upgrade from 2.0.5 to 2.7.5 results in all msgs getting corrupt [message #33493 is a reply to message #33476] Mon, 04 September 2006 14:24 Go to previous messageGo to next message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
Can you show me some corrupted messages?

FUDforum Core Developer
Re: Upgrade from 2.0.5 to 2.7.5 results in all msgs getting corrupt [message #33497 is a reply to message #33493] Mon, 04 September 2006 15:02 Go to previous messageGo to next message
frysco is currently offline  frysco   Canada
Messages: 9
Registered: September 2006
Location: Vancouver, BC
Karma: 0
Junior Member
Sure.

Pretty much any message in http://fcweb.gryphonic.org/forums/. That's the test server with 2.7.5.

The live server (2.0.5) is at http://www.furtherconfusion.org/forums/ to show what things should look like.
Re: Upgrade from 2.0.5 to 2.7.5 results in all msgs getting corrupt [message #33514 is a reply to message #33497] Tue, 05 September 2006 12:20 Go to previous messageGo to next message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
I'm afraid I am getting an error when trying to connect to http://fcweb.gryphonic.org/forums/

FUDforum Core Developer
Re: Upgrade from 2.0.5 to 2.7.5 results in all msgs getting corrupt [message #33521 is a reply to message #33514] Tue, 05 September 2006 14:15 Go to previous messageGo to next message
frysco is currently offline  frysco   Canada
Messages: 9
Registered: September 2006
Location: Vancouver, BC
Karma: 0
Junior Member
Sorry about that. I only had the hostname published with my internal DNS. I've now published it to my public servers.

You should be able to access it now. Rolling Eyes

-Frysco
Re: Upgrade from 2.0.5 to 2.7.5 results in all msgs getting corrupt [message #33535 is a reply to message #33521] Wed, 06 September 2006 15:52 Go to previous messageGo to next message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
It seems to always start reading from the very start of the file. What is the value of foff field in the msg table?

FUDforum Core Developer
Re: Upgrade from 2.0.5 to 2.7.5 results in all msgs getting corrupt [message #33536 is a reply to message #33535] Wed, 06 September 2006 16:04 Go to previous messageGo to next message
frysco is currently offline  frysco   United States
Messages: 9
Registered: September 2006
Location: Vancouver, BC
Karma: 0
Junior Member
I think this is what you're asking for?

The value of 'foff' varies for each message.

Here's a sampling from the fud2_msg table:

mysql> select id,foff from fud2_msg order by id asc limit 0,20;
+-----+-------+
| id  | foff  |
+-----+-------+
| 151 | 57381 |
| 152 | 57069 |
| 153 |  7931 |
| 154 | 55070 |
| 155 | 54286 |
| 156 | 55111 |
| 157 |  7398 |
| 158 | 53404 |
| 159 | 41364 |
| 160 | 20306 |
| 161 | 30313 |
| 162 | 49720 |
| 163 |  6627 |
| 164 | 50459 |
| 165 |  7290 |
| 166 |  6907 |
| 167 | 48498 |
| 168 | 48607 |
| 169 |  7049 |
| 170 | 48328 |
+-----+-------+
20 rows in set (0.00 sec)
Re: Upgrade from 2.0.5 to 2.7.5 results in all msgs getting corrupt [message #33537 is a reply to message #33536] Wed, 06 September 2006 16:08 Go to previous messageGo to next message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
Ok the offset values appear to be correct, how big is the msg_* files inside the messages directory?

FUDforum Core Developer
Re: Upgrade from 2.0.5 to 2.7.5 results in all msgs getting corrupt [message #33538 is a reply to message #33537] Wed, 06 September 2006 16:12 Go to previous messageGo to next message
frysco is currently offline  frysco   United States
Messages: 9
Registered: September 2006
Location: Vancouver, BC
Karma: 0
Junior Member
aerie# ls -l fcweb/fc-forum-data/messages/
total 1810
-rw-r--r--  1 www  www      14 Sep  3 20:45 .htaccess
-rw-rw-rw-  1 www  www   83375 Sep  3 20:52 msg_100000
-rw-rw-rw-  1 www  www   42601 Sep  3 20:52 msg_110000
-rw-rw-rw-  1 www  www   12762 Sep  3 20:52 msg_120000
-rw-rw-rw-  1 www  www     953 Sep  3 20:52 msg_130000
-rw-rw-rw-  1 www  www   56330 Sep  3 20:52 msg_140000
-rw-rw-rw-  1 www  www  118043 Sep  3 20:52 msg_150000
-rw-rw-rw-  1 www  www  103124 Sep  3 20:52 msg_160000
-rw-rw-rw-  1 www  www   35288 Sep  3 20:52 msg_170000
-rw-rw-rw-  1 www  www   87825 Sep  3 20:52 msg_180000
-rw-rw-rw-  1 www  www  167250 Sep  3 20:52 msg_190000
-rw-rw-rw-  1 www  www  120014 Sep  3 20:52 msg_20000
-rw-rw-rw-  1 www  www   12123 Sep  3 20:52 msg_200000
-rw-rw-rw-  1 www  www    1484 Sep  3 20:52 msg_210000
-rw-rw-rw-  1 www  www   43293 Sep  3 20:52 msg_220000
-rw-rw-rw-  1 www  www   36897 Sep  3 20:52 msg_230000
-rw-rw-rw-  1 www  www   29978 Sep  3 20:52 msg_240000
-rw-rw-rw-  1 www  www   29518 Sep  3 20:52 msg_250000
-rw-rw-rw-  1 www  www    9796 Sep  3 20:52 msg_260000
-rw-rw-rw-  1 www  www     922 Sep  3 20:52 msg_270000
-rw-rw-rw-  1 www  www    3523 Sep  3 20:52 msg_280000
-rw-rw-rw-  1 www  www   52470 Sep  3 20:52 msg_30000
-rw-rw-rw-  1 www  www   18490 Sep  3 20:52 msg_40000
-rw-rw-rw-  1 www  www    4026 Sep  3 20:52 msg_50000
-rw-rw-rw-  1 www  www   88847 Sep  3 20:52 msg_60000
-rw-rw-rw-  1 www  www  236994 Sep  3 20:52 msg_70000
-rw-rw-rw-  1 www  www   93128 Sep  3 20:52 msg_80000
-rw-rw-rw-  1 www  www  177285 Sep  3 20:52 msg_90000
-rw-rw-rw-  1 www  www  133488 Sep  3 20:52 private
Re: Upgrade from 2.0.5 to 2.7.5 results in all msgs getting corrupt [message #33539 is a reply to message #33538] Wed, 06 September 2006 16:40 Go to previous messageGo to next message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
Did you happen to run the message compactor after the import?

Also, I see the private file is not empty, implying presence of private messages in the forum, do those messages appear correctly?


FUDforum Core Developer
Re: Upgrade from 2.0.5 to 2.7.5 results in all msgs getting corrupt [message #33540 is a reply to message #33539] Wed, 06 September 2006 16:52 Go to previous messageGo to next message
frysco is currently offline  frysco   United States
Messages: 9
Registered: September 2006
Location: Vancouver, BC
Karma: 0
Junior Member
Ilia wrote on Wed, 06 September 2006 09:40

Did you happen to run the message compactor after the import?


On this most recent attempt, yes. However, doing so (or not) has not made any difference to the end result (ie, the corruption)

Quote:

Also, I see the private file is not empty, implying presence of private messages in the forum, do those messages appear correctly?


That I'm not sure of, since I don't know which users on the system may have private messages.
Re: Upgrade from 2.0.5 to 2.7.5 results in all msgs getting corrupt [message #33541 is a reply to message #33540] Wed, 06 September 2006 18:02 Go to previous messageGo to next message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
You can do a query on the pmsg table and find out.

FUDforum Core Developer
Re: Upgrade from 2.0.5 to 2.7.5 results in all msgs getting corrupt [message #33542 is a reply to message #33541] Wed, 06 September 2006 18:22 Go to previous messageGo to next message
frysco is currently offline  frysco   United States
Messages: 9
Registered: September 2006
Location: Vancouver, BC
Karma: 0
Junior Member
No, the private messages are corrupted in the same way as the public messages.

However, in there the value fud2_pmsg.foff is the same for all rows in the table.
Re: Upgrade from 2.0.5 to 2.7.5 results in all msgs getting corrupt [message #33552 is a reply to message #33542] Thu, 07 September 2006 13:26 Go to previous messageGo to next message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
Ok, can you please tell me if after the upgrade the value of 'foff' field in the new forum matches that o the values in the old forum?

FUDforum Core Developer
Re: Upgrade from 2.0.5 to 2.7.5 results in all msgs getting corrupt [message #33553 is a reply to message #33552] Thu, 07 September 2006 13:39 Go to previous messageGo to next message
frysco is currently offline  frysco   Canada
Messages: 9
Registered: September 2006
Location: Vancouver, BC
Karma: 0
Junior Member
In the fud2_pmsg table? If so, no.

This is what is there before the upgrade:

mysql> select fud2_pmsg.id, fud2_pmsg.offset from fud2_pmsg order by fud2_pmsg.id asc limit 0,10;
+----+--------+
| id | offset |
+----+--------+
|  1 |      0 |
|  2 |    283 |
|  4 |    591 |
|  5 |    874 |
|  7 |   1115 |
|  8 |   1115 |
|  9 |   1447 |
| 12 |   1907 |
| 13 |    566 |
| 14 |    566 |
+----+--------+
10 rows in set (0.12 sec)


This is what is there after the upgrade:

mysql> select fud2_pmsg.id, fud2_pmsg.foff from fud2_pmsg order by fud2_pmsg.id asc limit 0,10;
+----+------+
| id | foff |
+----+------+
|  1 |  283 |
|  2 |  283 |
|  4 |  283 |
|  5 |  283 |
|  7 |  283 |
|  8 |  283 |
|  9 |  283 |
| 12 |  283 |
| 13 |  283 |
| 14 |  283 |
+----+------+
10 rows in set (0.01 sec)
Re: Upgrade from 2.0.5 to 2.7.5 results in all msgs getting corrupt [message #33560 is a reply to message #33553] Thu, 07 September 2006 14:04 Go to previous messageGo to next message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
How about the msg table?

FUDforum Core Developer
Re: Upgrade from 2.0.5 to 2.7.5 results in all msgs getting corrupt [message #33565 is a reply to message #33560] Thu, 07 September 2006 15:07 Go to previous messageGo to next message
frysco is currently offline  frysco   United States
Messages: 9
Registered: September 2006
Location: Vancouver, BC
Karma: 0
Junior Member
Before upgrade:
mysql> select fud2_msg.id, fud2_msg.offset from fud2_msg order by fud2_msg.id asc limit 0,10;
+-----+--------+
| id  | offset |
+-----+--------+
| 151 |      0 |
| 152 |     34 |
| 153 |    387 |
| 154 |    346 |
| 155 |   1093 |
| 156 |   1877 |
| 157 |   9925 |
| 158 |   3470 |
| 159 |  38654 |
| 160 |  41672 |
+-----+--------+
10 rows in set (0.04 sec)


After upgrade:
mysql> select fud2_msg.id, fud2_msg.foff from fud2_msg order by fud2_msg.id asc limit 0,10;
+-----+-------+
| id  | foff  |
+-----+-------+
| 151 | 57381 |
| 152 | 57069 |
| 153 |  7931 |
| 154 | 55070 |
| 155 | 54286 |
| 156 | 55111 |
| 157 |  7398 |
| 158 | 53404 |
| 159 | 41364 |
| 160 | 20306 |
+-----+-------+
10 rows in set (0.00 sec)
Re: Upgrade from 2.0.5 to 2.7.5 results in all msgs getting corrupt [message #33592 is a reply to message #33565] Fri, 08 September 2006 15:47 Go to previous message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
It looks like the forum is fairly small, would it be possible to send me forum's sql/data archive (before the upgrade) via PM so I can try to upgrade it here locale and try to identify the problems you are seeing.

FUDforum Core Developer
  Switch to threaded view of this topic Create a new topic Submit Reply
Previous Topic: Why all the attitude about LOCK TABLES issues?
Next Topic: Receive error after step two during installation
Goto Forum:
  

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ]

Current Time: Wed Nov 27 20:36:00 GMT 2024

Total time taken to generate the page: 0.02552 seconds