FUDforum
Fast Uncompromising Discussions. FUDforum will get your users talking.

Home » FUDforum » How To » Import Issues to new Host (v3.0.4)
Show: Today's Messages :: Polls :: Message Navigator
Switch to threaded view of this topic Create a new topic Submit Reply
Import Issues to new Host (v3.0.4) [message #168289] Fri, 12 April 2013 12:16 Go to next message
Kermit is currently offline  Kermit   United Kingdom
Messages: 35
Registered: November 2004
Karma: 0
Member
Hi, hope someone can help as I'm having issues moving our fudforum v3.0.4 to a new host

Bear with me while I try to explain the problem and what I've tried so far

1. Installed both empty fudforum 3.4.0 (and 3.4.1) on both the new host and within an additional test system running within XAMPP on my PC - no problems with these, the empty clean forums work fine
2. Performed multiple 'make forum datadump' on the current live forum and transferred this backup to my pc and new host for separate testing
3. When I run admimport.php (mostly via the control panel link) I get the following

[this is taken from my pc test XAMPP as its easier to test import on this than actual new host given I end up having to reinstall fudforum after each failure]
Cleanup old files...
Restore files from backup...
Drop and recreate database tables...
Start loading database tables...
Process table forum_action_log:
...12 rows loaded.
Process table forum_ann_forums:
...3 rows loaded.
Process table forum_announce:
...3 rows loaded.
Process table forum_attach:
...670 rows loaded.
Process table forum_bookmarks:
...25 rows loaded.

snip

...43 rows loaded.
Process table forum_mod:
...116 rows loaded.
Process table forum_msg:

Warning: mysqli::query(): MySQL server has gone away in C:\xampp\htdocs\FUDforum\include\theme\default\db.inc on line 110

Warning: mysqli::query(): Error reading result set's header in C:\xampp\htdocs\FUDforum\include\theme\default\db.inc on line 110

Fatal error: Allowed memory size of 1073741824 bytes exhausted (tried to allocate 65488 bytes) in C:\xampp\htdocs\FUDforum\include\theme\default\db.inc on line 54


4. I'm not very good with SQL errors like these nor understanding php code so tried editing admimport.php to increase

/* main */
	@ini_set('memory_limit', '256M');
	@set_time_limit(0);

to 1024M but still get the same error

One thing I've been thinking is our forum may have missed the 3.0 upgrade when it went from 2.x to 3.x as our globals.php layout is missing some things present in fresh installs of 3.4.0 but mostly our tables are prefixed forum_ not fud30_ . To try rule out table prefix issues I've also tested having the empty fudforum use forum_ from the initial install wizard (rather than the default fud30_) but still get the same result

This is our live forum globals.php (with sensitive info ***** out)
<?php
	$GLOBALS['FORUM_TITLE'] = 'Honda-Forums.com';
	$GLOBALS['FORUM_DESCR'] = 'Hairy arsed bikers talking about baking cakes';
	$GLOBALS['DISABLED_REASON'] = 'Undergoing maintenance, please come back later.';
	$GLOBALS['WWW_ROOT'] = 'http://www.honda-forums.com/';
	$GLOBALS['CUSTOM_AVATAR_MAX_SIZE'] = 409600;
	$GLOBALS['CUSTOM_AVATAR_MAX_DIM'] = '176x120';
	$GLOBALS['COOKIE_PATH'] = '/';
	$GLOBALS['COOKIE_TIMEOUT'] = 604800;
	$GLOBALS['SESSION_TIMEOUT'] = 604800;
	$GLOBALS['COOKIE_DOMAIN'] = '.honda-forums.com';
	$GLOBALS['COOKIE_NAME'] = 'honda-forum';
	$GLOBALS['DBHOST'] = 'localhost';
	$GLOBALS['DBHOST_USER'] = '*****';
	$GLOBALS['DBHOST_PASSWORD'] = '***********';
	$GLOBALS['DBHOST_DBNAME'] = 'honda';
	$GLOBALS['DBHOST_TBL_PREFIX'] = 'forum_';
	$GLOBALS['FUD_SMTP_SERVER'] = 'smtp.*********.co.uk';
	$GLOBALS['FUD_SMTP_PORT'] = 25;
	$GLOBALS['FUD_SMTP_TIMEOUT'] = 10;
	$GLOBALS['FUD_SMTP_LOGIN'] = '********@*********.co.UK';
	$GLOBALS['FUD_SMTP_PASS'] = '*********';
	$GLOBALS['PRIVATE_ATTACHMENTS'] = 1;
	$GLOBALS['PRIVATE_ATTACH_SIZE'] = 150000;
	$GLOBALS['MAX_PMSG_FLDR_SIZE'] = 30000;
	$GLOBALS['MAX_PMSG_FLDR_SIZE_PM'] = 1000000;
	$GLOBALS['MAX_PMSG_FLDR_SIZE_AD'] = 1000000;
	$GLOBALS['FORUM_IMG_CNT_SIG'] = 1;
	$GLOBALS['FORUM_SIG_ML'] = 400;
	$GLOBALS['FUD_OPT_4']	= 7;
	$GLOBALS['DBHOST_SLAVE_HOST']	= '';
	$GLOBALS['ADMIN_EMAIL'] = '********@*********.co.UK';
	$GLOBALS['POSTS_PER_PAGE'] = 20;
	$GLOBALS['THREADS_PER_PAGE'] = 40;
	$GLOBALS['WORD_WRAP'] = 60;
	$GLOBALS['FLOOD_CHECK_TIME'] = 60;
	$GLOBALS['MOD_FIRST_N_POSTS'] = 0;
	$GLOBALS['POST_MIN_LEN'] = 0;
	$GLOBALS['POSTS_BEFORE_LINKS'] = 0;
	$GLOBALS['SERVER_TZ'] = 'Europe/London';
	$GLOBALS['MEMBERS_PER_PAGE'] = 40;
	$GLOBALS['THREAD_MSG_PAGER'] = 5;
	$GLOBALS['GENERAL_PAGER_COUNT'] = 15;
	$GLOBALS['EDIT_TIME_LIMIT'] = 15;
	$GLOBALS['LOGEDIN_TIMEOUT'] = 10;
	$GLOBALS['MAX_IMAGE_COUNT'] = 15;
	$GLOBALS['NOTIFY_FROM'] = '********@*********.co.UK';
	$GLOBALS['ANON_NICK'] = 'unregistered user';
	$GLOBALS['MAX_LOGIN_SHOW'] = 25;
	$GLOBALS['MAX_LOCATION_SHOW'] = 25;
	$GLOBALS['UNCONF_USER_EXPIRY'] = 7;
	$GLOBALS['MOVED_THR_PTR_EXPIRY'] = 0;
	$GLOBALS['DATA_DIR'] = '/var/www/honda-forums.com/honda_FUDforum/';
	$GLOBALS['WWW_ROOT_DISK'] = '/var/www/honda-forums.com/html/';
	$GLOBALS['SHOW_N_MODS'] = 0;
	$GLOBALS['MAX_SMILIES_SHOWN'] = 17;
	$GLOBALS['POLLS_PER_PAGE'] = 40;
	$GLOBALS['TREE_THREADS_MAX_DEPTH'] = 15;
	$GLOBALS['TREE_THREADS_MAX_SUBJ_LEN'] = 75;
	$GLOBALS['REG_TIME_LIMIT'] = 30;
	$GLOBALS['SEARCH_CACHE_EXPIRY'] = 172800;
	$GLOBALS['STATS_CACHE_AGE'] = 600;
	$GLOBALS['POST_ICONS_PER_ROW'] = 9;
	$GLOBALS['MAX_LOGGEDIN_USERS'] = 25;
	$GLOBALS['PHP_COMPRESSION_LEVEL'] = 9;
	$GLOBALS['MNAV_MAX_DATE'] = 31;
	$GLOBALS['MNAV_MAX_LEN'] = 256;
	$GLOBALS['FEED_AUTH_ID'] = 0;
	$GLOBALS['FEED_MAX_N_RESULTS'] = 10;
	$GLOBALS['FEED_CACHE_AGE'] = 600;
	$GLOBALS['PDF_PAGE'] = 'A4';
	$GLOBALS['PDF_WMARGIN'] = 15;
	$GLOBALS['PDF_HMARGIN'] = 15;
	$GLOBALS['PDF_MAX_CPU'] = 60;
	$GLOBALS['FUD_WHOIS_SERVER'] = 'whois.arin.net';
	$GLOBALS['MIN_TIME_BETWEEN_LOGIN'] = 10;
	$GLOBALS['PHP_CLI'] = '/usr/local/bin/php';
	$GLOBALS['FUD_OPT_2'] = 2139846526;
	$GLOBALS['FUD_OPT_1'] = 1633613599;
	$GLOBALS['FUD_OPT_3'] = 114762848;
	$GLOBALS['INCLUDE'] = '/var/www/honda-forums.com/honda_FUDforum/include/';
	$GLOBALS['ERROR_PATH'] = '/var/www/honda-forums.com/honda_FUDforum/errors/';
	$GLOBALS['MSG_STORE_DIR'] = '/var/www/honda-forums.com/honda_FUDforum/messages/';
	$GLOBALS['TMP'] = '/var/www/honda-forums.com/honda_FUDforum/tmp/';
	$GLOBALS['FILE_STORE'] = '/var/www/honda-forums.com/honda_FUDforum/files/';
	$GLOBALS['FORUM_SETTINGS_PATH'] = '/var/www/honda-forums.com/honda_FUDforum/cache/';
	$GLOBALS['PLUGIN_PATH'] = '/var/www/honda-forums.com/honda_FUDforum/plugins/';
	$GLOBALS['DBHOST_DBTYPE'] = 'mysql';
/* DO NOT EDIT FILE BEYOND THIS POINT UNLESS YOU KNOW WHAT YOU ARE DOING */
	require($INCLUDE.'core.inc');
?>


Question is what can I do if our forum is a bit of a mix of 2.x and 3.x given its now 3.0.4 or is it quite normal for a forum which did start out many years ago as at least 2.x (maybe even 1.x) and is now on v3.0.4 to still have forum_ table prefixes?

For Info the forum db size is 440MB (after a bit of pruning) and the resulting FUDforum_12_04_2013_12_12.fud.gz backup file 880MB (I had to resort to unticking the compress backup during the backups as the resulting .gz file was 'broken' when I downloaded it to my PC and tested unzipping with 7z it but thats another issue now resolved by the untick unless the .fud file is still possibly broken)

[Updated on: Fri, 12 April 2013 12:21]

Report message to a moderator

Re: Import Issues to new Host (v3.0.4) [message #168291 is a reply to message #168289] Fri, 12 April 2013 13:12 Go to previous messageGo to next message
Kermit is currently offline  Kermit   United Kingdom
Messages: 35
Registered: November 2004
Karma: 0
Member
I've now tried the same backup import on the proper new host and get this

Cleanup old files...
Restore files from backup...
Drop and recreate database tables...
Start loading database tables...
Process table fud30_action_log:
...12 rows loaded.
Process table fud30_ann_forums:
...3 rows loaded.
Process table fud30_announce:
...3 rows loaded.
Process table fud30_attach:
...670 rows loaded.
Process table fud30_bookmarks:
...25 rows loaded.
Process table fud30_buddy:
...259 rows loaded.

******snip*******

Process table fud30_mime:
...43 rows loaded.
Process table fud30_mod:
...116 rows loaded.
Process table fud30_msg:
 ...10000 rows

Fatal error: Uncaught exception 'Exception' with message '(/home/hondafor/fuddata/include/theme/default/db.inc:112<br /> /home/hondafor/public_html/forum/adm/admimport.php:186<br /> ) 1064: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '>' at line 1<br /> Query: INSERT INTO fud30_msg VALUES ('12803','1450','41','12216','81.128.199.63',NULL,'1074945292','0','0',NULL,'Re: Another 3 points','0','0','2084114','1078','350000','0','0','0',NULL,NULL,NULL,'1','1','gb','UNITED KINGDOM'),('12804','1403','41','12155','81.128.199.63',NULL,'1074945793','0','0',NULL,'Re: Job shopping','0','0','2085192','706','350000','0','0','0',NULL,NULL,NULL,'1','1','gb','UNITED KINGDOM'),('12805','1457','41','12176','81.128.199.63',NULL,'1074946619','0','0',NULL,'Re: Norwich Union - how do they survive?','0','0','2085898','764','350000','0','0','0',NULL,NULL,NULL,'1','1','gb','UNITED KINGDOM'),('12806','1422','41','12179','81.128.199.63',NULL,'1074946737','0','0',NULL,'Re: Mystery phrases','0','0','2086662','106','350000','0','0','0',NULL,NULL,NULL,'1','1','gb','UNITED KINGDOM'),('12807','1496','41','12798','81.128.199.63',NULL,'1074947129','0','0',NULL,'Re: Security Locks and 

many pages of out put like this then....

 I''m sick of it....'&lt;br /&gt;<br /> _POST: array ( 'SQ' =&gt; '6b2f44b24f892edcd05a51ef20530d62', 'path' =&gt; '/home/hondafor/fuddata/tmp/FUDforum_12_04_2013_12_12.fud', 'skipsearch' =&gt; 'y', 'btn_submit' =&gt; 'Import Data', )<br /> Database version: 5.5.30-cll<br /> [Referring Page] http://www.honda-forums.com/forum/adm/admimport.php?&amp;SQ=6b2f44b24f892edcd05a51ef20530d62<br /> ' in /home/hondafor/fuddata/include/core.inc:248 Stack trace: #0 /home/hondafor/fuddata/include/theme/default/db.inc(112): fud_sql_error_handler('INSERT INTO fud...', 'You have an err...', 1064, '5.5.30-cll') #1 /home/hondafor/public_html/forum/adm/admimport.php(186): q('INSERT INTO fud...') #2 {main} thrown in /home/hondafor/fuddata/include/core.inc on line 248


so different issues to when trying to restore to my local PC.

New Host Versions
FUDforum: 3.0.4
PHP: 5.4.12
Database: mysql 5.5.30-cll (mysql)
Operating system: Linux 3.2.40-grsec

Current Host Versions

FUDforum: 3.0.4
PHP: 5.2.6-1+lenny16
Database: mysql 5.0.51a-24+lenny5-log (mysql)
Operating system: Linux 2.6.32-5-xen-amd64

[Updated on: Fri, 12 April 2013 14:36]

Report message to a moderator

Re: Import Issues to new Host (v3.0.4) [message #168295 is a reply to message #168291] Sat, 13 April 2013 18:35 Go to previous messageGo to next message
Kermit is currently offline  Kermit   United Kingdom
Messages: 35
Registered: November 2004
Karma: 0
Member
Can no one with better knowledge than me think of anything I could try?
Re: Import Issues to new Host (v3.0.4) [message #168297 is a reply to message #168295] Sat, 13 April 2013 20:19 Go to previous messageGo to next message
naudefj is currently offline  naudefj   
Messages: 3772
Registered: December 2004
Karma: 28
Senior Member
Administrator
Core Developer
From your message it's impossible to tell what went wrong. Suggested next steps:

1. Mail me an admin userid/password to the site to debug (preferred)
2. Alternatively, attach complete output.
Re: Import Issues to new Host (v3.0.4) [message #168298 is a reply to message #168289] Sat, 13 April 2013 22:20 Go to previous messageGo to next message
Kermit is currently offline  Kermit   United Kingdom
Messages: 35
Registered: November 2004
Karma: 0
Member
Hi, thanks for the offer. The current site doesn't have a domain yet (transfer pending till we sort this import issue) but that can be worked around for logging into the empty site when I've been testing by adding entries to hosts file for the domain and the new host servers IP.

I most probably sort you a login shortly (to the new host with backup file present?) but right now I'mm in the process of ruling out file corruption when transferring the .gz file from the current host to my pc.

I noticed last night when I tick the box for compression when making the forum dump and while the dump each time is showing as successful when I've downloaded it to my pc and tested unzipping it, 7zip was telling me the "file is broken" so I had been thinking along the lines of the gz compression being broken and so started doing backups with compression unticked but now I'm unsure of this as I end up with a larger file (800MB vs 500mb) but its still inside a .gz container and of course if http file transfer of the backups is the issue its just as likely to be corrupting an uncompressed one.

I'm now testing getting round this given I don't have ftp access to the current host as I spotted the ftp backup plugin on the live forum and so have now set this to ftp backups to an ftp server I have and am in the process of downloading it to my pc to see if this unzips ok. Hopefully this will confirm if the http file transfer has corrupting the dump file irrespective of compression or not.

Fingers crossed a test unzip of this compressed dump isn't broken and if it unzips ok, I'll try another restore on my local pc copy of fud. Will report back soon.

Quick question if you see this before I report back. My local PC has an empty v3.0.4 waiting for the restore. The new hosts empty fudforum is 3.0.4.1 as their software includes the latest fudforum on a large selection of possible systems to install so last time around reinstalling the forum I took their easy install route. I could however dump that and grab 3.0.4 and install that instead or would 3.0.4.1 be compatible with a dump from 3.0.4?

[Updated on: Sat, 13 April 2013 22:54]

Report message to a moderator

Re: Import Issues to new Host (v3.0.4) [message #168301 is a reply to message #168298] Sun, 14 April 2013 06:45 Go to previous messageGo to next message
naudefj is currently offline  naudefj   
Messages: 3772
Registered: December 2004
Karma: 28
Senior Member
Administrator
Core Developer
> to the new host with backup file present?

Yes, I somehow need to be able to reproduce the problem.

> I could however dump that and grab 3.0.4 and install that instead or would 3.0.4.1 be compatible with a dump from 3.0.4?

As far as I understand FUDform 3.0.4 & 3.0.4.1 are compatible with each other.
Re: Import Issues to new Host (v3.0.4) [message #168308 is a reply to message #168301] Sun, 14 April 2013 19:27 Go to previous messageGo to next message
Kermit is currently offline  Kermit   United Kingdom
Messages: 35
Registered: November 2004
Karma: 0
Member
All resolved now, it was an issue with transferring the 500-800MB backup of the forum via http using a browser. Once transfered with ftp all was good. Thanks all the same although one thing that might be worth thinking about in a future release would be some sort of integrity check on the .gz (or .fud) file prior to actually restoring the data it if thats possible?

http://honda-forums.com/forum/index.php <-- new host


[Updated on: Sun, 14 April 2013 19:28]

Report message to a moderator

Re: Import Issues to new Host (v3.0.4) [message #168315 is a reply to message #168308] Mon, 15 April 2013 19:50 Go to previous messageGo to next message
naudefj is currently offline  naudefj   
Messages: 3772
Registered: December 2004
Karma: 28
Senior Member
Administrator
Core Developer
Thanks for the feedback. Future versions will check backup integrity before restoring. For details, see patch at http://fudforum.svn.sourceforge.net/fudforum/?rev=5604&view=rev
Re: Import Issues to new Host (v3.0.4) [message #168327 is a reply to message #168289] Wed, 17 April 2013 15:59 Go to previous message
Kermit is currently offline  Kermit   United Kingdom
Messages: 35
Registered: November 2004
Karma: 0
Member
Brilliant you have that written and ready to go with next release so quickly.

Forums have there uses Very Happy
  Switch to threaded view of this topic Create a new topic Submit Reply
Previous Topic: how to mark a single post
Next Topic: Individual Forum Analytics
Goto Forum:
  

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ]

Current Time: Sun Dec 22 11:41:27 GMT 2024

Total time taken to generate the page: 0.02493 seconds