FUDforum
Fast Uncompromising Discussions. FUDforum will get your users talking.

Home » FUDforum Development » Converters » FUDforum Migration Assistant (New converter framework.)  () 2 Votes
Show: Today's Messages :: Unread Messages :: Show Polls :: Message Navigator
| Subscribe to topic | Bookmark topic 
Switch to threaded view of this topic Create a new topic Submit Reply
icon12.gif  FUDforum Migration Assistant [message #164706] Wed, 02 March 2011 05:34 Go to next message
naudefj is currently offline  naudefj   South Africa
Messages: 3624
Registered: December 2004
Karma: 17
Senior Member
Administrator
Core Developer
remove from buddy list
ignore all messages by this user
We've reworked the FUDforum converter script. Please let us know if you can help us to test conversion from any of the below forums to FUDforum:

* Advanced Electron
* bbPress
* Drupal7 forum
* FluxBB
* IceBB
* MyBB
* Phorum
* phpBB3
* phpBB2
* PunBB
* Quicksilver Forums (QSF)
* Simple Machines (SMF)
* TairoBB
* UBB.threads
* Unclassified NewsBoard (UNB)
* Vanilla2
* XMB

The new converter can be downloaded from
https://sourceforge.net/projects/fudforum/files/ (MigrationAssistant.zip).

Note that we are not interested in converting old forums (not as part of this initiative anyway). These converters will only migrate the latest versions of these forum systems to FUDforum.

Any others we should add?

Best regards.

Frank
Re: FUDforum Migration Assistant [message #164828 is a reply to message #164706] Thu, 17 March 2011 03:42 Go to previous messageGo to next message
simonlnu is currently offline  simonlnu   Canada
Messages: 19
Registered: March 2011
Location: Tiohtiake
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
Was wondering if there was any progress on having some postgres support with the assistant?

I would really rather not dump my forum db then the PITA task of converting to mysql, then adding it to a mysql install, just so it would work.

I tried hacking on it very cursorily earlier, and failed Wink. I may try again soon-ish, then submit patches if i get a working one.
Re: FUDforum Migration Assistant [message #164829 is a reply to message #164828] Thu, 17 March 2011 06:01 Go to previous messageGo to next message
naudefj is currently offline  naudefj   South Africa
Messages: 3624
Registered: December 2004
Karma: 17
Senior Member
Administrator
Core Developer
remove from buddy list
ignore all messages by this user
I'll add PostgreSQL support and commit it later today or tomorrow.

From what forum are you converting?
Re: FUDforum Migration Assistant [message #164830 is a reply to message #164829] Thu, 17 March 2011 06:04 Go to previous messageGo to next message
simonlnu is currently offline  simonlnu   Canada
Messages: 19
Registered: March 2011
Location: Tiohtiake
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
phpbb3 v3.0.8, the latest.

i forgot my manners... thank you Smile.

[Updated on: Thu, 17 March 2011 06:05]

Report message to a moderator

Re: FUDforum Migration Assistant [message #164832 is a reply to message #164830] Thu, 17 March 2011 09:54 Go to previous messageGo to next message
simonlnu is currently offline  simonlnu   Canada
Messages: 19
Registered: March 2011
Location: Tiohtiake
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
Heh, I just check out trunk, and see the work so far. I'll give that a run. I was working reeeally tired when I tried... not conducive to fixing bugs in a mod you did Wink.
Re: FUDforum Migration Assistant [message #164833 is a reply to message #164832] Thu, 17 March 2011 11:23 Go to previous messageGo to next message
simonlnu is currently offline  simonlnu   Canada
Messages: 19
Registered: March 2011
Location: Tiohtiake
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
well, so far, I've had to modify two columns: one in the _users table, salt and the other in _smiley, code ; however I don't know if the latter is valid, since it may have inserted semi-bogus data.

EDIT: it is, just that a few of the smilies in phpbb was longer once the tildes (~) were inserted.

EDIT: Also had to remove the 'Alias' data, otherwise I was getting dupes, and violating UNIQUE constraints.

EDIT: and on the other hand, it causes problems of its own, doing that Wink.

[Updated on: Thu, 17 March 2011 11:33]

Report message to a moderator

Re: FUDforum Migration Assistant [message #164834 is a reply to message #164833] Thu, 17 March 2011 13:37 Go to previous messageGo to next message
naudefj is currently offline  naudefj   South Africa
Messages: 3624
Registered: December 2004
Karma: 17
Senior Member
Administrator
Core Developer
remove from buddy list
ignore all messages by this user
Please see
http://fudforum.svn.sourceforge.net/fudforum/?rev=5194&view=rev
for PostgreSQL support and some other fixes.

The problem with salt in the users table was solved (I hope).

The '~' in the smiley codes are valid. FUDforum uses a '~' as separator between codes.

Can you please post more details about the 'alias' problem? I would be able to solve it if I can somehow reproduce the problem.

Thanks for helping us to resolve these issues!
Re: FUDforum Migration Assistant [message #164835 is a reply to message #164834] Thu, 17 March 2011 18:22 Go to previous messageGo to next message
simonlnu is currently offline  simonlnu   Canada
Messages: 19
Registered: March 2011
Location: Tiohtiake
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
The alias thing was something on my part, at least in part; has to do with the bot users not necessarily having the right data. I got it mostly working eventually, but it chokes on some posts.

anonymised:

convert.php:364
 conversionmaps/phpBB3.map:144
 convert.php:753
 ) 42601: ERROR: syntax error at or near "1" LINE 1: 1 ^
 Query: 1
 _POST: array ( 'from' => 'phpBB3', 'cfg' => '$PHPBB3_FORUM_DIR', 'verbose' => '1', 'submit' => 'Start conversion', )
 Database version: 9.0.3
 [Referring Page] http://site.tld/forumlocation/convert.php


the log is more informative, basically a value ends up being null, so there's a SQL syntax error

STATEMENT:  INSERT INTO _thread (
            id, forum_id, root_msg_id, views, replies, thread_opt, orderexpiry
            ) VALUES(
                784,
                ,
                1135,
                6,
                0,
                0,
                0)

Re: FUDforum Migration Assistant [message #164836 is a reply to message #164835] Thu, 17 March 2011 18:23 Go to previous messageGo to next message
simonlnu is currently offline  simonlnu   Canada
Messages: 19
Registered: March 2011
Location: Tiohtiake
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
i'll post a patch shortly for the changes i did (you probably won't want to keep them all, i can guarantee it Wink
Re: FUDforum Migration Assistant [message #164838 is a reply to message #164836] Thu, 17 March 2011 18:32 Go to previous messageGo to next message
simonlnu is currently offline  simonlnu   Canada
Messages: 19
Registered: March 2011
Location: Tiohtiake
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
[PATCH] svn original compared to mine.

now i gotta clean up the fud database, hehe

[Updated on: Thu, 17 March 2011 18:32]

Report message to a moderator

Re: FUDforum Migration Assistant [message #164842 is a reply to message #164838] Thu, 17 March 2011 19:49 Go to previous messageGo to next message
simonlnu is currently offline  simonlnu   Canada
Messages: 19
Registered: March 2011
Location: Tiohtiake
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
found the original problem with alias, but then choked later with the bot users

2011-03-18 03:09:35 UTC 192.168.1.1(30164) (user@dbname): ERROR:  invalid input syntax for integer: "" at character 557
2011-03-18 03:09:35 UTC 192.168.1.1(30164) (user@dbname): STATEMENT:  INSERT INTO fud_users
            (id, login, alias, name, passwd, salt, last_visit, last_read, join_date,
            email, home_page, location, time_zone, sig, avatar, avatar_loc,
            icq, aim, yahoo, msnm, users_opt, theme)
            VALUES (
            2,
-- I Inserted the PHP code here for clarity and anonymity
	'. _esc($user['login']) .',
	'. _esc(htmlspecialchars($user['login'])) .',
	'. _esc($user['name']) .', 
                '',
                '',
                '',
                'hashed_password',
                'hash',
                1272115119,
                1272115119,
                1194157086,
                'admin(at)emailaddress(dot)tld',
                '',
                '',
                '-5.00',
                '<font size="150"><b><font color="#FF0000">If you have a problem with the board, contact me.</font></b></font>',
                0,
                '',
                '',
                '',
                '',
                '',
                5436407,
                2
                )
Re: FUDforum Migration Assistant [message #164843 is a reply to message #164838] Thu, 17 March 2011 23:11 Go to previous messageGo to next message
naudefj is currently offline  naudefj   South Africa
Messages: 3624
Registered: December 2004
Karma: 17
Senior Member
Administrator
Core Developer
remove from buddy list
ignore all messages by this user
simonlnu wrote:
now i gotta clean up the fud database, hehe


No need to clean up anything. Just re-run the converter.

simonlnu wrote:
STATEMENT: INSERT INTO _thread ( id, forum_id, root_msg_id, views, replies, thread_opt, orderexpiry ) VALUES( 784, ,


A thread that's not in a forum? I guess we can simply ignore these.
Re: FUDforum Migration Assistant [message #164844 is a reply to message #164843] Fri, 18 March 2011 00:26 Go to previous messageGo to next message
simonlnu is currently offline  simonlnu   Canada
Messages: 19
Registered: March 2011
Location: Tiohtiake
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
it's that non value there that make it choke, the "784, ," thing.

EDIT: in the patch, i do some weird stuff to get around the empty id. that's probably what made the topics and such all crazy (see my later post from a few minutes ago [07:54 local, 11:54 UTC])

[Updated on: Fri, 18 March 2011 04:29]

Report message to a moderator

Re: FUDforum Migration Assistant [message #164845 is a reply to message #164844] Fri, 18 March 2011 00:58 Go to previous messageGo to next message
simonlnu is currently offline  simonlnu   Canada
Messages: 19
Registered: March 2011
Location: Tiohtiake
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
got it

will post patch shortly

[Updated on: Fri, 18 March 2011 01:00]

Report message to a moderator

Re: FUDforum Migration Assistant [message #164851 is a reply to message #164845] Fri, 18 March 2011 03:20 Go to previous messageGo to next message
simonlnu is currently offline  simonlnu   Canada
Messages: 19
Registered: March 2011
Location: Tiohtiake
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
however, i can't login... trying to figure it out
Re: FUDforum Migration Assistant [message #164852 is a reply to message #164851] Fri, 18 March 2011 04:27 Go to previous messageGo to next message
simonlnu is currently offline  simonlnu   Canada
Messages: 19
Registered: March 2011
Location: Tiohtiake
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
well, reset pass, all's good. one thing i note once i rebuilt everything... the categories, topics are screwed up.. topics/posts aren't with the categories they belong to. PM me if you want to see, i'll post a link to both the original and the new forum

Edit: more i think about it, the more i think it is that funky stuff i did in the patch (#2)

[Updated on: Fri, 18 March 2011 05:05]

Report message to a moderator

Re: FUDforum Migration Assistant [message #164855 is a reply to message #164852] Fri, 18 March 2011 14:08 Go to previous messageGo to next message
naudefj is currently offline  naudefj   South Africa
Messages: 3624
Registered: December 2004
Karma: 17
Senior Member
Administrator
Core Developer
remove from buddy list
ignore all messages by this user
An updated MigrationAssistant.zip is now available at
https://sourceforge.net/projects/fudforum/files/
Re: FUDforum Migration Assistant [message #164856 is a reply to message #164855] Fri, 18 March 2011 15:55 Go to previous messageGo to next message
simonlnu is currently offline  simonlnu   Canada
Messages: 19
Registered: March 2011
Location: Tiohtiake
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
good job naudefj, works nicely Very Happy
Re: FUDforum Migration Assistant [message #164857 is a reply to message #164856] Fri, 18 March 2011 16:38 Go to previous messageGo to next message
simonlnu is currently offline  simonlnu   Canada
Messages: 19
Registered: March 2011
Location: Tiohtiake
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
I increased the size of the ip_addr column to 40 for IPv6 addresses in $FUD_PREFIX_msg
Re: FUDforum Migration Assistant [message #165663 is a reply to message #164706] Sun, 31 July 2011 21:21 Go to previous messageGo to next message
ShineOn is currently offline  ShineOn   United States
Messages: 53
Registered: July 2011
Karma: 1
Member
add to buddy list
ignore all messages by this user
I have been trying to get the latest migration assistant to convert phpbb3 and keep getting stuck on a couple of things.

Running php5.2.17, Apache 2.2.19, MySQL 5.5.14 on WinXPProSP3 (just for test/dev - I use Linux for production)

1) The phpBB3 config.php uses $dbport variable. The connect script in the migration assistant apparently does not use $dbport but either assumes that the port will be read from the services file or php.ini, or assumes it will use the socket instead. Even though the port is defined in services (mysql-tcp) and the port is set in the mysqli section of php.ini, it doesn't seem to use it.

The only way I can get the convert.php to connect is by commenting out the $dbport setting in phpbb3's config.php and adding the port to the $dbhost variable ('localhost:3306'), and when I do that, the convert.php script will connect to the phpbb3 database, but that breaks phpbb3's access to the database.

2) The source phpBB3's data has some utf8 character-set data. It has occurred for me in the location field of the user table, but if it happens there I expect it would happen elsewhere as it encounters utf8 characters in other tables/fields as the conversion progresses past the user import. When it does, it fails to continue, giving this error (confidential info replaced with strings of x'es):
E:\halftb\xxxx\FUDforum_3.0.2\fudforum\convert.php:751
) 1366: Incorrect string value: '\xEDa)' for column 'location' at row 1
Query: INSERT INTO fud30_users (id, login, alias, name, passwd, salt, last_visit, last_read, join_date, email, home_page, location, time_zone, sig, avatar, avatar_loc, icq, aim, yahoo, msnm, users_opt, theme) VALUES ( 1752, 'gxxxx7', 'gxxxx7', 'gxxxx7', 'xxxxxxxxxxxxxxxxxxxxxxxxxx..xxxxxx', '', 1205384388, 1205384388, 1158515359, 'gxxxx7(at)hotmail(dot)com', '', 'Caracas (while in vacations Lecher´┐Ża)', '0.00', '', 0, '<img src=\"h t t p : / / testpc.xxxxx/fud2//images/custom_avatars/3989bd335ab62e53c32b638e45a83adb_1752.jpg\" alt=\"\" width=\"100\" height=\"100\" />', 0, '', '', '', 4387830, 1 )


WRT #1, I can deal with working around the change needed to make the connect work, but it is something you should add to your buglist. The different method phpBB3 uses, even if it's non-standard, shouldn't make the conversion fail; the difference should be handled in the phpbb3 conversion map or something, if by no other means, at least by concatenating $dbhost .':'. $dbport if $dbport is set, when building your connect string.

WRT #2, is there a way to make it accept UTF8 data? Is this a function of how the database or tables were defined in MySQL by the FUDforum 3.0.2 installer, or is it in a globals file or something, or is there a function within the convert.php that should be modified to add logic to convert the UTF8 characters?
Re: FUDforum Migration Assistant [message #165664 is a reply to message #165663] Mon, 01 August 2011 12:46 Go to previous messageGo to next message
naudefj is currently offline  naudefj   South Africa
Messages: 3624
Registered: December 2004
Karma: 17
Senior Member
Administrator
Core Developer
remove from buddy list
ignore all messages by this user
#1 will be fixed in the next release.

For #2, can you create the DB as UTF-8? Alternatively, run the the MySQL Charset Converter (in ACP) to convert all tables to UTF-8.
Re: FUDforum Migration Assistant [message #165675 is a reply to message #165664] Thu, 04 August 2011 00:42 Go to previous messageGo to next message
ShineOn is currently offline  ShineOn   United States
Messages: 53
Registered: July 2011
Karma: 1
Member
add to buddy list
ignore all messages by this user
I tried the SVN of the migration assistant, against 3.03RC1, and had reasonable success a) with the connect to the phpBB3 database, and 2) with the avatar, smilies and user imports.

It choked after importing the topics, when trying to import the messages. The subject field in phpbb3 is varchar 255 while in FUD the subject field is vc 100. Eight of the messages (out of thousands) have more than 100 characters.

Any chance of there being some provision for this? I noticed the same difference exists in the PM subject line field; again phpBB3's is 255 while FUDforum's is 100.

If I change the field size in the FUDforum database to fit any data coming from phpBB3 will that break functionality?

I could change the subject line to fit 100 characters, manually, for those phpBB3 fields using more than 100, but I really hate the idea of my users losing any of their content because of limitations in the (hopefully) new forum software.
Re: FUDforum Migration Assistant [message #165677 is a reply to message #165675] Thu, 04 August 2011 01:57 Go to previous messageGo to next message
naudefj is currently offline  naudefj   South Africa
Messages: 3624
Registered: December 2004
Karma: 17
Senior Member
Administrator
Core Developer
remove from buddy list
ignore all messages by this user
ShineOn wrote:
It choked after importing the topics, when trying to import the messages. The subject field in phpbb3 is varchar 255 while in FUD the subject field is vc 100. Eight of the messages (out of thousands) have more than 100 characters.


No, it won't break anything. Go ahead and increase it to 255.

PS: I'll also change FUDforum's default to 255 for the next release (next RC or final 3.0.3).
FUDforum Migration Assistant - worked well on MyBB [message #168877 is a reply to message #165677] Thu, 01 August 2013 13:31 Go to previous message
Parrot
Messages: 32
Registered: July 2013
Location: US
Karma: 1
Member
add to buddy list
ignore all messages by this user
Just used Migration Assistant to import contents of the latest version of MyBB.

Worked perfectly.

Thanks for providing it.

Quick Reply
Formatting Tools:   
  Switch to threaded view of this topic Create a new topic
Previous Topic: PHP-Nuke 7.x Conversion
Goto Forum:
  

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ]

Current Time: Wed Oct 18 05:34:55 EDT 2017

Total time taken to generate the page: 0.00986 seconds