FUDforum
Fast Uncompromising Discussions. FUDforum will get your users talking.

Home » FUDforum Development » Converters » A big messages after migrate from phpbb
Show: Today's Messages :: Unread Messages :: Show Polls :: Message Navigator
| Subscribe to topic | Bookmark topic 
Switch to threaded view of this topic Create a new topic Submit Reply
icon13.gif  A big messages after migrate from phpbb [message #23919] Tue, 05 April 2005 11:23 Go to next message
therion is currently offline  therion   Spain
Messages: 17
Registered: March 2005
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
Hi people,

I'm migrating from PHPBB 2.0.13 to fudforum 2.6.12, and the process was ok, but now i have a big file (1.7 GB), is this ok? is a bug?

This is the file:
1,7G ./FUDforum/messages

Sorry for my english.

Re : A big messages after migrate from phpbb [message #23921 is a reply to message #23919] Tue, 05 April 2005 12:03 Go to previous messageGo to next message
DogManStar is currently offline  DogManStar   France
Messages: 60
Registered: March 2005
Karma: 0
Member
add to buddy list
ignore all messages by this user
It's normal.
All texts from posts are in a flat file. Titles, threads, members are in the database.
I believe 2 Gb is the max, i don't know what happen after, a new messages2 i suppose.

What's your natural language?
Mine is french.


I've seen things you people wouldn't believe. Attack ships on fire off the shoulder of Orion. I watched c-beams ... glitter in the dark near Tanhauser Gate. All those ... moments will be lost ... in time, like tears ... in rain. Time ... to die.

[Updated on: Tue, 05 April 2005 12:04]

Report message to a moderator

Re: Re : A big messages after migrate from phpbb [message #23922 is a reply to message #23921] Tue, 05 April 2005 12:16 Go to previous messageGo to next message
therion is currently offline  therion   Spain
Messages: 17
Registered: March 2005
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
Im from spain.

Are you sure? why is the reason for this?
Re : Re: Re : A big messages after migrate from phpbb [message #23923 is a reply to message #23922] Tue, 05 April 2005 12:24 Go to previous messageGo to next message
DogManStar is currently offline  DogManStar   France
Messages: 60
Registered: March 2005
Karma: 0
Member
add to buddy list
ignore all messages by this user
therion a écrit le mar, 05 avril 2005 18:16

Im from spain.

Are you sure? why is the reason for this?



Yes sure.
If you delete or rename (it's better Very Happy ) this file you'll see your forum with all posts "message empty".
Ilia has chosen to use files to store body posts.
It explain why in an old message in this forum.
I can find this message if you want.
What's the problem?


I've seen things you people wouldn't believe. Attack ships on fire off the shoulder of Orion. I watched c-beams ... glitter in the dark near Tanhauser Gate. All those ... moments will be lost ... in time, like tears ... in rain. Time ... to die.
Re : A big messages after migrate from phpbb [message #23924 is a reply to message #23919] Tue, 05 April 2005 12:28 Go to previous messageGo to next message
DogManStar is currently offline  DogManStar   France
Messages: 60
Registered: March 2005
Karma: 0
Member
add to buddy list
ignore all messages by this user
Here :
http://fudforum.org/forum/index.php?t=msg&goto=10768

About what happen when the file size reach 2 Go :
http://fudforum.org/forum/index.php?t=msg&goto=18749


I've seen things you people wouldn't believe. Attack ships on fire off the shoulder of Orion. I watched c-beams ... glitter in the dark near Tanhauser Gate. All those ... moments will be lost ... in time, like tears ... in rain. Time ... to die.

[Updated on: Tue, 05 April 2005 12:36]

Report message to a moderator

Re: A big messages after migrate from phpbb [message #23925 is a reply to message #23919] Tue, 05 April 2005 13:55 Go to previous messageGo to next message
LastQuark   United States
Messages: 12
Registered: August 2003
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
This is a feature that caught my eye into fudforum. It speeds up all things. If you wonder why accessing fudforum is faster than any other message boards, it is because of this. Just make sure to back-up this file also whenever you do backups.

 

Re: A big messages after migrate from phpbb [message #23930 is a reply to message #23925] Tue, 05 April 2005 15:47 Go to previous messageGo to next message
therion is currently offline  therion   Spain
Messages: 17
Registered: March 2005
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
It is curious that an plain file is faster than a database.

Then, ¿why the other things are ina a database?
Re : A big messages after migrate from phpbb [message #23932 is a reply to message #23919] Tue, 05 April 2005 16:20 Go to previous messageGo to next message
DogManStar is currently offline  DogManStar   France
Messages: 60
Registered: March 2005
Karma: 0
Member
add to buddy list
ignore all messages by this user
To be honest i don't know.
Perhaps it's easiest to develop...
After testing for me i can't say it's fastest and easiest to backup. Before i had to backup about 140 Mo of a mysql database, now one file and a .sql of 28 Mo...


I've seen things you people wouldn't believe. Attack ships on fire off the shoulder of Orion. I watched c-beams ... glitter in the dark near Tanhauser Gate. All those ... moments will be lost ... in time, like tears ... in rain. Time ... to die.
Re: A big messages after migrate from phpbb [message #23934 is a reply to message #23919] Tue, 05 April 2005 16:53 Go to previous messageGo to next message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
add to buddy list
ignore all messages by this user
well the path you've specified is actually the directory that probably has 2 files, msg_1 and private storing the bodies of normal & private messages.

If you have a large forum that is perfectly normal.


FUDforum Core Developer
Re: Re : A big messages after migrate from phpbb [message #23935 is a reply to message #23921] Tue, 05 April 2005 16:54 Go to previous messageGo to next message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
add to buddy list
ignore all messages by this user
DogManStar wrote on Tue, 05 April 2005 12:03

It's normal.
All texts from posts are in a flat file. Titles, threads, members are in the database.
I believe 2 Gb is the max, i don't know what happen after, a new messages2 i suppose.

What's your natural language?
Mine is french.


After the forum reaches 2 gigabytes, it'll start msg_2 Smile


FUDforum Core Developer
Re: A big messages after migrate from phpbb [message #23940 is a reply to message #23919] Tue, 05 April 2005 17:41 Go to previous messageGo to next message
therion is currently offline  therion   Spain
Messages: 17
Registered: March 2005
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
if i delete one post or thread, the forum refill this space with zeros or there are a indexing to ajust database with file?
Re: A big messages after migrate from phpbb [message #23941 is a reply to message #23940] Tue, 05 April 2005 17:51 Go to previous messageGo to next message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
add to buddy list
ignore all messages by this user
The forum won't "compact" the file, as that is a very slow process. If you wish to compact the file, there is an admin control panel explicity for that purpose.

FUDforum Core Developer
Re: A big messages after migrate from phpbb [message #23942 is a reply to message #23941] Tue, 05 April 2005 17:59 Go to previous messageGo to next message
therion is currently offline  therion   Spain
Messages: 17
Registered: March 2005
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
This means that only delete on database the poiner to this post text at file?
Re: A big messages after migrate from phpbb [message #23943 is a reply to message #23942] Tue, 05 April 2005 18:01 Go to previous messageGo to next message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
add to buddy list
ignore all messages by this user
yeah, when you delete the message the database references to it are removed, but the body remains inside the message file until the compactor is run.

FUDforum Core Developer
Re: A big messages after migrate from phpbb [message #23944 is a reply to message #23943] Tue, 05 April 2005 18:06 Go to previous messageGo to next message
therion is currently offline  therion   Spain
Messages: 17
Registered: March 2005
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
there are an shell compactor? With big forums make it in web is a hell Twisted Evil
Re: A big messages after migrate from phpbb [message #23945 is a reply to message #23944] Tue, 05 April 2005 18:37 Go to previous messageGo to next message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
add to buddy list
ignore all messages by this user
You can uncomment a line inside the compactor script that will allow you to run it via command line. The instructions can be found at the top of the script.

FUDforum Core Developer
icon14.gif  Re: A big messages after migrate from phpbb [message #23946 is a reply to message #23945] Tue, 05 April 2005 18:41 Go to previous messageGo to next message
therion is currently offline  therion   Spain
Messages: 17
Registered: March 2005
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
A lot of thanks, tomorrow i probe it, and comment the result Razz

icon13.gif  Re: A big messages after migrate from phpbb [message #23968 is a reply to message #23946] Wed, 06 April 2005 09:17 Go to previous messageGo to next message
therion is currently offline  therion   Spain
Messages: 17
Registered: March 2005
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
I am trying to do it again, because after run the compactor.php a lot of post are lost ...
Re: A big messages after migrate from phpbb [message #23970 is a reply to message #23968] Wed, 06 April 2005 10:26 Go to previous messageGo to next message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
add to buddy list
ignore all messages by this user
What do you mean lost, did the compactor run the completion or was it interrupted?

FUDforum Core Developer
Re: A big messages after migrate from phpbb [message #23974 is a reply to message #23970] Wed, 06 April 2005 10:55 Go to previous messageGo to next message
therion is currently offline  therion   Spain
Messages: 17
Registered: March 2005
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
The compactor finnished ok, but over 50% of post are missing in action . it can be that script has done something bad Evil or Very Mad

I do it again and the same, i think than is a very larger forum for the converter script ...

[Updated on: Wed, 06 April 2005 11:14]

Report message to a moderator

Re: A big messages after migrate from phpbb [message #23976 is a reply to message #23919] Wed, 06 April 2005 11:55 Go to previous messageGo to next message
therion is currently offline  therion   Spain
Messages: 17
Registered: March 2005
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
The users deleted have all 0 messages, this is a 'feature' i think Confused

Re: A big messages after migrate from phpbb [message #23981 is a reply to message #23976] Wed, 06 April 2005 19:14 Go to previous messageGo to next message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
add to buddy list
ignore all messages by this user
Compactor does not remove any messages, but rather is re-creates the message storage file, so there is no NULL space, which is caused by deleted & edited messages.

The compact.php script has not a single DELETE query or delete function, so it can hardly be responsible for message removal.

After running the import script, did you run the consistency checker?


FUDforum Core Developer
Re: A big messages after migrate from phpbb [message #23994 is a reply to message #23981] Thu, 07 April 2005 04:46 Go to previous messageGo to next message
therion is currently offline  therion   Spain
Messages: 17
Registered: March 2005
Karma: 0
Junior Member
add to buddy list
ignore all messages by this user
The problem is not the compactor. when script finishes migrating the users are all. But when he finishes of everything, the users disappear, some control that does in the end...
Re: A big messages after migrate from phpbb [message #24004 is a reply to message #23994] Thu, 07 April 2005 17:20 Go to previous message
Ilia is currently offline  Ilia   Canada
Messages: 13241
Registered: January 2002
Karma: 0
Senior Member
Administrator
Core Developer
add to buddy list
ignore all messages by this user
Did you run the consistency checker after running the conversion script?

FUDforum Core Developer
Quick Reply
Formatting Tools:   
  Switch to threaded view of this topic Create a new topic
Previous Topic: FuseTalk?
Next Topic: Form SImpleboard (mamboserver) to fudserver
Goto Forum:
  

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ]

Current Time: Mon Oct 23 04:07:00 EDT 2017

Total time taken to generate the page: 0.00986 seconds