| Import Datadump [message #16244] |
Thu, 22 January 2004 00:13  |
mocara
Messages: 157
Registered: January 2004
Karma: 0
|
Senior Member |
|
|
Hi.
I just datadumped a FUD install and it took a few minutes. I went to move that dump to another machine and it took well over an hour before I stopped it. It was doing stuff as the mysql files were getting bigger. I was just wondering though if someone could give me an idea of how long an import should take.
I have about 100,000 posts over 6 forums.
The import took so long I wasn't sure if it would be finished by the morning and that didn't seem right.
Pais.
|
|
|
|
| Re: Import Datadump [message #16284 is a reply to message #16244] |
Sun, 25 January 2004 16:24  |
Ilia
Messages: 13241
Registered: January 2002
Karma: 0
|
Senior Member
Administrator
Core Developer |
|
|
It definitely shouldn't take hours, however it can take quite a while, especially if you had the search engine enabled. The search table(s) for 100,000 message forum can contain few million of rows, which need to be inserted one by one.
FUDforum Core Developer
|
|
|
|
| Re: Import Datadump [message #19645 is a reply to message #16284] |
Mon, 16 August 2004 17:08 |
mocara
Messages: 157
Registered: January 2004
Karma: 0
|
Senior Member |
|
|
Might having the mysql master log being written for each of these have a massive effect on the time taken?
At the moment it's about 1/10th the way through an import and it's been over 1 hour. 100,000 posts in the forum.
Mocara
[Updated on: Mon, 16 August 2004 17:08] Report message to a moderator |
|
|
|
|
|
|
|
| Re: Import Datadump [message #19649 is a reply to message #19648] |
Mon, 16 August 2004 19:34 |
Ilia
Messages: 13241
Registered: January 2002
Karma: 0
|
Senior Member
Administrator
Core Developer |
|
|
Delete all entries from fud26_ses table and try to login.
FUDforum Core Developer
|
|
|
|
| Re: Import Datadump [message #19654 is a reply to message #19649] |
Mon, 16 August 2004 19:54 |
mocara
Messages: 157
Registered: January 2004
Karma: 0
|
Senior Member |
|
|
The guilty party has been found:
PHP Fatal error: Maximum execution time of 6000 seconds exceeded in adm/admimport.php on line 168
I've increased that to 20000 in the script and I'm running it again.
What times are to be expected for doing an import?
Mocara.
[Updated on: Mon, 16 August 2004 20:33] Report message to a moderator |
|
|
|
| Re: Import Datadump [message #19657 is a reply to message #19654] |
Mon, 16 August 2004 23:50 |
mocara
Messages: 157
Registered: January 2004
Karma: 0
|
Senior Member |
|
|
The import script has been running for 4 hours now. Please tell me that this isn't right? Would 100,000 posts take this long to import? What is it doing that takes so long?
I went to bed, woke up and it's still hadn't completed within 20,000 secs. Would it not be quicker for me to stop the forum, copy the files, dump the mysql data, import it and then edit the GLOBAL to reflect the new server?
FYI, ran myisamchk on everything, deleted all entries from fud26_ses. Still no go.
Mocara.
[Updated on: Tue, 17 August 2004 09:52] Report message to a moderator |
|
|
|
| Re: Import Datadump [message #19662 is a reply to message #19657] |
Tue, 17 August 2004 13:19 |
Ilia
Messages: 13241
Registered: January 2002
Karma: 0
|
Senior Member
Administrator
Core Developer |
|
|
The reason it's so slow, is because 100,000 posts would probably translate to several million entries inside the search tables. one alternative would be to manually import the sql data via mysqldump > mysqlimport and then copy over the files from old forum to the new.
FUDforum Core Developer
|
|
|
|
Calendar
Search
Help
Members
Register
Login
Home
]