FUDforum: Bug Reports » NNTP Import Stalls

Home » FUDforum Development » Bug Reports » NNTP Import Stalls

Show: Today's Messages :: Polls :: Message Navigator

NNTP Import Stalls [message #164945]

Thu, 07 April 2011 08:57

jm2morri

Messages: 225
Registered: January 2009
Location: Stratford, Ontario, Canad...

Karma: 0

Senior Member

Hello,

...similar issue...

The nntp import dies on a specific message of a news group that I am importing. No error message on command line or in error logs that I can see. mysqld is running at close to 100% CPU usage.

Cheers,

James.

Report message to a moderator

Re: NNTP Import Stalls [message #164947 is a reply to message #164945]

Fri, 08 April 2011 09:33

jm2morri

Messages: 225
Registered: January 2009
Location: Stratford, Ontario, Canad...

Karma: 0

Senior Member

OK, a bit more info. I put in some debugging echo statements in the script nntp.php. It stalls on the line where the function match_user_to_post() is called.

I printed out the inputs to that function and noticed two things that may be issues:

1) The from_name field contains a Scandinavian name with an accented character. When it gets echoed it shows up as a question mark in bash but I can see (using Thunderbird) that it actually is the lower case "o" with a slash through it (not sure what that character is called.

2) The user_id field is blank. Not sure if that is normal or not.

Also, the nntp_opt is 106 though I assume that is OK.

Does that help nail down what might be the problem? I really need to get this fixed as my forums are getting out of sync and my users won't like that....

James.

Report message to a moderator

Re: NNTP Import Stalls [message #164948 is a reply to message #164947]

Fri, 08 April 2011 09:38

jm2morri

Messages: 225
Registered: January 2009
Location: Stratford, Ontario, Canad...

Karma: 0

Senior Member

OK, I managed to figure out that it was indeed that Scandanavian character that was causing problems. I added this hack to nntp.php right before the call to match_user_to_post()

if ($msg_post->post_stamp == ID )
{
  $emsg->from_name = "name without accent";
}

And it then imported the message (and all the others that had queued up) just fine. So that function didn't like that character. That should be fixed, though I have no idea how to do that.

James.

Report message to a moderator

Re: NNTP Import Stalls [message #164954 is a reply to message #164948]

Fri, 08 April 2011 11:54

naudefj

Messages: 3772
Registered: December 2004

Karma: 28

Senior Member
Administrator
Core Developer

I've setup a test forum and imported the post without problem (from details in your mail).

Your DB may not accept UTF-8 characters.
Mail me access details if you want to to check it out.

Report message to a moderator

Re: NNTP Import Stalls [message #164955 is a reply to message #164954]

Fri, 08 April 2011 12:42

jm2morri

Messages: 225
Registered: January 2009
Location: Stratford, Ontario, Canad...

Karma: 0

Senior Member

naudefj wrote on Fri, 08 April 2011 07:54

Your DB may not accept UTF-8 characters.

It should I think. There are lots of german language text in other parts of the forum.

Is there a way I can check this?

James.

Report message to a moderator

Re: NNTP Import Stalls [message #164956 is a reply to message #164955]

Fri, 08 April 2011 13:43

naudefj

Messages: 3772
Registered: December 2004

Karma: 28

Senior Member
Administrator
Core Developer

Good question, maybe:
SQL> SHOW VARIABLES LIKE 'character_set_%';

More about the ø character: http://en.wikipedia.org/wiki/%C3%98

Report message to a moderator

Re: NNTP Import Stalls [message #164957 is a reply to message #164956]

Fri, 08 April 2011 13:49

jm2morri

Messages: 225
Registered: January 2009
Location: Stratford, Ontario, Canad...

Karma: 0

Senior Member

Here is the result from that command. JPG attached.

Variable_name Value
character_set_client utf8
character_set_connection utf8
character_set_database latin1
character_set_filesystem binary
character_set_results utf8
character_set_server latin1
character_set_system utf8
character_sets_dir /usr/share/mysql/charsets/

Does that help?

James.

Report message to a moderator

Re: NNTP Import Stalls [message #164958 is a reply to message #164957]

Fri, 08 April 2011 14:04

naudefj

Messages: 3772
Registered: December 2004

Karma: 28

Senior Member
Administrator
Core Developer

It looks pretty much UTF-8 to me.

You need to debug match_user_to_post() and possibly create_new_user() in include/scripts_common.inc.
It's just a couple of lines - should only take a couple of minutes of your time.

Report message to a moderator

Previous Topic:	Problems with MySQL 5.5
Next Topic:	E-mail to admin not working

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

]

Current Time: Wed Dec 11 21:07:22 GMT 2024

Total time taken to generate the page: 0.04519 seconds