FUDforum: Converters » Yahoo Groups -> mbox -> maillist.php -> missing posts

Home » FUDforum Development » Converters » Yahoo Groups -> mbox -> maillist.php -> missing posts

Show: Today's Messages :: Polls :: Message Navigator

Re: Yahoo Groups -> mbox -> maillist.php -> missing posts [message #21573 is a reply to message #15681]

Sat, 04 December 2004 02:04

srchild

Messages: 88
Registered: December 2003
Location: UK

Karma:

Member

srchild wrote on Wed, 31 December 2003 06:28

I've thought of a couple more things I can try first:

feed in the suspect messages singly and see if they are accepted
Using this: http://batleth.sapienti-sat.org/projects/mb2md/ I have split the mbox into single messages, and so if I can work out the shell scripting I can feed genuine single messages to maillist.php

Almost 12 months later I have returned to this project, and am now succeeding Smile

So I thought I'd post the success details in case others are trying this (Migrate Yahoogroup -> FUD).

I got the archive from Yahoo using Yahoo2mbox http://www.tt-solutions.com/en/products/yahoo2mbox/

I tidied it up a bit to remove some of the adverts etc (some done by hand, some done using regex search replace in vim)

I converted it to maildir format using mb2md.pl http://batleth.sapienti-sat.org/projects/mb2md/

I then fed it to maillist.php, using a sleep so that it could keep up. This seemed to be the key point. with a sleep of 0.5 (FreeBSD supports sleep for fractions of a second) I still lost about 50% of messages, but with a sleep of one second between messages I didn't lose a single one.

for i in /path/to/maildir/cur/*
do
cat $i |/usr/local/bin/php /path/to/FUDforum/scripts/maillist.php 4
sleep 1
done

Simon Child

Report message to a moderator

[Message index]

		Yahoo Groups -> mbox -> maillist.php -> missing posts By: srchild on Tue, 30 December 2003 20:34
		Re: Yahoo Groups -> mbox -> maillist.php -> missing posts By: Ilia on Tue, 30 December 2003 21:52
		Re: Yahoo Groups -> mbox -> maillist.php -> missing posts By: srchild on Tue, 30 December 2003 22:27
		Re: Yahoo Groups -> mbox -> maillist.php -> missing posts By: Ilia on Tue, 30 December 2003 22:38
		Re: Yahoo Groups -> mbox -> maillist.php -> missing posts By: srchild on Wed, 31 December 2003 00:28
		Re: Yahoo Groups -> mbox -> maillist.php -> missing posts By: srchild on Sat, 04 December 2004 02:04

Previous Topic:	Where to start?
Next Topic:	Conversion phpBB 2.0.5 => FUDforum problems

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

]

Current Time: Fri May 17 02:25:13 GMT 2024

Total time taken to generate the page: 0.05852 seconds