| Re: Asynchronous FTP Upload [message #172080 is a reply to message #172061] |
Sun, 30 January 2011 11:33   |
duderion
Messages: 3
Registered: January 2011
Karma:
|
Junior Member |
|
|
On Jan 28, 8:48 pm, Jerry Stuckle <jstuck...@attglobal.net> wrote:
> On 1/28/2011 10:56 AM, duderion wrote:
>
>
>
>
>
>
>
>> On Jan 28, 4:29 pm, Jerry Stuckle<jstuck...@attglobal.net> wrote:
>>> On 1/28/2011 10:12 AM, duderion wrote:
>
>>>> hi guys,
>
>>>> could anyone tell me how i can handle an ftp upload to several servers
>>>> at once?
>
>>>> I found fb_nb_put, but i dont know how to combine 5 connections with
>>>> this.
>
>>>> any help would be nice :)
>
>>>> dude
>
>>> You'll need to open 5 different streams and start each transfer. Keep
>>> track of the status of each transfer in an array and loop while any of
>>> them need to continue. In the loop, continue those which have not finished.
>
>>> Not sure what this is going to do though for you though, other than take
>>> a lot of unnecessary CPU because you're effectively polling constantly..
>>> Why don't you just upload each file individually?
>
> > Hi Jerry
> > thanks for the quick and nice reply,
> >
> > i need to do this, because i have to trasfer videos to around 500
> > hosts during one night. i have a 1gb upload line, and thats why i want
> > to run those uploads simultaniously....
> >
> <Top posting fixed>
>
> That doesn't mean you'll get anywhere near 1gb upload. Your limit in
> this case is likely going to be disk access speed (assuming the other
> hosts are replying in a timely manner, of course). And forcing the disk
> to jump around to fetch data from different areas of the disk is likely
> to be slower then accessing the data in a contiguous file.
>
> The point being - even if you open 5 parallel connections, you are not
> going to get 5x the speed; in fact, depending on what you're doing, you
> may actually slow down the processing. And error recovery becomes much
> harder.
>
> You need to test and find out. The "sweet spot" may be anywhere from 1
> to 500 parallel connections (although I highly doubt the latter :) ).
> And it may vary depending on exactly which hosts you're currently
> accessing and how quickly they respond.
>
> P.S. Please don't top post. Thanks.
>
> --
> ==================
> Remove the "x" from my email address
> Jerry Stuckle
> JDS Computer Training Corp.
> jstuck...@attglobal.net
> ==================
Thanks Jerry,
ill pass your useful information to my boss, who had this idea. i
guess its better to upload them in a row...
THANKS ALOT
and ill never top-post again :D
dude
|
|
|
|
Calendar
Search
Help
Members
Register
Login
Home
]