Looking for new routers for FIOS Gig with emphasis on VPN Throughput

[MichaelCG]

So today I have been looking at catapult gridftp and some others. Some are very costly. Some are very complex. I feel like I'm missing something that's obvious, but maybe not.

So wouldn't it be great if I could find a copy program (let's call it MCOPY) that would open multiple streams to copy files. I think that would allow me to saturate my vpn. doesn't TFTP use UDP to copy? Any other ideas?

Roveer

I haven't put any time into researching ng any alternatives since they rarely would be useful in an Enterprise environment. I know they exist if you don't mind doing additional scripting and/or integration work. HTTP and FTP have these abilities with the correct software setup. You also could consider doing multiple batch jobs over CIFS. Or better yet, package and compress all files into fewer large archives to be transferred. A large portion of CIFS chattiness is file level browsing and such and less files will result in less traffic and better transfer speeds.

Also to note...yes TFTP is UDP, but it has very little security nor flexibility.

Sent from some device using Tapatalk

 

[Roveer]

So the past few nights I've been doing a lot of reading. WAN Accelerators, alternate protocols etc. Tonight I came across an article about transferring data across ipsec tunnels. One of the items the author mentioned was different speeds using different protocols. One of the protocols was http. Hmm. My NAS at home has a http front end and I remembered that it did some form of file transfer. I gave it a shot, uploading a 17.7 gig rar archive in 3 minutes and 11 seconds. Here's the tail end of the transfer: As you can see, it achieved full line rate 100+ MBps

I see there are a number of windows programs out there allowing for http transfer. Hopefully I can find a command line version or better yet some that might actually map a drive or at least allow me to send files to my NAS. That would be super. This could be just what I'm looking for to finally saturate my ipsec vpn for file transfer.

--- update ---

For whatever reason, very large files sent to the NAS via its http upload feature are not showing up on the NAS (after successful upload via the gui). If I use the same method on the LAN it works but across the vpn it doesn't. I'm still experimenting and may try some other utilities but right now that's a problem. Also. Uploads are 100+ MB/s but downloads are 50 MB/s. Still a lot of work to do.


Roveer

 

[Roveer]

ok, I fixed the http upload issue by adjusting the APREQ2 ReadLimit on the NAS. Now it accepts the full 17.2 gig file and more.

I'm RAR testing the upload now to make sure it arrived intact. I would assume http doesn't have much/any error correction?

 

[MichaelCG]

HTTP itself I do not believe has any error detection nor correction. However TCP itself does have basic error detection within the transport.

 

[Roveer]

I think the answer to all of my questions on saturating my 1Gb ipsec was in front of me all of the time. SMB3. I had been doing some 10GB testing and not until I got to Win10 (Win8.1 does this too), did I get the advantages of SMB3 which among other things does multiple connections. The dips you see in the graph are most likely the crappy pc I had on one side of the vpn trying to do win10 updates at the same time I was uploading. I can hear the HD grinding away right now.