PS3 [GUIDE] How to successfully FTP huge amount of files

jacobsson

jacobsson

Senior Member
Hi guys and gals.
I just wanted to share some of my settings for successful mass transfers of files between PS3 and computer via FTP.

Prior to this I had a lot of problems making backups of large quantities of files such as game folders and retroarch via FTP, so much of a PITA that I thought I was a lost cause.

With these settings I've now managed to transfer 20,000+ files in one session w/o any manual restarts or fiddling, this over WiFi even!

There are probably room for improvements so please share your findings and we will enrich the guide along the way.

FileZilla settings:

Settings -> Connection (these values could go 60, 99, 20 for a faster timeout)
sT7J9BG.png



Settings -> Connection -> FTP
77XcODK.png



Settings -> Connection -> FTP -> Active mode
BdrPg4T.png



Settings -> Transfers (change red to ~90% of your max transfer speed between PS3 and PC)
WgGYxhM.png



Site Manager- > General (change red to your PS3 LAN IP)
K1s1y0k.png



Site Manager- > Transfer Settings
77NjCLc.png



PS3 settings:
  1. (OPTIONAL) Download and install mulitMan (or Monster Manager from here)
  2. Make a clean re-boot
  3. Start up the FTP (should start default in multiMan), in Monster Manager: press start and then choose Tools -> FTP)
  4. Start transferring data over FTP
 
Last edited:
DarkPowerX said:
Is this going to work on direct connection between pc and ps3? No router.
Click to expand...
Yes it works, and actually is the fastest setup because there are no bottlenecks :)

The network configuration in the PC is a bit tricky though, there are several different ways to do it, what you need to keep in mind is incase the PC have several network links (one or more wifi, and one or more lan) then everyone of them should be configured as a different IP range

Lets say... you could connect with a router to have acces to internet by using 192.168.0.x and a lan card with ethernet cable to connect with the PS3 in 125.125.1.x
The 125.125.1.x is like a "subnetwork" and the PC connects to both
 
I've never had a problem with 5-6 transfers at once. Past that is usually when it has issues...feels like it's limited by the # of spu in the cell. I usually drop the # of transfers when transferring one large file to 1-2 to increase speed a little.

I've found w/ small files, it takes more time to "setup" than to transfer, so the additional simultaneous transfers tend to be slightly faster. Albeit, the higher the # of transfers you use, the "less stable" it becomes while transferring.
 
Thanks for your tutorial!
I helped a lot to transfer huge amouts of files (>200000) to my PS3! It took around one day, but it was worth it!
One thing I did differently, though: I tried Monster Manager, but the PS3 just shut down after a while. I don't know why and when. I also couldn't find an option in Mondermanager for an auto shutdown (the one in XMB settings was definitely off).
So I just let wMM do the work and I only had one hang, which wasn't a problem with your settings for Filezilla... The transfer rates were ok'isch (17MB/s) with that, but that was OK as I didn't have to fiddle and check the PS3 the whole time.
 
@ecto

Hi! I'm really glad to hear that this helped you in the same way it helped me. Thanks for reporting back with your experience, I'll make sure to add MM as a good solution to the Auto shutdown issue.
 
I transfered a 8gb PKG file to ps3 PKG folder using FileZilla. When I tried to install it using file manager it said done copying file and the pkg file doesn't show up in PS3. It used some storage space but I can't find the file.
Is there a way to directly install pkg without transferring.
 
ecto said:
Thanks for your tutorial!
I helped a lot to transfer huge amouts of files (>200000) to my PS3! It took around one day, but it was worth it!
One thing I did differently, though: I tried Monster Manager, but the PS3 just shut down after a while. I don't know why and when. I also couldn't find an option in Mondermanager for an auto shutdown (the one in XMB settings was definitely off).
So I just let wMM do the work and I only had one hang, which wasn't a problem with your settings for Filezilla... The transfer rates were ok'isch (17MB/s) with that, but that was OK as I didn't have to fiddle and check the PS3 the whole time.
Click to expand...

Interesting post. I have a question, have you tried the overall transfer speed for small files using 1/file per transfer vs several/files per transfer?

After reading the tutorial I realized that I may have created a bottleneck in my FTP transfers because I set Filezilla for 1 transfer at a time... which took more than 1 hour to transfer +60,000 files, (~30gb total), vs 30~40 minutes for a few but very heavy files (~20gb). I will definitively try with several transfers at once for the hundreds small files but other users experience are well to be know!


Kimjim said:
I transfered a 8gb PKG file to ps3 PKG folder using FileZilla. When I tried to install it using file manager it said done copying file and the pkg file doesn't show up in PS3. It used some storage space but I can't find the file.
Is there a way to directly install pkg without transferring.
Click to expand...

You may want to locate the PKG file in "hdd0/packages" (if there is not such folder, create it), then head to the XMB, go to GAME>PACKAGE MANAGER>INSTALL>PS3 STORAGE. Your PKG(s) should be there, no need to reboot.

Regarding the PKG installation without the transfer, not sure if that way is possible but I read that you can mount a server that will virtually run the games from your PC using webMAN mod. Here is the tutorial for ps3netsrv.

However, if you have a computer with an SSD and dont mind to put it in use, you may heavily reduce the PKG transfer + installation method by extracting the PKG in your computer, then placing its content in "hdd0/game" via FTP. It is faster even for these backups with HUNDREDS of files.
 
montcer said:
Interesting post. I have a question, have you tried the overall transfer speed for small files using 1/file per transfer vs several/files per transfer?

After reading the tutorial I realized that I may have created a bottleneck in my FTP transfers because I set Filezilla for 1 transfer at a time... which took more than 1 hour to transfer +60,000 files, (~30gb total), vs 30~40 minutes for a few but very heavy files (~20gb). I will definitively try with several transfers at once for the hundreds small files but other users experience are well to be know!
Click to expand...

I never tried to transfer multiple files at a time because I thought it would make the transfer unstable. Also, I was hoping that transferring one file at a time would keep any fragmaentation of the internal hdd in better control, but that might very well be voodoo ;).

It's true that a large amount of small files is taking forever to transfer, but having a stable connection outweighs this. Just let it sit for the night and you're good.
 
ecto said:
I never tried to transfer multiple files at a time because I thought it would make the transfer unstable. Also, I was hoping that transferring one file at a time would keep any fragmaentation of the internal hdd in better control, but that might very well be voodoo ;).

It's true that a large amount of small files is taking forever to transfer, but having a stable connection outweighs this. Just let it sit for the night and you're good.
Click to expand...

Hmmmm, might I be too greedy? I set the max transfer limit to 10, and it is being WAYYYYY faster than 1/file transfer. However, it seems that the PS3 doesn't like it and after some time or after some files amount it closes the FTP connection for something like 1~2 minutes, with the following error:

EDIT: I wonder, how can I force the PS3 to not abort the connection?

EDIT 2: I am downloading things from the PS3 HDD. The connections works better when uploading.

Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc33.cld
Status: File transfer successful, transferred 3.5 KB in 1 second
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc33.cam
Status: File transfer successful, transferred 1.5 KB in 1 second
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc32.map
Status: File transfer successful, transferred 1.3 MB in 1 second
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc32.kg2
Status: File transfer successful, transferred 17.4 KB in 1 second
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc32.cld
Status: File transfer successful, transferred 19.4 KB in 1 second
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc32.cam
Status: File transfer successful, transferred 560 B in 1 second
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,3
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,4
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,5
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,6
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,7
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,8
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,9
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,10
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,11
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,13
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,15
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,17
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,18
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,19
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,20
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,21
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,22
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,23
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,24
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,25
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,26
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,27
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,28
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,29
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,30
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,31
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,32
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,33
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,34
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,35
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,36
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,37
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,38
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,39
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,40
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,41
Response: 200 OK
Command: RETR cc31.map
Response: 150 OK
Response: 451 ERR
Error: File transfer failed
Status: Starting download of /dev_hdd0/game/XXX/USRDIR/XXX/data/bg/cc/cc31.map
Command: PORT 192,168,137,1,220,42
Error: Connection closed by server
Error: File transfer failed
Status: Disconnected from server
Status: Delaying connection for 22 seconds due to previously failed connection attempt...
Error: Connection closed by server
Error: Could not connect to server
Status: Disconnected from server
Status: Delaying connection for 30 seconds due to previously failed connection attempt...
Error: Connection closed by server
Error: Could not connect to server
Status: Disconnected from server
Status: Delaying connection for 30 seconds due to previously failed connection attempt...
Error: Connection closed by server
Error: Could not connect to server
Status: Disconnected from server
Status: Delaying connection for 30 seconds due to previously failed connection attempt...
Error: Connection closed by server
Error: Could not connect to server
Status: Disconnected from server
Status: Delaying connection for 30 seconds due to previously failed connection attempt...
Error: Connection closed by server
Error: Could not connect to server
Status: Disconnected from server
Status: Delaying connection for 30 seconds due to previously failed connection attempt...
Status: Delaying connection for 10 seconds due to previously failed connection attempt...
Status: Delaying connection for 10 seconds due to previously failed connection attempt...
Status: Delaying connection for 10 seconds due to previously failed connection attempt...
Status: Delaying connection for 10 seconds due to previously failed connection attempt...
Status: Delaying connection for 10 seconds due to previously failed connection attempt...
Status: Delaying connection for 10 seconds due to previously failed connection attempt...
Status: Delaying connection for 1 second due to previously failed connection attempt...
Status: Delaying connection for 1 second due to previously failed connection attempt...
Status: Delaying connection for 1 second due to previously failed connection attempt...
Status: Delaying connection for 1 second due to previously failed connection attempt...
Status: Connecting to 192.168.137.233:21...
Status: Connecting to 192.168.137.233:21...
Status: Connection established, waiting for welcome message...
Status: Connecting to 192.168.137.233:21...
Status: Connection established, waiting for welcome message...
Status: Connecting to 192.168.137.233:21...
Status: Connection established, waiting for welcome message...
Status: Connecting to 192.168.137.233:21...
Status: Connection established, waiting for welcome message...
Status: Connecting to 192.168.137.233:21...
Status: Connection established, waiting for welcome message...
Status: Connecting to 192.168.137.233:21...
Status: Connection established, waiting for welcome message...
Status: Connecting to 192.168.137.233:21...
Status: Connection established, waiting for welcome message...
Status: Connecting to 192.168.137.233:21...
Status: Connection established, waiting for welcome message...
Status: Connecting to 192.168.137.233:21...
Status: Connection established, waiting for welcome message...
Status: Connection established, waiting for welcome message...
Error: Connection closed by server
Error: Could not connect to server
Status: Connecting to 192.168.137.233:21...
Status: Connection established, waiting for welcome message...
Status: Disconnected from server
Status: Delaying connection for 30 seconds due to previously failed connection attempt...
 
Last edited:
somebody knows how to reset filezilla configs?i've tried with new installation - doesn't work,most of the stuff sticks,i suspect config files being somewhere hidden in programdata,appdata or similar location but i can't find it.i'm using portable version.

those settings from this tut mess things up for me,most stuff filezilla won't even try to transfer,just hangs until disconnecting.
 
umart666 said:
somebody knows how to reset filezilla configs?i've tried with new installation - doesn't work,most of the stuff sticks,i suspect config files being somewhere hidden in programdata,appdata or similar location but i can't find it.i'm using portable version.

those settings from this tut mess things up for me,most stuff filezilla won't even try to transfer,just hangs until disconnecting.
Click to expand...

While FileZilla is closed, delete the following folder:

C:\Users\X\AppData\Roaming\FileZilla
 
Hello every time i try to ftp it says "This sever does not support FTP over TLS. If you continue, your password and files will be sent in clear over the internet." PLEASE HELP
 
You must log in or register to reply here.

Similar threads

Back
Top