PS3 [RESEARCH] Downloading all unknown file types to HDD and Flash

[aldostools]

How do I get wMM to look for dev_hdd0/video/**/****.iso , there is still that random folder issue too. This will stop us from accessing pkgs without moving them.

I am interested in these folders too.

View attachment 16685

These might not not suffer from the random subfolder issue, and i could edit them if I can find out how to use them, could be based on filetype, or maybe these are for use when copying from a PSP or something, more testing to be done.

wMM looks for /dev_hdd0/video by default... but I think the subfolders may cause issues. But it's solvable. I even could move the files automatically with a refresh.

static char paths [13][12] = {"GAMES", "GAMEZ", "PS3ISO", "BDISO", "DVDISO", "PS2ISO", "PSXISO", "PSXGAMES", "PSPISO", "ISO", "video", "GAMEI", "ROMS"};

We only need to find a way to change /xx with null or add /.. after /xx or simply truncate the path.

 

[DeViL303]

I will look into adding a null after video, or messing with the path in general. This will effect all video types though, so not sure if its a great option, I do not mind as i dont use my PS3 for videos, but I know some do.

If anyone on CFW wants to have a look or help test, this attached mms.sprx is patched with these extra file types, these file types will now download fully and be copy-able from the XMB.

I tried to only overwrite the rarer formats.

I also included a updated download_list.xml, this has many more paths added for all types of download, including options for root of dev_hdd0 and root dev_hdd1, dev_hdd0/theme etc. This adds lots to the PSP only file types, and also to the HDD only file types.

I have also optimized all the entries, the info_rsc line makes no difference, free space shows regardless. and also the logical_sceme line makes no difference.

Before:

After:

 

[aldostools]

I will look into adding a null after video, or messing with the path in general. This will effect all video types though, so not sure if its a great option, I do not mind as i dont use my PS3 for videos, but I know some do.

If anyone on CFW wants to have a look or help test, this attached mms.sprx is patched with these extra file types, these file types will now download fully and be copy-able from the XMB.

I tried to only overwrite the rarer formats.

I also included a updated download_list.xml, this has many more paths added for all types of download, including options for root of dev_hdd0 and root dev_hdd1, dev_hdd0/theme etc. This adds lots to the PSP only file types, and also to the HDD only file types.

I have also optimized all the entries, the info_rsc line makes no difference, free space shows regardless. and also the logical_sceme line makes no difference.

Some suggested additions: PUP, SELF, IMG, MDF, CUE . Maybe replacing these rare audio extensions: M4A, MA4, M2A, M1A, M4B

Also MKV, ISO.0 ISO.1 ... ISO.9 replacing MPO, MP2, MP1, M2P, M1P, M2V, M1V, 3G2, 3GP2, DSF, OMA, MSA

EDIT: I suppose the extensions for ISO.0..ISO.9 in mms should be added as 0, 1, 2, 3, 4, 5, 6, 7, 8, 9

 

[DeViL303]

OK, I have stuck to overwriting video file types for now, as otherwise we will need to use the music or photo category for some file types and it will be a bit confusing.

Here is a mms.sprx attached with support for ISO, PKG, ZIP, PUP, SELF, SPRX, RCO, XML, MDF, IMG, CUE, BIN.

Just seen your edit. can add more in a while.

It would be nice if we could do some exclusion trick in the category_video.xml so it does not show those file types, and then we could add a new item for a file manager with an exclusion trick for real videos, might be possible.

We have lots of control now really. See this video for some example of copying PKGs and RCOs from USB, then putting into separate albums named correctly, we can move all these file types from one album to another, copy whole albums, copy multiple, copy one, delete one, delete multiple, delete albums etc, full control like videos.

 

[aldostools]

OK, I have stuck to overwriting video file types for now, as otherwise we will need to use the music or photo category for some file types and it will be a bit confusing.

Here is a mms.sprx attached with support for ISO, PKG, ZIP, PUP, SELF, SPRX, RCO, XML, MDF, IMG, CUE, BIN.

Just seen your edit. can add more in a while.

It would be nice if we could do some exclusion trick in the category_video.xml so it does not show those file types, and then we could add a new item for a file manager with an exclusion trick for real videos, might be possible.

We have lots of control now really. See this video for some example of copying PKGs and RCOs from USB, then putting into separate albums named correctly, we can move all these file types from one album to another, copy whole albums, copy multiple, copy one, delete one, delete multiple, delete albums etc, full control like videos.

FYI wMM now lists the ISOs stored in /dev_hdd0/video
https://github.com/aldostools/webMAN-MOD/releases

I think we'll need to update category_game.xml to make Package Manager list the PKG files copied to USB.

The packages in hdd0/video can't be listed. Maybe we'll need to update xai_plugin to move them to /packages or use a wMM script.
http://127.0.0.1/move.ps3/dev_hdd0/video/*.pkg&to=/dev_hdd0/packages
http://127.0.0.1/move.ps3/dev_hdd0/video/*.iso&to=/dev_hdd0/PS3ISO
http://127.0.0.1/move.ps3/dev_hdd0/video/*.PUP&to=/dev_hdd0/updater/01

It would be nice to customize the icons for broken files and unknown files so they look like file icons.
Also text "Corrupted Data" and "Unsupported Data" could be changed to something like "CFW Content", "File" or a name more acceptable.

 

[DeViL303]

FYI wMM now lists the ISOs stored in /dev_hdd0/video
https://github.com/aldostools/webMAN-MOD/releases

Nice one.

I think we'll need to update category_game.xml to make Package Manager list the PKG files copied to USB.

You mean if packages are copied back off the system and end up in dev_usbxxx/VIDEO/ ? Yeah we could add that path to package manager. I have tried to mess with that path too, to change it to root or packages, or PS3. No luck yet.

The packages in hdd0/video can't be listed. Maybe we'll need to update xai_plugin to move them to /packages or use a wMM script.
http://127.0.0.1/move.ps3/dev_hdd0/video/*.pkg&to=/dev_hdd0/packages
http://127.0.0.1/move.ps3/dev_hdd0/video/*.iso&to=/dev_hdd0/PS3ISO
http://127.0.0.1/move.ps3/dev_hdd0/video/*.PUP&to=/dev_hdd0/updater/01

Yeah, so far i have no luck messing with the path. I tried editing all the ones i could find, and none made any difference. Really we need to find the variable for the random folder name and hard code it.

It would be nice to customize the icons for broken files and unknown files so they look like file icons.
Also text "Corrupted Data" and "Unsupported Data" could be changed to something like "CFW Content", "File" or a name more acceptable.

Good idea, that can be done in the main explore rco I guess, I will have a look and making it look a bit better.

TBH Im not sure where to go with this mms.sprx mod. Its cool as a proof of concept of what's possible, but this requires sprx mods, So it will only work on CFW. Thing is we already have decent file managers and FTP on CFW, So I'm not sure if the copying etc is as useful as the downloading mods for every day use.

Maybe it will develop into something, but for now Im not sure if anyone would use it other than to try it once really.

If these mods could be done on OFW then maybe it would be worth developing more, I don't know. Its all good for research and learning either way anyway.


NOTE: Rebuilding the database removes all unsupported/corrupted files and albums so that is an issue. I guess another sprx needs to be modded to stop that, the mms_maintenance.sprx maybe.

 

[Lambada]

FYI wMM now lists the ISOs stored in /dev_hdd0/video
https://github.com/aldostools/webMAN-MOD/releases

I think we'll need to update category_game.xml to make Package Manager list the PKG files copied to USB.

The packages in hdd0/video can't be listed. Maybe we'll need to update xai_plugin to move them to /packages or use a wMM script.
http://127.0.0.1/move.ps3/dev_hdd0/video/*.pkg&to=/dev_hdd0/packages
http://127.0.0.1/move.ps3/dev_hdd0/video/*.iso&to=/dev_hdd0/PS3ISO
http://127.0.0.1/move.ps3/dev_hdd0/video/*.PUP&to=/dev_hdd0/updater/01

It would be nice to customize the icons for broken files and unknown files so they look like file icons.
Also text "Corrupted Data" and "Unsupported Data" could be changed to something like "CFW Content", "File" or a name more acceptable.

Nice!
In the future perhaps identify if the game image is a ps1, ps2, psp or ps3 by reading the executable filename and then move to the correct folder (PSXISO, PS2ISO, PSPISO, PS3ISO)?
Just throwing ideas.



Sent from my Redmi Note 5 using Tapatalk

 

[DeViL303]

If we could modify this screen, in the same way I modded the download paths screen, maybe we could add more locations.

 

[DeViL303]

Off topic, but lol.

Not sure why these are in the language xmls in the first place, but this does not seem like the best way to call a +/-

On topic, That works anyway. The icon is displayed small. I used the SD card icon as it looks like a file icon.

Also changed the folder now so they are just normal, not video specific.

 

[DeViL303]

I have figured out subfolders in the download_list.xml, this tidies up the paths a bit and allows me to add loads of sub folder paths, so i have mapped almost every folder on dev_blind, and dev_flash2 , This allows pretty much any mod to be downloaded directly to flash.

I have also made it so the same screen appears no matter what file type you download, so full options, including all media options where as normally that would be restricted to just the type you are downloading. PSP only files, and HDD only will now show all options too. like this:

Still that damn deletion bug when downloading to dev_hdd0.

 

[DeViL303]

Something new, the upload_list.xml is not used at all. All uploading is handled by the download_list.xml too.

So I have added a few things including 100% working video uploading that did not exist before at all.

Also I am trying to get the uploader seeing other file types, as then we could upload from all paths, of course the deleting error would not be an issue as we would be reading. This is interesting if it could be made to work, Imagine this, a site could be set up, you upload for example your xregistry, or category_game.xml or an sprx, and it then instantly pops up with download of a patched version just like that which you download into same location

BEFORE:

AFTER:

 

[Niander466]

could you send the .xml file? Even if it does not work, it's very good to test lol.

 

[DeViL303]

could you send the .xml file? Even if it does not work, it's very good to test lol.

Here, This download_list.xml is over 3 times the size of the original.

On HFW/HAN, files can be downloaded to dev_flash2 perfectly, that is only 16MB though. Files can be downloaded to dev_hdd1 perfectly if its mounted. That is only 2GB though. Files can be downloaded to dev_flash perfectly if its mounted as dev_blind. If you download to dev_hdd0 then there is still the issue with the files getting deleted if you dont download them in the background, and then if you do download in the background, there is the 99% bug where they stay in download management even when they are 100% finished. At least they dont get deleted.

Uploading, now gives options of music and video that did not show before, that is 100% working, should work on OFW too. For CFW I have got it to start uploading a pkg by using a modified mms.sprx, more testing to be done.

Note: There are 2 icons included that need to go in dev_blind/vsh/resource/explore/icon/

 

[Niander466]

Here, This download_list.xml is over 3 times the size of the original.

On HFW/HAN, files can be downloaded to dev_flash2 perfectly, that is only 16MB though. Files can be downloaded to dev_hdd1 perfectly if its mounted. That is only 2GB though. Files can be downloaded to dev_flash perfectly if its mounted as dev_blind. If you download to dev_hdd0 then there is still the issue with the files getting deleted if you dont download them in the background, and then if you do download in the background, there is the 99% bug where they stay in download management even when they are 100% finished. At least they dont get deleted.

Uploading, now gives options of music and video that did not show before, that is 100% working, should work on OFW too. For CFW I have got it to start uploading a pkg by using a modified mms.sprx, more testing to be done.

Note: There are 2 icons included that need to go in dev_blind/vsh/resource/explore/icon/

Right!! Thank you, I'll take a look right now !!

 

[DeViL303]

I just uploaded a test ISO with the PS3 web browser, no problem. So the same mods to mms.sprx I did for copying, allow for those file types to be uploaded too. Handy. The uploading of unknown file types is for CFW only as its a sprx mod.

 

[DeViL303]

Games showing on upload menu, it's kind of interesting, not working and probably never will. Before I delete it I thought I might as well show it first, as lots of these funny non working mods never get seen.

 

[lmn7]

Something new, the upload_list.xml is not used at all. All uploading is handled by the download_list.xml too.

I thought maybe upload_list.xml was used on the XMB to copy photos/videos/etc, you sure it's not used at all?

 

[DeViL303]

I thought maybe upload_list.xml was used on the XMB to copy photos/videos/etc, you sure it's not used at all?

Not completely sure no, I just know its not what I thought, and when you go to upload a file online it reads the paths from the top of download_list.xml.

 

[lmn7]

Not completely sure no, I just know its not what I thought, and when you go to upload a file online it reads the paths from the top of download_list.xml.

Ah ok, btw about that xRegistry upload idea... not a good one IMO. Account details are stored within the file in plaintext. Would be a serious security issue. We can already get the contents of files on the HDD within the browser, the real problem is patching it, I'm sure the encryption is documented somewhere though.

One question, is it possible to have multiple concurrent downloads? I assume this would only be feasible with background downloads. So when you use this trick to download a file to flash for example, can you dl in background? And if so, are there issues?

Great progress on this btw, it's coming along nicely!

 

[DeViL303]

Ah ok, btw about that xRegistry upload idea... not a good one IMO. Account details are stored within the file in plaintext. Would be a serious security issue. We can already get the contents of files on the HDD within the browser, the real problem is patching it, I'm sure the encryption is documented somewhere though.

One question, is it possible to have multiple concurrent downloads? I assume this would only be feasible with background downloads. So when you use this trick to download a file to flash for example, can you dl in background? And if so, are there issues?

Great progress on this btw, it's coming along nicely!

oh yeah, I know whats in there. the xreg idea was just as POC and for people who would trust the server or have offline PS3 and nothing to worry about, we could have debug options enabled by a server for example, working on OFW. Anyway that is only only small part of that idea, its more the sprx/self/xml patches that can be done that are interesting. For example, we could have a "Add whats new on PSX-place" button on a website, you press it, and a patched explore_plugin.sprx starts downloading with instructions to choose vsh/module/ as location, Or "add package manager" and a category_game.xml starts downloading. Many many possibilities there with direct downloads to flash, even locally hosted downloads from webmans webserver could be used in some way i bet.

Multiple concurrent downloads to flash, no, background downloading is only possible to hdd0. Even if we could enable it for other partitions I guess it would download it to dev_hdd0/vsh/task/xxxxxxxxx anyway as that is how BGDL works really.