Some very useful tools for editing code en masse

imkira3

Member
So I'm working on a huge project, I have all these backup files, a lot of them very similar but constantly being changed bit by bit as I correct bugs and add new features. After over 3 years performing backups I have accrued quite a lot of files, so I decided to resort to by favourite compression algorithm, PAQ8PXD V5. It's a command line tool but if you prefer a GUI I did find one, I'll link to the video below. PAQ8PXD V5 is very slow and uses a lot of memory, but the results are beyond belief. I just compressed 1,495,362 files, weighing in at 1.10 gb or 5.71 gb on disk (NTFS) to a mere 1.48 mb, no I'm not kidding. I know archive.org and other websites offer plenty of online storage space, but I like local backups too. No telling when a server may shut down. If you like to keep a record of your work around then this program is for you, but don't try compressing anything already compressed, including images, videos, executables, etc., this will work best with a large number of uncompressed files. I have noticed I could have millions of copies of the same file and it won't alter the size of the archive a whit if they are identical, this algorithm could not be more suited for backing up old project files. When I tried archiving with WinRar using the best compression level, the resulting archive weighed in at 509mb, over 300x larger.

Another program worth noting is Advanced Find and Replace. We all know how useful Bulk Rename Utility and Notepad++ are for bulk edits, but this program took it to another level. Unfortunately there is no extended expressions, but we can do thousands of bulk replacements across multiple directories and associated subdirectories with a few clicks. It can load .csv files or you can make a list within the program. Sure, Notepad++ will cover most cases, but if you have to bulk edit a few hundred similar variable or whatnot this program is exactly what was needed, and unlike Notepad++ this only has to load each file once to do multiple replacements. This will also provide a neat opportunity to review every replacement at once, cutting down on irreversible errors.

PAQ8PXD V5 GUI Offlicial Link

Advanced Find and Replace Official Website
https://www.abacre.com/afr/

I didn't create these programs, but they are damn useful and I can't be writing scripts for every little thing. I hope they help with your projects!

EDIT: I found an even better program for replacing text in bulk, its called Ecobyte Replace Text. The official website is gone and development is discontinued, but if you can find a mirror it's a great piece of freeware.
 
Last edited:
To be honest, nothing revolutionary. How well data can be compressed depend of how much patterns repeating and i.e if packer can identify and link the same blocks across different files (i.e encrypted or already compressed files almost doesn't compress). There are few algorithms which packing data very tight but the cost is long compression and decompression period. Most popular today LZMA (used in RAR5, 7Z, XZ) was also known in ancient times but was overkill for Pentium II just like "algos" used in KGB Archiver and similar apps. ;)

I do not criticize Your post, just FYI.
 
Back
Top