SMF - The fastest duplicate files finder... [Updated 2024-Oct-20]

[Ascend4nt]

works now

Nice job! Very professional looking and feature-rich tool

[KaFu]

Nice job! Very professional looking and feature-rich tool

Thanks a lot ... note that SMF now utilizes your _WinAPI_FileFind() and _DOSWildcardsToPCRegEx(original code: RobSaunder's) UDF's. Thanks a lot for those to you . Already crediting your for the UDF's on my page, will do so in the help-file too in next update. Your other UDF's are also all awesome, will for sure utilize one or the other in different projects!

Edited April 4, 2009 by KaFu

[131738]

thank you

[KaFu]

You're welcome, glad you like the program .

[KaFu]

April's nearly over, it's time for another update on SMF ...

Changelog v0.5.0.0.9 > v0.5.0.2.1

General

• Fixed Analysis of Unicode Characters in Folder & Filenames
• Fixed Crash on Deletion of Duplicates
• Add option to remove empty parent directories on deletion of files
• Changed default database location from Memory to File
• Tweaked Style

Source and Executable are available at

http://www.funk.eu

Best Regards

[Creator]

Very very nice tool you made there! And it works portable! Thanks for creating.

[colafrysen]

Just wanted to say big thanks to you for this tool, used it to get rid of all the duplicates on iTunes

It's just awesome, i almost can't grip thats it is coded in AutoIt...

[KaFu]

Thanks for the compliment , and be sure to re-check what you want to delete, I do ...

[Ashalshaikh]

Thank You ...

[froufrou]

Well i found your color picker a few days ago,and WOW!! Loved it.And now i find that you have a project for searching,so i go get it because since i switched to vista i hate the search built in.And again WOW!! the search you made is wonderful.Thank-You for you wonderful projects.Seeing what can be done has inspired me to learn even more of AutoIt.

[KaFu]

Well i found your color picker a few days ago,and WOW!! Loved it.And now i find that you have a project for searching,so i go get it because since i switched to vista i hate the search built in.And again WOW!! the search you made is wonderful.Thank-You for you wonderful projects.Seeing what can be done has inspired me to learn even more of AutoIt.

Thanks , then also take a look at my latest project, the AMT ...

[froufrou]

It's Downloading now.I'll let you know soon

Edit:

Well gave it a run.It was awesome.I love the .html export,that's what I'll be using for all my movies and video clips.

Edited June 13, 2009 by froufrou

[KaFu]

It's time again... for another update on SMF...

... and this time... after hearing complains about my version numbering ... it's V1.0!

Changelog grew quiet large in the past 6 months ... so here's just the copy&paste:

Changelog v0.5.0.2.1 > v1.0.0.0

2009-Nov-17

v0.5.1.0.4 > v1.0.0.0

- Major Design Overhaul / Relaunch as Version 1!

- Switch Report sorting to _GUICtrlListView_SortItems()

- Updated to SQLite DLL to version 3.6.19

- Updated to MediaInfo_0.7.23.dll

- Treeview selection state saved on exit now too (before only on search)

2009-Sep-13

v0.5.0.9.7 > v0.5.1.0.4

- Removed HotKey.au3 functions

- Changed invoking HotKey from WIN-F to Ctrl+Alt+F

- Tray Icon destroyed on Exit

2009-Sep-13

v0.5.0.8.4 > v0.5.0.9.5

- Trying to figure out crash on dual usage of Large and Small Icons in Report

- Added ASC and DESC Icons on report columns

2009-Aug-28

v0.5.0.8.1 > v0.5.0.8.4

- Removed OPT OnExit func from Hotkey. Now called in __ExitFunc() manually

- Created stripped version of SMF_Func_WinAPI_FileFind_v03_OM.au3 => scan speed improvement

- Started shortening Vars in main work loop => scan speed improvement

2009-Aug-24

v0.5.0.7.7 > v0.5.0.8.1

- Fixed small control positioning bug in report

- Updated SQLite DLL to version 3.6.17

- Updated TrID Definitions to version 2009/Aug/22

2009-Aug-17

v0.5.0.6.6 > v0.5.0.7.7

- Report: "Set Filetime" implemented

2009-Aug-13

v0.5.0.6.6 > v0.5.0.7.4

- Report: "Set File Attributes" implemented

- Report: Added option to open Windows search

2009-Jul-22

v0.5.0.6.2 > v0.5.0.6.6

- Further design changes

- CRC32 now default hash for duplicates search again

- Relocated "Search in File content" function to run after filters for performance improvment

- Updated to MediaInfo_0.7.20.dll

v0.5.0.6.0 > v0.5.0.6.2

- Relocated fileinstall directory to @AppDataDir

v0.5.0.5.9 > v0.5.0.6.0

- Bug fix Report: Old sort order now reapplied correctly after file operation

2009-Jul-20

v0.5.0.5.7 > v0.5.0.5.9

- Bug fix Treeview: USB directory structure was not parsed

- Changed: Minimize on ESC

- Report column selection now restores previous selected fields

v0.5.0.5.6 > v0.5.0.5.7

- Fileicons in report now optional (None / Small Icons / Large Icons)

2009-Jul-15

v0.5.0.5.4 > v0.5.0.5.6

- Added: Folder Treeview - now the selected folders of last run are reloaded/-checked on start-up

v0.5.0.5.3 > v0.5.0.5.4

- Corrected Unicode issue in File-Slider

v0.5.0.5.1 > v0.5.0.5.3

- Revised SMF fileinstall() folder structure

- Corrected Unicode issue in hashing function

2009-Jul-14

v0.5.0.5.0 > v0.5.0.5.1

- Added Trayseticontip

- Added a _GUICtrlMenu_CreateMenu()

- Added icons to Menu

v0.5.0.4.9 > v0.5.0.5.0

- Add Slider to set GUI transparency

v0.5.0.3.6 > v0.5.0.4.8

- Further design changes

- Fixed issues while deleting files and folders from report with Unicode chars

v0.5.0.2.9 > v0.5.0.3.6

- Enhanced fileicon support for report

- Further design changes

- Massive changes to hash functions

- CRC32

- SHA1

- MD5

to optimize code and speed. Also added _MemVirtualAlloc(0, BinaryLen($_CRC32Opcode), $MEM_COMMIT, $PAGE_EXECUTE_READWRITE) to solve DEP issues on Win Vista+

v0.5.0.2.7 > v0.5.0.2.9

- Added fileicon support to report

v0.5.0.2.6 > v0.5.0.2.7

- Changed Autostart option from registry to Startup-Folder method

v0.5.0.2.5 > v0.5.0.2.6

- Fixed bug in autostart minimized function

- Changed style of custom progress GUI

2009-Jul-01

v0.5.0.2.4 > v0.5.0.2.5

- Started redesign of main GUI

- Tweaked search in file function

2009-Jun-30

v0.5.0.2.3 > v0.5.0.2.4

- Added option to search IN file content

v0.5.0.2.2 > v0.5.0.2.3

- Added option to change SMF process priority during scan => default is to set Priority to 'High'

2009-Jun-29

v0.5.0.2.1 > v0.5.0.2.2

- Updated TrID Definitions to version 22/06/09

- Updated MediaInfo DLL to version 0.7.17

- Updated SQLite DLL to version 3.6.16

- Updated function _DOSWildcardsToRegExp() to new version _DOSWildcardsToPCRegEx()

http://www.autoitscript.com/forum/index.php?showtopic=90846

- Updated include SMF_Func_ShellTristateTreeView_v20.au3 to SMF_Func_ShellTristateTreeView_v24.au3

- Replaced single instance check done with Winexists() through Singleton()

- Added option to call SMF Window with "WIN+F" Hotkey

http://www.autoitscript.com/forum/index.php?showtopic=90492

- Updated Func _DirGetSizeEx()

#699650

Source and Executable are available... as always... at

http://www.funk.eu

Best Regards

[Dolemite50]

Hi Kafu,

I've always considered this app to be one of the most complete examples around here. I think the only thing that might keep SMF from sweeping the nation is that it is a little intimidating or at least not very intuitive for semi-casual users like myself. When I see unfamiliar options like "CS-Sha1(short)" and "ADS Stream infos" it scares me away from diving in to explore your program. Every time my mouse hovers a button I wonder if I'm about to learn the hard way that "ADS" actually stands for "Actively Delete Shit" or something.

As far as examples go, it doesn't get much better than to have a search guru kick down a full-blown working example of what he's learned. That's really kind of you man!

D50

[KaFu]

Time for another update on SMF...

Changelog v1.0.0.0 > v1.1.3.8

• Implemented True Multi-Threading
  • Well, at least true dual-threading ...
  • The Report can now be executed during the search, allowing you to view the results as they fly in!
• Win7 compatibility
• Massive improvements on responsiveness of the report
• Added more file details to analyze, if you know any other interesting details to analyze, give me a hint.
• Windows Explorer Integration
• Fixed 1.000 small bugs
• Added 1.001 new small bugs

SMF is growing... quiet complex , so if you find any issues, please feel free to report them.

ATM I'm too lazy to update the screenshots, will do so later .

Source and Executable are available... as always... at

http://www.funk.eu

Best Regards

[JohnOne]

Great stuff mate

Top of the Pops

5*

[trancexx]

I get two messages:

---------------------------
Windows Internet Explorer
---------------------------
Cannot find 'file:///SMF_Files/text/SMF_ReadMe.html'. Make sure the path or Internet address is correct.
---------------------------
OK   
---------------------------

Followed by:

---------------------------
AutoIt Error
---------------------------
Line 8874  (File "C:\Documents and Settings\trancexx\Desktop\SMF.exe"):


Error: The requested action with this object has failed.
---------------------------
OK   
---------------------------

[KaFu]

Can't reproduce , run's fine on my desktop.

'file:///SMF_Files/text/SMF_ReadMe.html'

should be more something like this

'file:///C:\Documents and Settings\trancexx\Desktop\SMF_Files/text/SMF_ReadMe.html'

Alongside the SMF.exe there is a file SMF.ini. What's the setting of "SMF_Files="? Thats the value of $sSMF_Default_DataDir obtain in the first install (lines 114-194).

Edited March 5, 2010 by KaFu

[trancexx]

Can't reproduce , run's fine on my desktop.

'file:///SMF_Files/text/SMF_ReadMe.html'

should be more something like this

'file:///C:\Documents and Settings\trancexx\Desktop\SMF_Files/text/SMF_ReadMe.html'

Alongside the SMF.exe there is a file SMF.ini. What's the setting of "SMF_Files="? Thats the value of $sSMF_Default_DataDir obtain in the first install (lines 114-194).

Content of SMF.ini is

[settings]
SMF_version=SMF - Search my Files - v1.1.3.8 (2010-Mar-05)
SMF_UUID={D719D975-7CE7-4BD2-998B-8BD6473412C5}

Nothing more there.

[KaFu]

Content of SMF.ini is

[settings]
SMF_version=SMF - Search my Files - v1.1.3.8 (2010-Mar-05)
SMF_UUID={D719D975-7CE7-4BD2-998B-8BD6473412C5}

Nothing more there.

Ahhh, could reproduce on the fifth re-try , seems to be that the data-directory is sometimes not created fast enough to capture the fileinstalls. Additionally when installing to a HDD root there is a trailling "\" after the drive-letter... Added some checks and re-upload the files... pls re-test ...