Return to site

Duplicate Detective 1 94 – Find And Remove Duplicate Files

broken image


Introduction
  1. Duplicate Detective 1 94 – Find And Remove Duplicate Files On Mac
  2. Duplicate Detective 1 94 – Find And Remove Duplicate Files Pdf
  3. Duplicate Detective 1 94 – Find And Remove Duplicate Files Free

Duplicate File Detective is a feature-rich software application whose purpose is to locate duplicate files on your computer, allowing you to delete them and, thus clear up space on your hard drive. Duplicate Detective – Find and Delete Duplicate Files 1.92. AppStore QR-Code ‎Duplicate Detective: Cleaner. Download Duplicate Detective 1.92 for Mac OS X Free.

This tutorial shows how to find and optionally delete similar or duplicate pages within the same PDF document using the AutoSplit™ plug-in for the Adobe® Acrobat®. This operation detects similar pages and presents them to the user for a review. The user can review the results and select/unselect individual pages from the list of duplicates for a possible deletion or extraction. You can perform the following operations:
  • Find duplicate and near-duplicate pages
  • Bookmark duplicate pages
  • Extract duplicate pages into a separate PDF document
  • Delete duplicate pages from the document
  • Save page similarity report
The plug-in provides two different methods for detecting duplicate or near-duplicate pages:
Compare Page Text Only
Use this method to compare page text regardless of its visual appearance. It computes page similarity based on text content only and completely ignores text appearance, layout, images and graphics that might be present on the page. It is the best method to detect duplicates in most document types.
Compare Visual Appearance of the Pages
This method compares pages 'as images' and detects pages that look exactly the same. This method does not compare any invisible text that may be present on the page. It is not advised to use this method on scanned paper documents.
Using Scanned Paper Documents
Quite often this operation is used to find duplicate pages in the scanned paper documents. The scanned documents need to be OCRed prior to using them for any text-based processing. The OCR is a process of recognizing text in scanned documents and making them searchable. It is essential to understand that text recognition in scanned documents is prone to errors and it is rarely 100% accurate. The number of errors depends on scanning resolution and original document quality. In most common cases, a scanned page may contain between 1 to 10 recognition errors where certain letters are incorrectly identified. For example, depending on the font, the lowercase letter l can look exactly like the numeral 1 . The uppercase letter O is often misidentified as the numeral 0, or uppercase letter S as the numeral 5 and etc. Since many alphanumeric symbols share similar, or identical, physical characteristics, differentiation often poses a challenge. This is why a similarity-based comparison comes useful to detect small differences between pages that are produced by the text recognition process. Low quality scanned documents may contain a large number of errors making them unusable for any reliable text-based comparison. See the following tutorial on how to OCR scanned documents and asses their suitability for the text-based processing. .
Prerequisites
You need a copy of the Adobe® Acrobat® along with the AutoSplit™ plug-in installed on your computer in order to use this tutorial. You can download trial versions of both the Adobe® Acrobat® and the AutoSplit™ plug-in.
Contents
Method 1 - Comparing Page Text Only ↑overview
This method compares page similarity only based on their page content. The visual appearance, text position and order is irrelevant. This method also ignores any images and graphics present on the pages. The modified cosine similarity metric is used to calculate how similar are two pages based on their text content.
Step 1 - Open a PDF File
Start the Adobe® Acrobat® application and open a PDF file using 'File > Open...' menu.
Step 2 - Open the 'Find Duplicate Pages' Dialog
Select 'Plug-Ins > Split Documents > Find and Delete Duplicate Pages...' to open the 'Find Duplicate Pages' dialog.
Step 3 - Specify Settings
Check the 'Compare only page text (ignore visual appearance of the pages)' option.
Using Predefined Settings
The text-based method provides a number of predefined parameters sets that are suitable for comparing different kinds of documents with a different amount of recognition errors. Each predefined set of parameters provides different conditions for similarity calculations:
  • Custom Settings - all settings are specified by user
  • Scanned Paper Document: High Quality
  • Scanned Paper Document: Medium Quality
  • Fax Document: Low Quality
  • Non-scanned PDF: exact match
  • Non-scanned PDF: fuzzy match
  • Exact match (with text order)- this method does not use cosine similarity
Settings appear below the menu after selecting a predefined parameter set.
Here are the settings used by the predefined sets:
Click 'Edit...' to customize page similarity settings:
The text comparison method uses 3 parameters to limit how different two 'similar' pages can be. By varying these parameters, it is possible to detect pages that have a different degree of similarity.
  • Minimal allowed page text similarity (in percent) - this is the value of cosine similarity metric expressed in percent. Specify minimum allowed page text similarity between 70 and 100 (in percent).
  • Maximum allowed page length difference (in characters).
  • Maximum allowed page text difference (in words).
Use these settings to experiment with processing settings when it is necessary to adjust processing algorithm for a specific document.
Use Sample Pages
Optionally, click 'Set From Page Sample...' to specify page similarity settings based on the two sample pages:
Select two pages that can be consider identical. The software will auto-calculate page similarity and the statistics will appear in the left lower corner of the dialog.
Click 'OK' to save the current similarity settings.
Specify Text Filtering Options
There are several parameters that control the page content that is being analyzed by the text comparison algorithm. Use these options when comparing scanned paper documents that may contain various text recognition errors. These options exclude certain kind of characters from processing. In many cases, it may help to compute a more accurate similarity metric.
  • Ignore text case - this option ignores text case while comparing text.
  • Ignore punctuation (,.!?-) - this options excludes all punctuation characters from comparison.
  • Ignore non-alphanumeric characters - this options ignores all characters except letters and digits.
Click 'OK' to save page similarity settings.
Click 'OK' to start searching the current PDF document for the duplicate pages:
Step 4 - Inspect Duplicate Pages
The 'Delete Duplicate Pages' dialog shows a list of duplicate or near-duplicate pages. Click on a page record to display a corresponding page in the viewer. Examine pages and select/unselect pages for deletion.
Optionally, click 'Save Report...' to create a page similarity report in HTML format. Or click 'Bookmark Pages' to create bookmarks in PDF for selected duplicate pages.
The plug-in allows to preview/compare the found duplicate or near-duplicate pages. The page similarity (in %) and the number of mismatched words is displayed for each pair of pages. Here are the examples computed for the pair of the scanned paper documents:

Duplicate Detective 1 94 – Find And Remove Duplicate Files On Mac

Note that the apperance and location of the text do not affect the results.
These two pages are considered identical despite the difference in the text color:
These two pages are considered identical despite the difference in the content layout:
These two pages are consider 94% similar despite the difference in the text order, layout and absence of the image:
Step 5 - Extract or Bookmark Duplicate Pages
Optionally, use 'Bookmark Pages' button to bookmark all checked pages. This is useful if you are not planning to delete the found duplicate pages from the document. Use checkboxes in front of the pages to select/unselect them from the processing set.
Files
Use 'Extract Pages....' button to extract all checked pages into a separate PDF document. This operation will not remove pages from the current document.
Use 'Save Report...' button to save page similarity computation report into HTML file. It contains page similarity details, shows differences between pages and lists missing words. It can be very useful for the in-depth analysis.
Step 6 - Delete Duplicate Pages
Use checkboxes in front of the pages to select/unselect pages from being deleted. Press 'Delete Pages' button in the 'Delete Duplicate Pages' dialog to remove all checked pages from the current PDF document:
Click 'OK' button to confirm. Pages will be permanently removed.
Method 2 - Comparing Visual Appearance Only ↑overview
This method compares pages 'as images' and detects pages that look exactly the same. This method does not compare any invisible text that may be present on the page. It is not advised to use this method on scanned paper documents.
Step 1 - Open a PDF File
Start the Adobe® Acrobat® application and open a PDF file using 'File > Open...' menu.
Step 2 - Open the 'Find Duplicate Pages' Dialog
Select 'Plug-Ins > Split Documents > Find and Delete Duplicate Pages...' to open the 'Find Duplicate Pages' dialog.
Step 3 - Specify Settings
Check the 'Compare visual appearance for exact match (can be used to compare images)' option.
Click 'OK' to start searching for duplicate pages.
Step 4 - Inspect Duplicate Pages
The 'Delete Duplicate Pages' dialog shows a list of duplicate or near-duplicate pages. Click on a page record to display the corresponding page in the side-by-side view. Examine pages and select/unselect pages for a possible deletion.
Optionally, click 'Save Report...' to create a page similarity report in HTML format. Or click 'Bookmark Pages' to create bookmarks in PDF for selected duplicate pages.
This method is based on creating a smaller (sampled) copies of the pages and comparing them 'as images'. The following example shows two identical pages that contain only graphics and no searchable text:
If pages are visually identical, then the software detects them as duplicates:
These two pages are considered different due to the 'Approved' stamp on the one of the pages:
These two pages are consider identical by this method:
Unlike the text-based comparison method, if the color or style of the text is different, then the pages are not considered identical:
Step 5 - Delete Duplicate Pages
Click 'Delete Pages' in the 'Delete Duplicate Pages' dialog to proceed.
Click 'OK' button to delete pages from the current PDF documents. Pages will be permanently removed.
Comparing Multiple PDF Documents
This operation can be used to find and remove duplicate pages from the multiple PDF documents. The approach is to combine one or more documents into a single PDF file and run 'Find and Delete Duplicate Pages' operation on the resulting file. This will essentially produce a single document without any duplicates. Optionally, it is possible to extract all detected duplicate pages into a separate PDF document.
Step 1 - Combine Multiple PDF Documents ↑overview
Start the Adobe® Acrobat® application and select 'Tools' from the menu. Select 'Combine Files' icon from the Tools list.
Click 'Add Files...' in the 'Combine Files' menu and select PDF files to merge for comparison.
Click the 'Combine' button in the menu to merge selected PDF files.
Step 2 - Find Duplicate Pages

Duplicate Detective 1 94 – Find And Remove Duplicate Files Pdf

The combined output PDF file would appear on the screen. If not, open the combined PDF file.
Select 'Plug-Ins > Split Documents > Find and Delete Duplicate Pages...' to open the 'Find Duplicate Pages' dialog.
Check the 'Compare visual appearance for exact match (can be used to compare images)' option. Click 'OK' to start searching for duplicate pages.
Step 3 - Extract Duplicate Pages
The 'Delete Duplicate Pages' dialog will show a list of duplicate or near-duplicate pages. Click on a page record to display a corresponding page in the viewer. Examine pages and select/unselect pages.
Click 'Extract Pages...' to extract selected duplicate pages into a new PDF document.
Specify an output folder and a file name. Click 'Save' once done.
The dialog would appear showing the number of pages that have been extracted into a separate document. Now you have saved all duplicate pages into the separate PDF file before deleting them. You can examine these pages and use later if necessary.
Click 'OK' to close the dialog.
Step 4 - Delete Duplicate Pages
Click 'Delete Pages' in the 'Delete Duplicate Pages' dialog to proceed.
Click 'OK' in the dialog to delete selected duplicate pages from the current PDF document.
The selected duplicate pages would be permanently removed from the PDF document. You would need to use 'File > Save' menu to save the modified document to disk.
Click here for a list of all step-by-step tutorials available.

Duplicate File Finder - About

Fast Duplicate File Finder FREEWARE will find duplicate files in a folder, computer or entire network. The application will compare the content of the files and will find duplicates even if they are using different file names.

The Professional version can find similar files regardless of their file types. It will analyze the file data in order to find duplicates and not just file attributes like name and size as the standard clone removers do. It uses advanced algorithms while searching for related files and provides accurate results, which is not true for the commonly advertised FUZZY search methods.
The duplicate remover uses fast binary comparison algorithm and has internal preview supporting a lot of image, video, music and text file formats. It can also preview the common file formats.

After the scan process is finished the program shows all the duplicated files in groups and can automatically mark the oldest for deleting. The auto-mark algorithm has advanced settings to exclude from auto mark files with user specified extensions, file sizes, file dates, and file names. A 'source' folder can also be excluded from the auto mark. There is an option to protect system files and folders which is enabled by default and guarantees that the application will not remove any critical system files.
Download the FREE duplicate finder and recover up to 50% free space.


Featured on:


How To Find Duplicate Files?

Start the Scan: Select computer, drive, folder or network location to scan and choose among the multiple detection modes - 100% equal files, similar files, similar file names and many more.

Review Results: The tool automatically selects true duplicates for removal, but the identified files can be previewed inside the application and the selection can be modified manually if needed.

Delete Duplicate Files: Duplicated files can be removed in one go or moved to a folder or backup drive. You can now enjoy a fast and organized computer.


Duplicate File Finder - Features

The duplicate cleaner is a powerful utility for finding repeating files in a folder and all its sub folders. The duplicate remover has the following features:
  • Find duplicate files or find similar files in user specified folders, hard drives, computers or entire networks
  • Fast binary comparison algorithm
  • Internal preview supporting images, videos, music, text and binary files
  • Older or smaller files can be automatically marked for deletion
  • Redundant files can be moved to Recycle Bin, custom folder or deleted permanently
  • Support for all kinds of removable media - usb drives, diskettes etc.
  • Has intuitive interface and rich documentation
  • Process priority settings that will let the application scan in your computers IDLE time
  • Protection for system files and folders that will prevent damages to your system files when removing redundant files
  • Automatically locate duplicated files in Windows Explorer
  • Open file with associated program
  • Powerful filter and exclude from auto-check options
  • Powerful Quick Check/Uncheck dialog
  • Multi-language file system support
  • Native support for 64 bit and 32 bit operating systems
  • Lifetime License!

Duplicate File Finder - Command Line Parameters

Command-Line Parameters Usage: (Available only in Pro version)

DupFileFinder.exe -run -s -exp

-run - performs a duplicate files scan immediately after the program is started

-exp - Export command line parameter. Depending on the file extension will export the corresponding file type. Multiple formats can be exported at once by separating the paths with semicolons. The variables {DATE} and {TIME} will be replaced with the current date and time.

-s – stands for SILENT. Using the option the GUI will not be displayed during the scan and the application will exit after the command line actions are processed.

Example: DupFileFinder.exe -run -s -exp 'c:result_{DATE} {TIME}.xml;c:result_{DATE} {TIME}.fdff;c:result_{DATE} {TIME}.csv'

Note: If some of the parameters contain spaces, you must enclose them in double quotes as shown above..


System Requirements

Duplicate Detective 1 94 – Find And Remove Duplicate Files Free

  • Operating system: Windows 10/Windows 8.1/Windows 8/Windows 7/Windows Vista/Windows XP/Windows NT/Windows 2000/Windows 2003/All Windows Server operating systems
  • CPU: Pentium-233 MHz or higher
  • 128 MB RAM
  • 5 MB free hard disk space
  • True Color display and video card
  • Mouse or other pointing device

Duplicate File Finder - Testimonials

David Cardinal - PC Magazine
'If you suspect you've wound up with multiple copies of large files like photos, music, or videos, there are utilities that can help you locate and delete duplicates. One nice free one is Duplicate File Finder from MindGems'

Gavin Cooper, D&D Consulting - www.timesunion.com

'Duplicate files over time you often move files around especially music photos and video files leaving the originals to sit and gather dust - there are a few free applications out there that can help to de-duplicate files good free one is Fast Duplicate File Finder.'






broken image