BatchUniqueChecker

Key Features

• Check the content uniqueness within the URLs from a list of any size
• Import the list of URLs from Sitemap.xml or add it manually
• The tool can be used to analyze only the "meaningful" text (within HTML paragraphs) from web pages
• Identify the differences between any two selected URLs
• Setting the shingle length (from 1 to 10 words per shingle)
• Export reports to Excel (CSV format)

Differences From Analogues

• Multithreading and quick URL check
• Portable format (works without installation from any internal or external storage drive)
• Freeware

Version History

Version 1.4 (build 28), 09.12.2021:

• added the ability to check for uniqueness of local HTML and TXT files
• in the window for comparing the uniqueness of the original URL with the others, the display of the search URL has been added
• added the ability to copy the list of pages from the Similar URL window to the clipboard
• increased the maximum possible number of imported URLs from 5,000 to 10,000
• added the Info column of the context menu to the main program window

Version 1.3 (build 21), 25.02.2021:

• fixed incorrect work of the program with threads
• the number of URL validation errors should be significantly less

Version 1.3 (build 20), 07.12.2020:

• fixed problem with not correct using pauses between requests to web pages
• finalized and improved translation
• updated splitter (visual divider)

Version 1.2 (build 19), 27.10.2020:

• improved algorithm for determining "meaningful" texts
• we added the ability to recheck URLs completed with errors
• we added the ability to display URLs closest in uniqueness to the selected one
• we added comparing the uniqueness of two arbitrary texts (Settings tab)

Version 1.1 (build 16), 25.10.2020:

• we added two ways of getting the content for uniqueness check: full-text search (PlainText) and "meaningful" (meaningful sentences and sections of text)
• web page content is easier to download thanks to User-Agent support
• you can turn off stop words now

Version 1.0 (build 5), 14.10.2020:

• multi-threaded check of pages within an URL list (up to 10 threads at once)
• import URLs from Sitemap.xml or a txt-file or paste them manually from the clipboard
• compare any two URLs and display their differences
• the URL uniqueness is visualized with different colors in the results table and graph
• export results to Excel (CSV)

Minimum system requirements

– 1 GHz (recommended 3 GHz and more)
– 1 GB RAM (recommended 8 GB and more)
– Microsoft Windows 10/8/7/Vista/XP
– Internet