Twitter Facebook Linkedin Product Hunt


BatchUniqueChecker is designed to bulk check the content uniqueness within the pages from an URL list, Sitemap.xml or local HTML-files.

BatchUniqueChecker, checking uniqueness of page content among themselves

Comparing the uniqueness of the original URL with similar ones

Comparing the uniqueness of the original URL with similar ones

Display the differences between selected URLs

Checking the uniqueness of a list of pages

Checking the uniqueness of two texts

Checking the uniqueness of two texts

Settings of the BatchUniqueChecker

Checking the uniqueness of texts using the URL list

Terms of use: Freeware

Key Features

  • Check the content uniqueness within the URLs from a list of any size
  • Import the list of URLs from Sitemap.xml or add it manually
  • The tool can be used to analyze only the "meaningful" text (within HTML paragraphs) from web pages
  • Identify the differences between any two selected URLs
  • Setting the shingle length (from 1 to 10 words per shingle)
  • Export reports to Excel (CSV format)

Differences From Analogues

  • Multithreading and quick URL check
  • Portable format (works without installation from any internal or external storage drive)
  • Freeware

Version History

The BatchUniqueChecker software is implemented in SiteAnalyzer as a separate module and will not be further developed in its current form. Read more...

Version 1.4 (build 28), 09.12.2021:

  • added the ability to check for uniqueness of local HTML and TXT files
  • in the window for comparing the uniqueness of the original URL with the others, the display of the search URL has been added
  • added the ability to copy the list of pages from the Similar URL window to the clipboard
  • increased the maximum possible number of imported URLs from 5,000 to 10,000
  • added the Info column of the context menu to the main program window

Version 1.3 (build 21), 25.02.2021:

  • fixed incorrect work of the program with threads
  • the number of URL validation errors should be significantly less

Version 1.3 (build 20), 07.12.2020:

  • fixed problem with not correct using pauses between requests to web pages
  • finalized and improved translation
  • updated splitter (visual divider)

Version 1.2 (build 19), 27.10.2020:

  • improved algorithm for determining "meaningful" texts
  • we added the ability to recheck URLs completed with errors
  • we added the ability to display URLs closest in uniqueness to the selected one
  • we added comparing the uniqueness of two arbitrary texts (Settings tab)

Version 1.1 (build 16), 25.10.2020:

  • we added two ways of getting the content for uniqueness check: full-text search (PlainText) and "meaningful" (meaningful sentences and sections of text)
  • web page content is easier to download thanks to User-Agent support
  • you can turn off stop words now

Version 1.0 (build 5), 14.10.2020:

  • multi-threaded check of pages within an URL list (up to 10 threads at once)
  • import URLs from Sitemap.xml or a txt-file or paste them manually from the clipboard
  • compare any two URLs and display their differences
  • the URL uniqueness is visualized with different colors in the results table and graph
  • export results to Excel (CSV)

Minimum system requirements

– 1 GHz (recommended 3 GHz and more)
– 1 GB RAM (recommended 8 GB and more)
– Microsoft Windows 10/8/7/Vista/XP
– Internet


You must be logged to leave a comment.

<< Back

Our Clients