Line Periodicity Detector

The 'Similarity Threshold' determines how closely two lines must match to be grouped together as part of a periodic pattern. The value is a decimal between 0.01 and 1.0, where 1.0 means lines must be identical, and lower values allow for more variation.

Increasing this value makes the detector more strict, reducing false positives but potentially missing valid patterns with minor differences. Decreasing it allows for more flexible matching, which can be useful for documents with variable content.

'Minimum Alignment' specifies the minimum number of characters that must align between two lines for them to be considered fully similar. This helps prevent short or incidental matches from being treated as repeating patterns.

Increase this value to require longer matching segments, which is useful for documents with long lines or where short matches are not meaningful. Decrease it for documents with short lines or when you want to detect smaller repeating units.

'Minimum Segment Length' controls the smallest sequence of characters that will be considered when evaluating line similarity. This helps filter out noise and ensures that only substantial matches contribute to periodicity detection.

Set this value higher to ignore short, potentially irrelevant matches. Lower it to increase sensitivity to smaller repeating elements.

Can be one of the following types:

Assign a Value Extractor to the 'Background Extractor' property to match and filter out background content (such as headers, footers, or decorative elements) that should not influence the detection of repeating patterns.

This is especially useful for documents where non-data elements could otherwise cause false positives in periodicity detection.

'Page Depth' limits the number of pages that will be processed when searching for repeating patterns. This can improve performance and focus analysis on the most relevant portion of the document.

Set this value based on the typical length of your documents and the location of repeating patterns. For example, if repeating sections only occur on the first few pages, set 'Page Depth' accordingly.