LexiconType

Use Lookup for mapping codes to descriptions, abbreviations to full forms, translations, or any scenario where a key should resolve to a value.

• Each entry must be in the form: key=value
• Keys must be unique within the lexicon.
• Values may be any string (including empty).

Example entries: AL=Alabama AK=Alaska AZ=Arizona AR=Arkansas CA=California

At runtime, lookups can be performed to translate a key (e.g., "AK") to its value ("Alaska"). This type is ideal for state codes, abbreviations, or any mapping scenario.

Use Vocabulary for lists of valid values, such as allowed words, product codes, or entity names, where no mapping or weighting is needed.

• Each entry is a single value (no delimiter).
• Blank lines are ignored.

Example entries: about above after again against

At runtime, each line is treated as a valid entry for lookup, validation, or extraction. This type is ideal for dictionaries, stopword lists, or any scenario where only the presence of a value matters.

Use Frequency for frequency analysis, weighted lookups, or when you want to track how often each entry appears in a corpus.

• Each entry must be in the form: key=count
• count must be a valid integer.
• Keys must be unique within the lexicon.

Example entries: you=22484400 i=19975318 the=17594291 to=13200962 a=11230036

At runtime, the count can be used for weighting, ranking, or statistical analysis of entries. This type is ideal for language models, word frequency lists, or any scenario where the frequency of occurrence is important.