Delimited Extract

The 'Filename Pattern' property specifies a regular expression used to identify which files should be processed by this extractor. Only files whose names match this pattern will be considered for extraction.

• Use standard .NET regular expression syntax.
• The default value \.csv$ matches files ending with .csv.
• Adjust the pattern to match other file extensions or naming conventions as needed.

Example

• To match files ending with .tsv: \.tsv$
• To match files containing "export" in the name: export.*\.csv$

All files stored on the Batch Folder being processed will be matched against this pattern.

Can be one of the following values:

The 'Mapping Method' property determines the strategy used to associate columns in the CSV file with columns in your Data Table. Choose the method that best matches your data:

The choice of mapping method affects which other properties are relevant (such as 'Mappings' or 'Header Row').

The 'Mappings' property is used when 'Mapping Method' is set to Mapped. It allows you to define custom mappings between CSV columns and table columns using a Lexicon.

• Each entry in the lexicon should specify a table column name and the corresponding CSV column name or index.
• This is useful for files with inconsistent headers, synonyms, or when you need to map columns by alternate names.

Example

This property is ignored unless 'Mapping Method' is set to Mapped.

The 'Header Row' property specifies which row in the CSV file contains the column names. This is used when mapping columns by name or using a mapping lexicon.

• The value is 1-based (1 = first row).
• If left blank, the first row is used by default.
• This property is ignored when 'Mapping Method' is set to Positional.

Adjust this property if your files contain introductory rows or metadata before the actual header.

The 'Skip Rows' property allows you to skip a specified number of rows at the start of the file before extracting data. This is useful for files with introductory text, metadata, or multiple header rows.

• Set to 0 to process all rows (default).
• Increase the value to skip unwanted rows before the data begins.

This property is applied after the header row is processed.

The 'Delimiter' property specifies the character or string used to separate fields in the file.

• The default value is , (comma).
• For tab-delimited files, use \t.
• For pipe-delimited files, use |.

Ensure this matches the actual delimiter used in your files for correct parsing.

The 'Quoted' property controls whether the parser treats fields enclosed in double quotes as a single value, even if they contain delimiter characters.

• Set to true (default) for standard CSV files that use quotes to escape delimiters.
• Set to false if your files do not use quoted fields.

Adjust this property to match the quoting conventions of your data source.

The 'Trim Whitespace' property controls whether leading and trailing whitespace is removed from each field after parsing.

• Set to true (default) to automatically trim whitespace.
• Set to false to preserve all whitespace, which may be necessary for certain data types.

Adjust this property based on the requirements of your downstream processing or data validation.