Release Notes - CSV Adapter 2.2

Owned by Arielle Kaye Odeste
Jun 21, 2022
2 min read

Overview

Version 2.2 of CSV adapter introduces multiple new features and bug fixes.

Product Enhancements

  • Skip Row Feature – The adapter can now omit headers from CSV files via "comment out" characters.

    • The adapter has now a new config item called "RowsToOmit" to skip several rows.

    • Example values for this config are 1, 2-3,100-200.

    • The rows that will be skipped start from record 1 of the data (the header row is excluded)

    • The skipped rows will be put in a file under Archive->Exceptions->SkippedRows_DateTime.csv. Every time a file has rows skipped, the current timestamp will be appended to the skipped rows file.

  • DateFormats configuration – Added a new adapter configuration option where different date formats can be indicated instead of saving it in a file.

Bug Fixes

  • File Data not showing issue – A downloaded CSV file from a SFTP source now fully overwrites the previous file. It does not append the contents.

  • Data onboarding issue – Fixed an issue where values were being added to the wrong fields in certain scenarios.

  • Parsing issue – Fixed an issue when parsing multiple CSV files with extra columns and/or missing columns and onboarding into same index.

  • Duplicate Columns issue – Fixed an issue when a file had duplicate column (More than one column with same name) and the data was shifted to the right because the duplicate columns were not added to the data table for onboarding. The duplicate columns are now identified properly and marked with a _Duplicate field to accommodate proper onboarding. If a field name is "Agent" and it is present 3 times in the csv file, then the index would show Agent, Agent_Duplicate1 and Agent_Duplicate2.

  • Composite Primary Key – Fixed an issue when composite primary keys were used as a combination of more than one column.