CsvToIon
Convert a CSV file into ION.
type: "io.kestra.plugin.serdes.csv.CsvToIon"
Examples
Convert a CSV file to the Amazon Ion format.
id: csv_to_ion
namespace: company.team
tasks:
- id: http_download
type: io.kestra.plugin.core.http.Download
uri: https://huggingface.co/datasets/kestra/datasets/raw/main/csv/products.csv
- id: to_ion
type: io.kestra.plugin.serdes.csv.CsvToIon
from: "{{ outputs.http_download.uri }}"
Properties
from *Requiredstring
Source file URI
Pebble expression referencing an Internal Storage URI e.g. {{ outputs.mytask.uri }}
.
allowExtraCharsAfterClosingQuote booleanstring
false
Allow extra characters after a closing quote
charset string
UTF-8
The name of a supported charset
errorOnDifferentFieldCount booleanstring
false
Specifies if an exception should be thrown, if CSV data contains different field count
fieldSeparator string
,
The field separator character
header booleanstring
true
Specifies if the first line should be the header
maxBufferSize integerstring
16777216
Maximum CSV parser buffer size (bytes)
maxFieldSize integerstring
16777216
Maximum field size (characters)
skipEmptyRows booleanstring
false
Specifies if empty rows should be skipped
skipRows integerstring
0
Number of lines to skip at the start of the file
textDelimiter string
"
The text delimiter character
Outputs
uri string
uri
URI of a temporary result file