AzureDataLakeStoreReadSettings interface

Azure data lake store read settings.

Extends

Properties

deleteFilesAfterCompletion

Indicates whether the source files need to be deleted after copy completion. Default is false. Type: boolean (or Expression with resultType boolean).

enablePartitionDiscovery

Indicates whether to enable partition discovery. Type: boolean (or Expression with resultType boolean).

fileListPath

Point to a text file that lists each file (relative path to the path configured in the dataset) that you want to copy. Type: string (or Expression with resultType string).

listAfter

Lists files after the value (exclusive) based on file/folder names’ lexicographical order. Applies under the folderPath in data set, and filter files/sub-folders under the folderPath. Type: string (or Expression with resultType string).

listBefore

Lists files before the value (inclusive) based on file/folder names’ lexicographical order. Applies under the folderPath in data set, and filter files/sub-folders under the folderPath. Type: string (or Expression with resultType string).

modifiedDatetimeEnd

The end of file's modified datetime. Type: string (or Expression with resultType string).

modifiedDatetimeStart

The start of file's modified datetime. Type: string (or Expression with resultType string).

partitionRootPath

Specify the root path where partition discovery starts from. Type: string (or Expression with resultType string).

recursive

If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean).

type

Polymorphic discriminator, which specifies the different types this object can be

wildcardFileName

ADLS wildcardFileName. Type: string (or Expression with resultType string).

wildcardFolderPath

ADLS wildcardFolderPath. Type: string (or Expression with resultType string).

Inherited Properties

disableMetricsCollection

If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean).

maxConcurrentConnections

The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer).

Property Details

deleteFilesAfterCompletion

Indicates whether the source files need to be deleted after copy completion. Default is false. Type: boolean (or Expression with resultType boolean).

deleteFilesAfterCompletion?: any

Property Value

any

enablePartitionDiscovery

Indicates whether to enable partition discovery. Type: boolean (or Expression with resultType boolean).

enablePartitionDiscovery?: any

Property Value

any

fileListPath

Point to a text file that lists each file (relative path to the path configured in the dataset) that you want to copy. Type: string (or Expression with resultType string).

fileListPath?: any

Property Value

any

listAfter

Lists files after the value (exclusive) based on file/folder names’ lexicographical order. Applies under the folderPath in data set, and filter files/sub-folders under the folderPath. Type: string (or Expression with resultType string).

listAfter?: any

Property Value

any

listBefore

Lists files before the value (inclusive) based on file/folder names’ lexicographical order. Applies under the folderPath in data set, and filter files/sub-folders under the folderPath. Type: string (or Expression with resultType string).

listBefore?: any

Property Value

any

modifiedDatetimeEnd

The end of file's modified datetime. Type: string (or Expression with resultType string).

modifiedDatetimeEnd?: any

Property Value

any

modifiedDatetimeStart

The start of file's modified datetime. Type: string (or Expression with resultType string).

modifiedDatetimeStart?: any

Property Value

any

partitionRootPath

Specify the root path where partition discovery starts from. Type: string (or Expression with resultType string).

partitionRootPath?: any

Property Value

any

recursive

If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean).

recursive?: any

Property Value

any

type

Polymorphic discriminator, which specifies the different types this object can be

type: "AzureDataLakeStoreReadSettings"

Property Value

"AzureDataLakeStoreReadSettings"

wildcardFileName

ADLS wildcardFileName. Type: string (or Expression with resultType string).

wildcardFileName?: any

Property Value

any

wildcardFolderPath

ADLS wildcardFolderPath. Type: string (or Expression with resultType string).

wildcardFolderPath?: any

Property Value

any

Inherited Property Details

disableMetricsCollection

If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean).

disableMetricsCollection?: any

Property Value

any

Inherited From StoreReadSettings.disableMetricsCollection

maxConcurrentConnections

The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer).

maxConcurrentConnections?: any

Property Value

any

Inherited From StoreReadSettings.maxConcurrentConnections