Microsoft.Kusto clusters/databases/dataConnections 2020-09-18

Article
12/09/2024

Bicep resource definition

The clusters/databases/dataConnections resource type can be deployed with operations that target:

Resource groups - See resource group deployment commands

For a list of changed properties in each API version, see change log.

Resource format

To create a Microsoft.Kusto/clusters/databases/dataConnections resource, add the following Bicep to your template.

resource symbolicname 'Microsoft.Kusto/clusters/databases/dataConnections@2020-09-18' = {
  location: 'string'
  name: 'string'
  kind: 'string'
  // For remaining properties, see Microsoft.Kusto/clusters/databases/dataConnections objects
}

Microsoft.Kusto/clusters/databases/dataConnections objects

Set the kind property to specify the type of object.

For EventGrid, use:

{
  kind: 'EventGrid'
  properties: {
    blobStorageEventType: 'string'
    consumerGroup: 'string'
    dataFormat: 'string'
    eventHubResourceId: 'string'
    ignoreFirstRecord: bool
    mappingRuleName: 'string'
    storageAccountResourceId: 'string'
    tableName: 'string'
  }
}

For EventHub, use:

{
  kind: 'EventHub'
  properties: {
    compression: 'string'
    consumerGroup: 'string'
    dataFormat: 'string'
    eventHubResourceId: 'string'
    eventSystemProperties: [
      'string'
    ]
    mappingRuleName: 'string'
    tableName: 'string'
  }
}

For IotHub, use:

{
  kind: 'IotHub'
  properties: {
    consumerGroup: 'string'
    dataFormat: 'string'
    eventSystemProperties: [
      'string'
    ]
    iotHubResourceId: 'string'
    mappingRuleName: 'string'
    sharedAccessPolicyName: 'string'
    tableName: 'string'
  }
}

Property values

EventGridConnectionProperties

Name	Description	Value
blobStorageEventType	The name of blob storage event type to process.	'Microsoft.Storage.BlobCreated' 'Microsoft.Storage.BlobRenamed'
consumerGroup	The event hub consumer group.	string (required)
dataFormat	The data format of the message. Optionally the data format can be added to each message.	'APACHEAVRO' 'AVRO' 'CSV' 'JSON' 'MULTIJSON' 'ORC' 'PARQUET' 'PSV' 'RAW' 'SCSV' 'SINGLEJSON' 'SOHSV' 'TSV' 'TSVE' 'TXT' 'W3CLOGFILE'
eventHubResourceId	The resource ID where the event grid is configured to send events.	string (required)
ignoreFirstRecord	A Boolean value that, if set to true, indicates that ingestion should ignore the first record of every file	bool
mappingRuleName	The mapping rule to be used to ingest the data. Optionally the mapping information can be added to each message.	string
storageAccountResourceId	The resource ID of the storage account where the data resides.	string (required)
tableName	The table where the data should be ingested. Optionally the table information can be added to each message.	string

EventGridDataConnection

Name	Description	Value
kind	Kind of the endpoint for the data connection	'EventGrid' (required)
properties	The properties of the Event Grid data connection.	EventGridConnectionProperties

EventHubConnectionProperties

Name	Description	Value
compression	The event hub messages compression type	'GZip' 'None'
consumerGroup	The event hub consumer group.	string (required)
dataFormat	The data format of the message. Optionally the data format can be added to each message.	'APACHEAVRO' 'AVRO' 'CSV' 'JSON' 'MULTIJSON' 'ORC' 'PARQUET' 'PSV' 'RAW' 'SCSV' 'SINGLEJSON' 'SOHSV' 'TSV' 'TSVE' 'TXT' 'W3CLOGFILE'
eventHubResourceId	The resource ID of the event hub to be used to create a data connection.	string (required)
eventSystemProperties	System properties of the event hub	string[]
mappingRuleName	The mapping rule to be used to ingest the data. Optionally the mapping information can be added to each message.	string
tableName	The table where the data should be ingested. Optionally the table information can be added to each message.	string

EventHubDataConnection

Name	Description	Value
kind	Kind of the endpoint for the data connection	'EventHub' (required)
properties	The Event Hub data connection properties to validate.	EventHubConnectionProperties

IotHubConnectionProperties

Name	Description	Value
consumerGroup	The iot hub consumer group.	string (required)
dataFormat	The data format of the message. Optionally the data format can be added to each message.	'APACHEAVRO' 'AVRO' 'CSV' 'JSON' 'MULTIJSON' 'ORC' 'PARQUET' 'PSV' 'RAW' 'SCSV' 'SINGLEJSON' 'SOHSV' 'TSV' 'TSVE' 'TXT' 'W3CLOGFILE'
eventSystemProperties	System properties of the iot hub	string[]
iotHubResourceId	The resource ID of the Iot hub to be used to create a data connection.	string (required)
mappingRuleName	The mapping rule to be used to ingest the data. Optionally the mapping information can be added to each message.	string
sharedAccessPolicyName	The name of the share access policy	string (required)
tableName	The table where the data should be ingested. Optionally the table information can be added to each message.	string

IotHubDataConnection

Name	Description	Value
kind	Kind of the endpoint for the data connection	'IotHub' (required)
properties	The Iot Hub data connection properties.	IotHubConnectionProperties

Microsoft.Kusto/clusters/databases/dataConnections

Name	Description	Value
kind	Set to 'EventGrid' for type EventGridDataConnection. Set to 'EventHub' for type EventHubDataConnection. Set to 'IotHub' for type IotHubDataConnection.	'EventGrid' 'EventHub' 'IotHub' (required)
location	Resource location.	string
name	The resource name	string (required)
parent	In Bicep, you can specify the parent resource for a child resource. You only need to add this property when the child resource is declared outside of the parent resource. For more information, see Child resource outside parent resource.	Symbolic name for resource of type: clusters/databases

Quickstart samples

The following quickstart samples deploy this resource type.

Bicep File	Description
Deploy Azure Data Explorer DB with Cosmos DB connection	Deploy Azure Data Explorer DB with Cosmos DB connection.
Deploy Azure Data Explorer db with Event Grid connection	Deploy Azure Data Explorer db with Event Grid connection.
Deploy Azure Data Explorer db with Event Hub connection	Deploy Azure Data Explorer db with Event Hub connection.

ARM template resource definition

The clusters/databases/dataConnections resource type can be deployed with operations that target:

Resource groups - See resource group deployment commands

For a list of changed properties in each API version, see change log.

Resource format

To create a Microsoft.Kusto/clusters/databases/dataConnections resource, add the following JSON to your template.

{
  "location": "string",
  "name": "string",
  "kind": "string"
  // For remaining properties, see Microsoft.Kusto/clusters/databases/dataConnections objects
}

Microsoft.Kusto/clusters/databases/dataConnections objects

Set the kind property to specify the type of object.

For EventGrid, use:

{
  "kind": "EventGrid",
  "properties": {
    "blobStorageEventType": "string",
    "consumerGroup": "string",
    "dataFormat": "string",
    "eventHubResourceId": "string",
    "ignoreFirstRecord": "bool",
    "mappingRuleName": "string",
    "storageAccountResourceId": "string",
    "tableName": "string"
  }
}

For EventHub, use:

{
  "kind": "EventHub",
  "properties": {
    "compression": "string",
    "consumerGroup": "string",
    "dataFormat": "string",
    "eventHubResourceId": "string",
    "eventSystemProperties": [ "string" ],
    "mappingRuleName": "string",
    "tableName": "string"
  }
}

For IotHub, use:

{
  "kind": "IotHub",
  "properties": {
    "consumerGroup": "string",
    "dataFormat": "string",
    "eventSystemProperties": [ "string" ],
    "iotHubResourceId": "string",
    "mappingRuleName": "string",
    "sharedAccessPolicyName": "string",
    "tableName": "string"
  }
}

Property values

EventGridConnectionProperties

Name	Description	Value
blobStorageEventType	The name of blob storage event type to process.	'Microsoft.Storage.BlobCreated' 'Microsoft.Storage.BlobRenamed'
consumerGroup	The event hub consumer group.	string (required)
dataFormat	The data format of the message. Optionally the data format can be added to each message.	'APACHEAVRO' 'AVRO' 'CSV' 'JSON' 'MULTIJSON' 'ORC' 'PARQUET' 'PSV' 'RAW' 'SCSV' 'SINGLEJSON' 'SOHSV' 'TSV' 'TSVE' 'TXT' 'W3CLOGFILE'
eventHubResourceId	The resource ID where the event grid is configured to send events.	string (required)
ignoreFirstRecord	A Boolean value that, if set to true, indicates that ingestion should ignore the first record of every file	bool
mappingRuleName	The mapping rule to be used to ingest the data. Optionally the mapping information can be added to each message.	string
storageAccountResourceId	The resource ID of the storage account where the data resides.	string (required)
tableName	The table where the data should be ingested. Optionally the table information can be added to each message.	string

EventGridDataConnection

Name	Description	Value
kind	Kind of the endpoint for the data connection	'EventGrid' (required)
properties	The properties of the Event Grid data connection.	EventGridConnectionProperties

EventHubConnectionProperties

Name	Description	Value
compression	The event hub messages compression type	'GZip' 'None'
consumerGroup	The event hub consumer group.	string (required)
dataFormat	The data format of the message. Optionally the data format can be added to each message.	'APACHEAVRO' 'AVRO' 'CSV' 'JSON' 'MULTIJSON' 'ORC' 'PARQUET' 'PSV' 'RAW' 'SCSV' 'SINGLEJSON' 'SOHSV' 'TSV' 'TSVE' 'TXT' 'W3CLOGFILE'
eventHubResourceId	The resource ID of the event hub to be used to create a data connection.	string (required)
eventSystemProperties	System properties of the event hub	string[]
mappingRuleName	The mapping rule to be used to ingest the data. Optionally the mapping information can be added to each message.	string
tableName	The table where the data should be ingested. Optionally the table information can be added to each message.	string

EventHubDataConnection

Name	Description	Value
kind	Kind of the endpoint for the data connection	'EventHub' (required)
properties	The Event Hub data connection properties to validate.	EventHubConnectionProperties

IotHubConnectionProperties

Name	Description	Value
consumerGroup	The iot hub consumer group.	string (required)
dataFormat	The data format of the message. Optionally the data format can be added to each message.	'APACHEAVRO' 'AVRO' 'CSV' 'JSON' 'MULTIJSON' 'ORC' 'PARQUET' 'PSV' 'RAW' 'SCSV' 'SINGLEJSON' 'SOHSV' 'TSV' 'TSVE' 'TXT' 'W3CLOGFILE'
eventSystemProperties	System properties of the iot hub	string[]
iotHubResourceId	The resource ID of the Iot hub to be used to create a data connection.	string (required)
mappingRuleName	The mapping rule to be used to ingest the data. Optionally the mapping information can be added to each message.	string
sharedAccessPolicyName	The name of the share access policy	string (required)
tableName	The table where the data should be ingested. Optionally the table information can be added to each message.	string

IotHubDataConnection

Name	Description	Value
kind	Kind of the endpoint for the data connection	'IotHub' (required)
properties	The Iot Hub data connection properties.	IotHubConnectionProperties

Microsoft.Kusto/clusters/databases/dataConnections

Name	Description	Value
apiVersion	The api version	'2020-09-18'
kind	Set to 'EventGrid' for type EventGridDataConnection. Set to 'EventHub' for type EventHubDataConnection. Set to 'IotHub' for type IotHubDataConnection.	'EventGrid' 'EventHub' 'IotHub' (required)
location	Resource location.	string
name	The resource name	string (required)
type	The resource type	'Microsoft.Kusto/clusters/databases/dataConnections'

Quickstart templates

The following quickstart templates deploy this resource type.

Template	Description
Deploy Azure Data Explorer DB with Cosmos DB connection	Deploy Azure Data Explorer DB with Cosmos DB connection.
Deploy Azure Data Explorer db with Event Grid connection	Deploy Azure Data Explorer db with Event Grid connection.
Deploy Azure Data Explorer db with Event Hub connection	Deploy Azure Data Explorer db with Event Hub connection.

Terraform (AzAPI provider) resource definition

The clusters/databases/dataConnections resource type can be deployed with operations that target:

Resource groups

For a list of changed properties in each API version, see change log.

Resource format

To create a Microsoft.Kusto/clusters/databases/dataConnections resource, add the following Terraform to your template.

resource "azapi_resource" "symbolicname" {
  location = "string"
  name = "string"
  kind = "string"
  // For remaining properties, see Microsoft.Kusto/clusters/databases/dataConnections objects
}

Microsoft.Kusto/clusters/databases/dataConnections objects

Set the kind property to specify the type of object.

For EventGrid, use:

{
  kind = "EventGrid"
  properties = {
    blobStorageEventType = "string"
    consumerGroup = "string"
    dataFormat = "string"
    eventHubResourceId = "string"
    ignoreFirstRecord = bool
    mappingRuleName = "string"
    storageAccountResourceId = "string"
    tableName = "string"
  }
}

For EventHub, use:

{
  kind = "EventHub"
  properties = {
    compression = "string"
    consumerGroup = "string"
    dataFormat = "string"
    eventHubResourceId = "string"
    eventSystemProperties = [
      "string"
    ]
    mappingRuleName = "string"
    tableName = "string"
  }
}

For IotHub, use:

{
  kind = "IotHub"
  properties = {
    consumerGroup = "string"
    dataFormat = "string"
    eventSystemProperties = [
      "string"
    ]
    iotHubResourceId = "string"
    mappingRuleName = "string"
    sharedAccessPolicyName = "string"
    tableName = "string"
  }
}

Property values

EventGridConnectionProperties

Name	Description	Value
blobStorageEventType	The name of blob storage event type to process.	'Microsoft.Storage.BlobCreated' 'Microsoft.Storage.BlobRenamed'
consumerGroup	The event hub consumer group.	string (required)
dataFormat	The data format of the message. Optionally the data format can be added to each message.	'APACHEAVRO' 'AVRO' 'CSV' 'JSON' 'MULTIJSON' 'ORC' 'PARQUET' 'PSV' 'RAW' 'SCSV' 'SINGLEJSON' 'SOHSV' 'TSV' 'TSVE' 'TXT' 'W3CLOGFILE'
eventHubResourceId	The resource ID where the event grid is configured to send events.	string (required)
ignoreFirstRecord	A Boolean value that, if set to true, indicates that ingestion should ignore the first record of every file	bool
mappingRuleName	The mapping rule to be used to ingest the data. Optionally the mapping information can be added to each message.	string
storageAccountResourceId	The resource ID of the storage account where the data resides.	string (required)
tableName	The table where the data should be ingested. Optionally the table information can be added to each message.	string

EventGridDataConnection

Name	Description	Value
kind	Kind of the endpoint for the data connection	'EventGrid' (required)
properties	The properties of the Event Grid data connection.	EventGridConnectionProperties

EventHubConnectionProperties

Name	Description	Value
compression	The event hub messages compression type	'GZip' 'None'
consumerGroup	The event hub consumer group.	string (required)
dataFormat	The data format of the message. Optionally the data format can be added to each message.	'APACHEAVRO' 'AVRO' 'CSV' 'JSON' 'MULTIJSON' 'ORC' 'PARQUET' 'PSV' 'RAW' 'SCSV' 'SINGLEJSON' 'SOHSV' 'TSV' 'TSVE' 'TXT' 'W3CLOGFILE'
eventHubResourceId	The resource ID of the event hub to be used to create a data connection.	string (required)
eventSystemProperties	System properties of the event hub	string[]
mappingRuleName	The mapping rule to be used to ingest the data. Optionally the mapping information can be added to each message.	string
tableName	The table where the data should be ingested. Optionally the table information can be added to each message.	string

EventHubDataConnection

Name	Description	Value
kind	Kind of the endpoint for the data connection	'EventHub' (required)
properties	The Event Hub data connection properties to validate.	EventHubConnectionProperties

IotHubConnectionProperties

Name	Description	Value
consumerGroup	The iot hub consumer group.	string (required)
dataFormat	The data format of the message. Optionally the data format can be added to each message.	'APACHEAVRO' 'AVRO' 'CSV' 'JSON' 'MULTIJSON' 'ORC' 'PARQUET' 'PSV' 'RAW' 'SCSV' 'SINGLEJSON' 'SOHSV' 'TSV' 'TSVE' 'TXT' 'W3CLOGFILE'
eventSystemProperties	System properties of the iot hub	string[]
iotHubResourceId	The resource ID of the Iot hub to be used to create a data connection.	string (required)
mappingRuleName	The mapping rule to be used to ingest the data. Optionally the mapping information can be added to each message.	string
sharedAccessPolicyName	The name of the share access policy	string (required)
tableName	The table where the data should be ingested. Optionally the table information can be added to each message.	string

IotHubDataConnection

Name	Description	Value
kind	Kind of the endpoint for the data connection	'IotHub' (required)
properties	The Iot Hub data connection properties.	IotHubConnectionProperties

Microsoft.Kusto/clusters/databases/dataConnections

Name	Description	Value
kind	Set to 'EventGrid' for type EventGridDataConnection. Set to 'EventHub' for type EventHubDataConnection. Set to 'IotHub' for type IotHubDataConnection.	'EventGrid' 'EventHub' 'IotHub' (required)
location	Resource location.	string
name	The resource name	string (required)
parent_id	The ID of the resource that is the parent for this resource.	ID for resource of type: clusters/databases
type	The resource type	"Microsoft.Kusto/clusters/databases/dataConnections@2020-09-18"

Share via

Microsoft.Kusto clusters/databases/dataConnections 2020-09-18

Bicep resource definition

Resource format

Microsoft.Kusto/clusters/databases/dataConnections objects

Property values

EventGridConnectionProperties

EventGridDataConnection

EventHubConnectionProperties

EventHubDataConnection

IotHubConnectionProperties

IotHubDataConnection

Microsoft.Kusto/clusters/databases/dataConnections

Quickstart samples

ARM template resource definition

Resource format

Microsoft.Kusto/clusters/databases/dataConnections objects

Property values

EventGridConnectionProperties

EventGridDataConnection

EventHubConnectionProperties

EventHubDataConnection

IotHubConnectionProperties

IotHubDataConnection

Microsoft.Kusto/clusters/databases/dataConnections

Quickstart templates

Terraform (AzAPI provider) resource definition

Resource format

Microsoft.Kusto/clusters/databases/dataConnections objects

Property values

EventGridConnectionProperties

EventGridDataConnection

EventHubConnectionProperties

EventHubDataConnection

IotHubConnectionProperties

IotHubDataConnection

Microsoft.Kusto/clusters/databases/dataConnections

Feedback

Additional resources