Microsoft Sentinel
Cloud and workloads

Set up federated data connectors in Microsoft Sentinel data lake (Preview)

In brief

The page now labels the capability as Preview, clarifies storing the client secret in Azure Key Vault, reorganizes connector sections, and adds Azure Databricks prerequisites for hybrid workspaces, external data access, and Delta Parquet tables.

What Defender admins need to know

Administrators configuring Azure Databricks federation should verify these prerequisites and retain the client secret for Key Vault.

Summaries are generated from the documentation change itself.

Documentation change

The comparison below shows only the changed extract. Use the full-page view for complete context.

Set up federated data connectors in Microsoft Sentinel data lake (Preview)

This article explains how to configure federated data connectors to enable querying of external data sources from the Microsoft Sentinel data lake. You can federate with Azure Databricks, Azure Data Lake Storage (ADLS) Gen 2, and Microsoft Fabric. The article walks through creating a service principal, storing credentials in Azure Key Vault, and setting up a connector instance for each supported data source. Use this guide if you're a security administrator who needs to bring external data into Microsoft Sentinel for investigation and analysis.

  1. Select New client secret.

  2. Enter a description and select an expiration period.

  3. Select Add.

  4. Copy the client secret value immediately for use in the next section. Youbecause you can't retrieve it later. You need this value afterwhen you leavestore the page.secret in Azure Key Vault.

  5. Note the application details:

    • Application (client) ID

The process for creating a connector instance varies depending on whether you're connecting to Microsoft Fabric, Azure Data Lake Storage Gen 2, or Azure Databricks. Follow the instructions for your specific data source type.

Microsoft Fabric

Use this tabthe following steps to create a federated connector instance for Microsoft Fabric.

Create a Microsoft Fabric connector instance

Before configuring the Fabric connector instance, you must set up permissions within the Microsoft Fabric environment to allow Microsoft Sentinel to access the data.

  1. Select Connect to create the connection instance.

Azure Data Lake Storage Gen 2

Azure Data Lake Storage Gen 2

Use this tabthe following steps to create a federated connector instance for Azure Data Lake Storage (ADLS) Gen 2.

Create an ADLS Gen 2 connector instance

Before creating the connector, prepare your storage account:

Select Connect, to complete the setup for the ADLS Gen 2 connector instance. The wizard closes and the instance count for Azure Data Lake Storage Gen2 increases.

Azure Databricks

Use this tabthe following steps to create a federated connector instance for Azure Databricks.

Create an

Prepare the Azure Databricks connector instance

environment

Before creating the connector, configure access in your Databricks environment as follows:

  1. Select the service principal you created earlier and select Add.

Create the Azure Databricks connector instance

Follow these steps to create the Azure Databricks connector instance in the Defender portal:

  1. On the Data federation > Catalog page, select the Azure Databricks row.
  2. In the side panel, select Connect a connector.

After selecting Connect, the wizard closes and the instance count for Databricks increases.


Verify tables from your connector instance

After creating a connector instance check that the tables you federated are available in Microsoft Sentinel.

:::image type="content" source="./media/data-federation-setup/verify-tables.png" lightbox="./media/data-federation-setup/verify-tables.png" alt-text="Screenshot showing the federated table schema.":::

Manage connector instances

To modify or delete a connector instance:

  • Verify the Sentinel platform managed identity prefixed by msg-resources- has the correct permissions on Azure Key Vault.

  • If your connection source is Azure Databricks or Azure Data Lake Storage Gen2, ensure the Key Vault secret contains the correct client secret for your service principal.

  • If your connection source is Azure Databricks, confirm the target uses hybrid workspace type and that external data access has been enabled for the workspace.

  • The Key Vault networking must be set to Allow public access from all networks during the connector configuration, which is the default configuration of Key Vault. It can be changed after connector creation or editing.

  • Confirm the external data source is publicly accessible.

  • Check that the service principal has appropriate permissions on the target data source for Azure Databricks and ADLS.

Tables don't appear

  • Verify the service principal has read access to the target tables for ADLS and Azure Databricks, and the service principal is in the same tenant as these data sources.

  • Verify the target tables are in delta parquet format.

  • For Databricks, ensure you granted both the built-in Data Reader privilege preset plus the External Use Schema permission to the service principal.

  • For ADLS Gen 2, confirm the Storage Blob Data Reader role is assigned to the service principal.