Microsoft Sentinel
Cloud and workloads

Manage data tiers and retention in Microsoft Sentinel | Microsoft Learn

In brief

The article now documents a unified Defender portal experience for connector and table management, transformations, and ingestion-health monitoring, with Overview, Connectors, and Tables tabs.

What Defender admins need to know

Admins should verify URBAC, Data (manage), and equivalent workspace permissions. The experience is limited to commercial cloud, with some table-management limitations.

Summaries are generated from the documentation change itself.

Documentation change

The comparison below shows only the changed extract. Use the full-page view for complete context.

Manage data tiers and retention in Microsoft Sentinel | Microsoft Learn

Data you collect intoThe Microsoft Defender portal provides a centralized experience for managing Microsoft Sentinel (SIEM) and Microsoft Defender XDR is storeddata. The Data & connectors experience consolidates connector management, table management, transformations, and ingestion health monitoring into a single view, so you can understand and optimize your security data without navigating between separate pages.

This article introduces the Data & connectors experience and explains how to use it to manage data in tables. TheMicrosoft Sentinel and Microsoft Defender portal lets you manage the retention period and the storage costs associated with your data. You can manage retention and costs when you:XDR. For related tasks, see:

This article explains how to manage table retention and tier options

Data & connectors in the Microsoft Defender portal (preview)

Important

The Data & connectors experience is currently in PREVIEW. See the Supplemental Terms of Use for Microsoft Azure Previews for additional legal terms that apply to optimize security operationsAzure features that are in beta, preview, or otherwise not yet released into general availability.

The Data & connectors experience brings connector management, table management, transformations, and reduce costsingestion health monitoring together into a single view in the Microsoft Defender portal. Use it to understand and manage your Microsoft Sentinel data without navigating between separate pages.

Screenshot of the Data and connectors page showing the Overview, Connectors, and Tables tabs.

To open the experience, in the Microsoft Defender portal, select Setup & configuration > Data & connectors. The page includes three tabs:

  • Overview tab — Workspace-level ingestion health dashboard.
  • Connectors tab — Centralized inventory of data connectors, including classic Sentinel connectors and unified connectors.
  • Tables tab — Table management, schema exploration, transformations, and retention.

Prerequisites

To use the Data & connectors experience in preview, you need:

  • Unified role-based access control (URBAC) enabled in the Microsoft Defender portal.
  • Data (manage) permission in the Data Operations permission group.
  • Workspace permissions equivalent to Log Analytics Contributor, including:
    • Microsoft.OperationalInsights/workspaces/write
    • Microsoft.OperationalInsights/workspaces/tables/write

Known limitations

The following limitations apply to the preview:

  • The Data Sources tab on the table details panel appears only for federated tables. Support for other table types is planned.
  • The Data & connectors experience is available in the commercial cloud only. Sovereign clouds, including US Government and China, aren't supported.

Overview tab

The Overview tab is a workspace-level dashboard that surfaces ingestion health signals so you can act on issues before they impact detections. Filter by time range and workspace to scope the dashboard.

The Overview tab includes:

  • Ingestion volume — Daily ingestion split by Analytics tier and Data Lake tier for the selected time range.
  • Connectors that need attention — Connectors with credential errors, ingestion failures, or outages, along with the error type, failure count in the last 24 hours, and last successful ingestion.
  • Table ingestion fluctuations — Tables with unexpected volume changes compared to the same day the previous week, grouped as spikes and drops. You can adjust the fluctuation thresholds.
  • Data ingestion volume by table — Top ingesting tables ranked by daily volume, so you can identify high-volume tables driving ingestion costs.
  • Ingestion latency by table — The time between data generation and availability in your environment, so you can identify connector throttling or source-side delays.

Screenshot of Overview health insights showing ingestion volume, a connector that needs attention, and table ingestion fluctuations.

Screenshot of the Data ingestion volume by table chart showing daily volume trends for the top 10 tables.

Screenshot of the Ingestion latency by table chart showing P95 latency trends for all tables.

Connectors tab

The Connectors tab brings unified data connectors and Sentinel classic data connectors together in a single inventory. Use it to review connector health, add new connectors, or open a connector's details view.

The Connectors tab includes:

  • Unified connector inventory — All onboarded connectors, with status, provider, content source, and available updates.
  • Toggle between unified and classic connectors — Use the classic connectors selector to switch between the unified connector catalog and the Sentinel classic data connectors inventory, which includes connectors built with the Codeless Connector Framework (CCF).
  • Filter by provider, data type, and status — Narrow the list to find specific connectors quickly.
  • Data onboarding assistant — Guided flow to add new connectors.
  • Create custom connector — Start a new custom connector from the Connectors tab.

Screenshot of the connector selector with Sentinel under Classic connectors and My connectors under Unified connectors.

Tables tab

Data you collect into Microsoft Sentinel and Microsoft Defender XDR.XDR is stored in tables. The Tables tab is where you view your tables, review their ingestion health, inspect their schema and transformations, and manage the retention period and storage costs associated with your data.

Which tables can you manage in the Microsoft Defender portal?

This section describes the table types you can manage in the Microsoft Defender portal.

You can view Basic Logs tables in your Microsoft Sentinel workspace from the Microsoft Defender portal, but you can currently manage them only from your Log Analytics workspace. To manage these tables from the Microsoft Defender portal, change the table plan from Basic Logs to Analytics in your Microsoft Sentinel workspace.

How data tiers and retention work

You can retain data in Microsoft Sentinel in one of two tiers:

For more information about the Microsoft Sentinel data lake, see What is Microsoft Sentinel data lake.

Use Table insights for table-level observability

In the Microsoft Defender portal, Table insights is a built-in monitoring view on the Tables page that tab helps you understand ingestion health at the table level for the selected Microsoft Sentinel workspace. It gives you quick observability signals so you can identify ingestion and cost patterns before you change tier or retention settings.

Table insights includes signals such as:appear in two places on the Tables tab:

  • Ingestion volume by tierSummary tiles at the top of the page show workspace-level counts, including the number of tables and how they're distributed across the Analytics tier, Data Lake tier, and XDR default tier.
  • Day-over-week ingestion fluctuations
  • TopColumns in the tables by daily ingestion volume
  • gridshow per-table health signals for each table, including:
    • Last data received
    • Average daily ingestion volume
    • Estimated daily ingestion cost
    • Volume anomaly (day-over-week ingestion fluctuation)

Use the grid columns to sort, filter, and compare tables side by side. Combine these signals to detect connector failures, investigate cost spikes, validate new connector onboarding, and identify candidates for right-sizing retention and tier.

Screenshot of the Tables grid showing filters and table insights columns for tier, last data received, average daily ingestion, estimated daily cost, volume anomaly, and retention.

Important

For setup, access, and interpretation guidance, see Configure table settings in Microsoft Sentinel.

Table details panel

Select a table on the Tables tab to open the table details panel. The panel consolidates schema, transformations, and retention information for the selected table. It includes the following tabs:

TabWhat it shows
OverviewTable type, tier, analytics retention, total retention, and other table metadata.
SchemaColumn names, data types, and column descriptions for the selected table. Use this tab to inspect schema without running KQL queries.
TransformationsFilter, Split, and Scope Tag transformation rules that apply to the table. You can view, create, edit, and delete transformation rules from this tab.
RetentionAnalytics retention and total retention settings for the table.
Data SourcesConnector information for the table. This tab appears only for federated table types.

Compare the analytics and data lake tiers

This table compares the Analytics and Data Lake tiers and their key characteristics:

| Data export | ✅ | ❌ | | Retention period | 90 days for Microsoft Sentinel, 30 days for Microsoft Defender XDR. Can be extended to up to two years at a prorated monthly long-term retention charge. | Same as analytics retention, by default. Can be extended to up to 12 years. |

What happens when you modify table settings

You can switch a table's tier and retention settings at any time.

  • You change analytics retention to 90 days without changing total retention, which remains 180 days.
  • Microsoft Sentinel automatically removes the last 90 days of data from analytics retention, but continues to store data that's 90-180 days old in the Data Lake tier.

Manage XDR data in Microsoft Sentinel

By default, Microsoft Defender XDR retains threat hunting data in the XDR default tier for 30 days. This data isn't ingested into the Analytics or Data Lake tiers by default. If you extend the retention period of supported XDR tables beyond 30 days and up to 90 days, Sentinel ingestion costs apply, but there are no additional storage costs. The tables are created in your Microsoft Sentinel workspace in the Analytics tier and mirrored to the Data Lake tier.

For more information about managing your tables and data, see Manage your existing tables and data.

XDR data retention and costs

The following tables summarize the free retention periods and cost implications for the different tiers in Microsoft Sentinel: