Microsoft Sentinel
Cloud and workloads

Customer intent: As a security engineer or data scientist, I want to explore and analyze security data in the Microsoft Sentinel data lake using Jupy…

In brief

The article now specifies required Microsoft Entra ID roles before creating or scheduling jobs, and a managed identity permission requirement for jobs that create custom analytics-tier tables. It also clarifies job-management and `save_as` guidance.

What Defender admins need to know

Before creating or scheduling jobs, verify the required roles and assign the documented managed identity access when custom tables are involved.

Summaries are generated from the documentation change itself.

Documentation change

The comparison below shows only the changed extract. Use the full-page view for complete context.

You can create scheduled jobs to run at specific times or intervals using the Microsoft Sentinel extension for Visual Studio Code. Jobs allow you to automate data processing tasks to summarize, transform, or analyze data in the Microsoft Sentinel data lake and federated tables. Jobs are also used to process data and write results to custom tables in the lake tier or analytics tier.

This article shows youThe following sections explain how to create, schedule, edit, and manage notebook jobs, including configuring job schedules, viewing job details and run history, and monitoring jobs in the Microsoft Defender portal.

Required permissions for notebook jobs

Create and schedule a job

Before you create or schedule a job, make sure you have one of the supported Microsoft Entra ID roles. If the job creates custom tables in the analytics tier, assign the data lake managed identity the Log Analytics Contributor role first. For more information, see Required permissions for notebook jobs.

You can create a job in one of three ways:

  1. In the notebook editor, select Create schedule Job from the toolbar.

    :::image type="content" source="./media/notebook-jobs/job-configuration.png" lightbox="./media/notebook-jobs/job-configuration.png" alt-text="A screenshot showing the job configuration page." :::

  2. To view your jobs, select the Microsoft Sentinel Screenshot of the Microsoft Sentinel icon in the VS Code activity bar, used to open the Microsoft Sentinel extension. icon in the left toolbar. Jobs are displayed on the Jobs panel.

  3. Select a job to see the job details.

In addition to viewing jobs in VS Code, you can also view your notebook jobs in the Defender portal. To view your jobs in the Defender portal, Select Microsoft Sentinel > Data lake exploration > Jobs .

The Jobspage shows a list of jobs and their types. Select a notebook job to view its details. You can enable and disable the job's schedule but you can't edit a notebook job in the Defender portal.

:::image type="content" source="media/notebook-jobs/view-jobs-in-defender-portal.png" lightbox="media/notebook-jobs/view-jobs-in-defender-portal.png" alt-text="A screenshot showing the jobs page in the Defender portal.":::

:::image type="content" source="media/notebook-jobs/portal-job-history.png" lightbox="media/notebook-jobs/portal-job-history.png" alt-text="A screenshot showing the jobs history page in the Defender portal.":::

Service parameters and limits and troubleshooting

The following sections summarize column naming rules,rules and service limits, and troubleshooting resourceslimits for notebook jobs in the Microsoft Sentinel data lake.

Column namesname requirements for the save_as method

The following rules applysave_as method writes notebook output to column names when using the save_as method to write data from a notebook todestination table in the Microsoft Sentinel data lake. The following column-naming rules apply when you use this method.

  • Column names must start with a letter.