DOCSEARCHbyAlgolia
Submit Docs

Microsoft Fabric Toolbox

repository·main·Indexed 21 days ago

https://github.com/microsoft/fabric-toolbox

A repository of tools, accelerators, scripts, and samples from the Fabric Customer Advisory Team (CAT). It includes the BCDR accelerator for automating disaster recovery of Git items, Lakehouses, and Warehouses; the Warehouse Automation Tool for DACPAC extraction and SQL endpoint deployment; and automation for branching to new workspaces.

Tokens
294.1K
Snippets
612
Records
1.1K
Agent score
75%

What's inside fabric-toolbox

  2. Overview of Fabric Workspace Monitoring Report Templates

    main

    The Fabric Workspace Monitoring Report Templates module provides pre-built reports (Real-Time Dashboards and Power BI Reports) built on top of the native Microsoft Fabric Workspace Monitoring feature. This allows for end-to-end visibility across Fabric workloads, enabling root-cause analysis, historical log analysis, and anomaly detection.

    Prerequisite: Workspace Monitoring must be enabled at the workspace level. When enabled, the workspace streams selected diagnostics to a KQL database within Fabric, which can be queried via KQL or SQL.

  3. Overview of Fabric Toolbox assets

    main

    The Fabric Toolbox is a collection of tools, accelerators, scripts, and samples designed to assist with Microsoft Fabric implementations. These assets are provided as examples to help developers and architects build custom solutions for their specific use cases. The repository is organized into several functional categories:

    • Monitoring: Tools for cost analysis, unified admin monitoring, platform monitoring (RTI and Capacity Events), workspace monitoring templates, and Spark monitoring.
    • Accelerators: Solutions for BCDR (Business Continuity and Disaster Recovery), CI/CD (Git-based, deployment pipelines, or workspace branching), Data Warehouse backup/recovery, and policy mirroring (Policy Weaver).
    • Samples: Implementation examples for Open Mirroring, data pipeline scheduling, storage event triggers, and various Notebook-based tasks (e.g., refreshing SQL endpoints, managing warehouses, or checking workspace size).
    • Scripts: SQL and DW-focused scripts for managing views, properties, active requests, and query management.
    • Tools: Standalone utilities such as the Fabric Assessment Tool, Data Factory Migration Assistant, MCP Servers for DAX and Semantic Models, and the MicrosoftFabricMgmt PowerShell module.

  4. Overview of Semantic Model MCP Server

    main

    The Semantic Model MCP Server (v0.3.0) is a Model Context Protocol (MCP) server that connects to Microsoft Fabric and Power BI semantic models. It is designed to be used as a 'chat with your semantic model' feature within VS Code Co-pilot, allowing developers to use their own LLM (e.g., via local compute) to interact with their data models.

    Core Capabilities:

    • Workspace & Dataset Management: Browse Power BI workspaces, list datasets, and navigate environments.
    • Model Manipulation: Retrieve TMSL (Tabular Model Scripting Language) definitions, create new models, and update existing ones.
    • Querying: Execute DAX queries and query Fabric Lakehouse tables via SQL Analytics Endpoints.
    • Fabric Integration: List lakehouses and Delta tables, and manage DirectLake models.
    • Best Practice Analyzer (BPA): Evaluate models against 71 industry rules for performance, DAX, and maintenance.
    • Documentation: Integrated Microsoft Learn search for authoritative guidance.

  5. Overview of FabricRTI_Accelerator

    main

    The FabricRTI_Accelerator provides a low-code, automated way to deploy Microsoft Fabric Real-Time Intelligence (RTI) workloads and entities. It is designed to simplify moving workloads between different environments or workspaces by automating the manual creation of items.

    Currently, the accelerator supports the automated provisioning of:

    • Eventhouse: Including KQL Databases and their entities such as Tables, Functions, and Materialized Views.
    • Eventstream: Including the full definition of sources, processing logic, and destinations.

  6. Overview of Semantic Model MCP Server Prompts

    main

    The Semantic Model MCP Server provides a collection of Model Context Protocol (MCP) prompts designed to assist with Microsoft Fabric and Power BI semantic model management. These prompts allow users to interact with their MCP client to perform tasks ranging from basic workspace exploration to advanced model optimization and Best Practice Analyzer (BPA) runs.

    Prompts are automatically registered when the server starts and are organized into functional categories such as Basic Exploration, Semantic Model Analysis, Model Optimization, Security & Governance, Lakehouse & SQL Analytics, DirectLake Models, Troubleshooting, Best Practice Analyzer (BPA), and Power BI Desktop Integration.

  7. Overview of Fabric Unified Admin Monitoring (FUAM)

    main

    Fabric Unified Admin Monitoring (FUAM) is a solution accelerator designed for holistic monitoring of the Microsoft Fabric platform. It provides a unified view by extracting data from various Fabric sources, allowing for both high-level analysis and fine-grained deep dives.

    Key Features:

    • Data Extraction: Automatically collects data including Tenant Settings, Delegated Tenant Settings, Activities, Workspaces, Capacities, Capacity Metrics, Tenant metadata (via Scanner API), Capacity Refreshables, and Git Connections.
    • Storage & Access: Data is stored in raw format and Delta Parquet within a Fabric Lakehouse. This enables direct consumption via Power BI Direct Lake mode or the Lakehouse SQL Endpoint using SQL.
    • Extensibility: Built with a modular architecture using Fabric Pipelines, Notebooks, and Lakehouses, allowing users to add their own modules or enrich the model with custom data.
    CAUTION

    FUAM is a solution accelerator and not an official Microsoft product. It is provided without official support, and changes to underlying Fabric elements (like the Capacity Metrics App) may impact its functionality.

  8. Overview of Data Factory to Microsoft Fabric Migration Assistant

    main

    The Data Factory to Microsoft Fabric Migration Assistant is an enterprise-grade web application designed to automate the migration of Azure Data Factory (ADF) and Azure Synapse Analytics pipelines to Microsoft Fabric Data Pipelines.

    It is a single-page application (SPA) that runs entirely in the browser, ensuring high security and privacy. Key characteristics include:

    • Zero Server Infrastructure: All processing happens client-side in the browser.
    • No Data Persistence: No data is stored beyond the active session.
    • Upload-First Design: You can upload and profile ARM templates anonymously to review compatibility and dependency graphs before authenticating.
    • Direct API Integration: Connects directly from the browser to Azure AD and Fabric APIs via OAuth 2.0.

  9. Overview of Fabric Cost Analysis (FCA)

    main

    Fabric Cost Analysis (FCA) is a solution accelerator designed to provide holistic monitoring of Microsoft Fabric costs. It combines financial and operational data to help users understand capacity usage, Azure quotas, and reservations.

    Key Capabilities:

    • Analyzes Azure Cost in FOCUS format.
    • Integrates enriched Microsoft Learn documentation.
    • (Optional) Incorporates Azure Reservations and Azure Quotas.
    • Provides data via Power BI Direct Lake using Delta Parquet format.
    • Supports natural language querying via a Data Agent on top of the semantic model.

    ⚠️ Caution: FCA is a solution accelerator and is not an official Microsoft product. It is provided without official support.

  10. Overview of Fabric ACE Toolkit Public Functions

    main

    The Fabric ACE Toolkit provides PowerShell functions to manage various Microsoft Fabric resources. Functions are organized by resource type:

    • Capacity & Workspace: Manage capacities, workspaces, identities, and role assignments.
    • Data & Pipelines: Manage Data Pipelines, Datamarts, and Notebooks.
    • Domains: Create, update, and assign domains to workspaces.
    • Environment: Manage Fabric Environments, libraries, and Spark compute.
    • KQL & Eventhouse: Manage Eventhouses, Eventstreams, KQL Databases, KQL Dashboards, and KQL Querysets.
    • Lakehouse & Warehouse: Manage Lakehouses (including tables and maintenance), Warehouses, and Mirrored Databases/Warehouses.
    • ML & Spark: Manage ML Experiments, ML Models, Spark Settings, and Spark Job Definitions.
    • Reports & Semantic Models: Manage Reports, Paginated Reports, Reflex, and Semantic Models.
    • Tenant: Manage Tenant settings and capacity overrides.
    • Utils: Helper functions for Base64 conversion and monitoring long-running operations.

  11. Overview of Automatic Column-level Lineage Extraction

    main

    The Lineage Extractor is a tool designed to automatically extract metadata and column-level lineage from Microsoft Fabric and upload it to Microsoft Purview Data Governance.

    It extracts the following information:

    • Lakehouses and Warehouses: Metadata for tables and their columns (via SQL queries).
    • PowerBI Reports: Attributes and their source Lakehouse/Warehouse tables (requires reports to be in the new PBIP/PBIR format).
    • Fabric Data Factory Pipelines: Column mappings from Copy Activities.

    The extracted data is stored in DataFrames for reuse in regulatory reporting or impact analysis, and it creates a graphical lineage graph in Microsoft Purview.

  12. Overview of Fabric Platform Monitoring modules

    main

    The Fabric Platform Monitoring solution accelerator provides observability for Fabric platform activities. It is divided into four main modules that can be used independently or together:

    • Capacity Utilization: Monitors capacity information in real-time using Capacity Events.
    • Gateway Monitoring: Receives real-time information from On-Premise Data Gateways (Note: does not work with VNET Gateways). Requires a PowerShell script deployed on the Gateway machine.
    • Activity Events: Extracts and stores platform activity events as quickly as possible (as low as 2-minute frequency) using Eventhouse for semi-structured data.
    • Inventory: Extracts tenant-level information (Capacities, Apps, Domains, Tenant Settings, etc.) in a semi-structured format.
    CAUTION

    Capacity Events are currently in Public Preview. Changes to this event source may require solution updates.