Agent Skill
2/7/2026

testing

Comprehensive testing skill covering unit, integration, and E2E testing with pytest, Jest, Cypress, and Playwright. Use for writing tests, improving coverage, debugging test failures, and setting up testing infrastructure.

F
fgarofalo56
0GitHub Stars
1Views
npx skills add fgarofalo56/Suppercharge_Microsoft_Fabric

SKILL.md

Nametesting
DescriptionComprehensive testing skill covering unit, integration, and E2E testing with pytest, Jest, Cypress, and Playwright. Use for writing tests, improving coverage, debugging test failures, and setting up testing infrastructure.
<div align="center" markdown>

๐ŸŽฐ Supercharge Microsoft Fabric ๐ŸŽฒ

Casino & Gaming Industry POC + Federal Expansions

Microsoft Fabric Azure Python PySpark License: MIT Docker Dev Container Tutorials Tests Phase

Transform your casino operations with enterprise-grade analytics powered by Microsoft Fabric

Real-time insights โ€ข Medallion Architecture โ€ข Regulatory Compliance โ€ข Direct Lake BI

๐Ÿ“š Documentation โ€ข ๐Ÿš€ Quick Start โ€ข ๐Ÿณ Docker โ€ข ๐Ÿ“– Tutorials โ€ข ๐Ÿ—๏ธ Architecture โ€ข ๐Ÿ“Š POC Agenda


</div>

๐Ÿ“ Navigation

Home / README

SectionDescription
๐ŸŽฏ OverviewWhat this POC delivers
๐Ÿ‘ฅ Target AudienceWho should use this
๐Ÿš€ Quick StartGet up and running
โšก 5-Minute Quick StartFastest path to first results
๐Ÿ“‹ Cheat SheetQuick reference & commands
๐Ÿณ Docker SupportContainer-based deployment
๐Ÿ’ป Dev ContainerOne-click development setup
๐Ÿ“Š Power BI ReportsPre-built report templates
๐Ÿ’ฐ Cost EstimationAzure cost planning
๐Ÿ“ Sample DataPre-generated datasets
๐Ÿ—๏ธ ArchitectureTechnical deep-dive
๐ŸŽฐ Data DomainsGaming-specific domains
๐Ÿ“‚ Repository StructureWhat's included
๐Ÿ“Š POC AgendaWorkshop schedule
๐Ÿ“– TutorialsLearning path
๐Ÿ“š Documentation SiteFull docs with search
๐Ÿ“œ ComplianceRegulatory coverage
๐Ÿ›๏ธ Phase 7 ExpansionsFederal, streaming, analytics expansions
๐Ÿ†• Phase 9-10 New Fabric Experience40+ new feature docs, best practices, Bicep modules

๐ŸŽฏ Overview

This repository provides a complete, production-ready proof-of-concept environment for Microsoft Fabric, purpose-built for the casino and gaming industry.

<table> <tr> <td width="50%">

โœจ Key Features

FeatureDescription
๐Ÿ›๏ธ Medallion ArchitectureBronze/Silver/Gold Lakehouse
โšก Real-Time IntelligenceCasino floor monitoring
๐Ÿ“Š Direct LakeSub-second Power BI analytics
๐Ÿ” Microsoft PurviewData governance & compliance
๐Ÿš€ Infrastructure as CodeBicep/ARM deployment
๐Ÿ“š Step-by-Step TutorialsHands-on learning path
</td> <td width="50%">

๐Ÿ’Ž Value Proposition

โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚  ๐ŸŽฐ REAL-TIME SLOT TELEMETRY        โ”‚
โ”‚  ๐ŸŽฒ TABLE GAME ANALYTICS            โ”‚
โ”‚  ๐Ÿ‘ค PLAYER 360 INSIGHTS             โ”‚
โ”‚  ๐Ÿ’ฐ FINANCIAL COMPLIANCE            โ”‚
โ”‚  ๐Ÿ”’ SECURITY & SURVEILLANCE         โ”‚
โ”‚  ๐Ÿ“‹ REGULATORY REPORTING            โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
</td> </tr> </table>

๐Ÿ‘ฅ Target Audience

<table> <tr> <td align="center" width="16%"> <h2>๐Ÿ—๏ธ</h2> <b>Data Architects</b><br/> <sub>Evaluating Fabric</sub> </td> <td align="center" width="16%"> <h2>โš™๏ธ</h2> <b>Data Engineers</b><br/> <sub>Medallion patterns</sub> </td> <td align="center" width="16%"> <h2>๐Ÿ“Š</h2> <b>BI Developers</b><br/> <sub>Direct Lake solutions</sub> </td> <td align="center" width="16%"> <h2>๐Ÿ“</h2> <b>Solution Architects</b><br/> <sub>Enterprise platforms</sub> </td> <td align="center" width="16%"> <h2>๐ŸŽฐ</h2> <b>Gaming Industry</b><br/> <sub>Regulated operations</sub> </td> <td align="center" width="16%"> <h2>๐Ÿจ</h2> <b>Hospitality</b><br/> <sub>Guest analytics</sub> </td> </tr> </table>

๐Ÿš€ Quick Start

Choose your preferred deployment method:

MethodBest ForTime to Start
๐Ÿณ Docker Quick StartQuick demos, testing data generators~5 minutes
๐Ÿ’ป Dev ContainerFull development environment~10 minutes
โ˜๏ธ Azure DeploymentProduction-like POC environment~30 minutes

๐Ÿ”€ Two Ways to Run This POC

Path A (Production-Aligned): Deploy Azure infrastructure via Bicep (infra/main.bicep), upload data to ADLS Gen2, and connect it to Fabric via OneLake shortcuts. This unlocks governance (Purview), security (Private Endpoints), and monitoring tutorials. Cost: ~$1-3/day idle.

Path B (Quickstart): Skip Bicep entirely โ€” upload generated data straight into your Fabric Lakehouse via the UI and start running notebooks immediately. Fastest path to learning the medallion architecture. Upgrade to Path A anytime.

See Tutorial 00 โ€” Step 4 for details.


Docker Quick Start

The fastest way to generate sample data and explore the POC.

# Clone the repository
git clone https://github.com/fgarofalo56/Suppercharge_Microsoft_Fabric.git
cd Suppercharge_Microsoft_Fabric

# Generate demo data (1000 events, 7 days)
docker-compose run --rm demo-generator

# Generate full dataset (30 days, all domains)
docker-compose run --rm data-generator

# Output will be in ./output directory

๐Ÿ’ก Pro Tip: Use the demo generator for quick testing (generates in ~2 minutes), or the full data generator for realistic POC scenarios with 30 days of data.

See Docker Support for more options.


Dev Container Quick Start

One-click development environment with all tools pre-configured.

VS Code:

  1. Install the Dev Containers extension
  2. Open this repository in VS Code
  3. Click "Reopen in Container" when prompted (or use Ctrl+Shift+P > "Dev Containers: Reopen in Container")

GitHub Codespaces:

  1. Click the green "Code" button on GitHub
  2. Select "Codespaces" tab
  3. Click "Create codespace on main"

๐Ÿ’ก Pro Tip: GitHub Codespaces provides a cloud-based development environment with no local installation required. Perfect for team collaboration and workshops.

See Dev Container for configuration details.


Azure Deployment

๐Ÿ“‹ Prerequisites: Complete the full Prerequisites Guide before starting deployment. This includes Azure subscription setup, tool installation, and resource provider registration.

Prerequisites Checklist

  • Azure subscription with Owner or Contributor access
  • Microsoft Fabric capacity (F64 recommended for POC)
  • Azure CLI 2.50+ with Bicep extension
  • PowerShell 7+ or Bash
  • Git installed
  • Docker (optional, for data generation)

Step-by-Step Deployment

<table> <tr> <td width="80">

1๏ธโƒฃ

</td> <td>

Clone the Repository

git clone https://github.com/fgarofalo56/Suppercharge_Microsoft_Fabric.git
cd Suppercharge_Microsoft_Fabric
</td> </tr> <tr> <td>

2๏ธโƒฃ

</td> <td>

Configure Environment

cp .env.sample .env
# Edit .env with your Azure subscription and tenant details

โš ๏ธ Warning: Ensure all required environment variables are populated. Missing values will cause deployment failures.

</td> </tr> <tr> <td>

3๏ธโƒฃ

</td> <td>

Login to Azure

az login
az account set --subscription "<your-subscription-id>"
</td> </tr> <tr> <td>

4๏ธโƒฃ

</td> <td>

Deploy Infrastructure

az deployment sub create \
  --location eastus2 \
  --template-file infra/main.bicep \
  --parameters infra/environments/dev/dev.bicepparam

๐Ÿ’ก Pro Tip: Run az deployment sub what-if first to preview all resource changes before actual deployment.

</td> </tr> <tr> <td>

5๏ธโƒฃ

</td> <td>

Start Learning

๐Ÿ‘‰ Begin with Tutorial 00: Environment Setup

</td> </tr> </table>

๐Ÿ—๏ธ Architecture

High-Level Data Flow

flowchart TB
    subgraph Sources["๐Ÿ“ฅ Data Sources"]
        RT[/"โšก Real-Time<br/>Casino Floor"/]
        BATCH[/"๐Ÿ“ฆ Batch<br/>Systems"/]
        EXT[/"๐Ÿ”— External<br/>APIs"/]
    end

    subgraph Ingestion["๐Ÿ”„ Ingestion Layer"]
        ES[Eventstreams]
        DF[Dataflows Gen2]
        MR[Database Mirroring]
    end

    subgraph Medallion["๐Ÿ›๏ธ Medallion Architecture"]
        subgraph Bronze["๐Ÿฅ‰ BRONZE"]
            BL[(Bronze Lakehouse<br/>Raw Data)]
        end
        subgraph Silver["๐Ÿฅˆ SILVER"]
            SL[(Silver Lakehouse<br/>Cleansed)]
        end
        subgraph Gold["๐Ÿฅ‡ GOLD"]
            GL[(Gold Lakehouse<br/>Business Ready)]
        end
    end

    subgraph Analytics["๐Ÿ“Š Analytics & Governance"]
        DL[Direct Lake<br/>Semantic Model]
        EH[Eventhouse<br/>KQL Analytics]
        PV[Microsoft Purview<br/>Governance]
    end

    subgraph Consumption["๐Ÿ‘๏ธ Consumption"]
        PBI[Power BI<br/>Reports]
        RTD[Real-Time<br/>Dashboards]
        API[REST APIs]
    end

    RT --> ES
    BATCH --> DF
    EXT --> MR

    ES --> BL
    DF --> BL
    MR --> BL

    BL --> SL
    SL --> GL

    GL --> DL
    GL --> EH
    GL -.-> PV
    SL -.-> PV
    BL -.-> PV

    DL --> PBI
    EH --> RTD
    GL --> API

    style Bronze fill:#cd7f32,color:#fff
    style Silver fill:#c0c0c0,color:#000
    style Gold fill:#ffd700,color:#000

Architecture Highlights

<details> <summary><b>๐Ÿฅ‰ Bronze Layer - Raw Ingestion</b></summary>
  • Purpose: Land raw data with minimal transformation
  • Pattern: Schema-on-read, append-only
  • Format: Delta Lake tables
  • Retention: Configurable (default 90 days)
  • Key Feature: Full historical lineage preserved
</details> <details> <summary><b>๐Ÿฅˆ Silver Layer - Cleansed & Validated</b></summary>
  • Purpose: Business rules and data quality
  • Pattern: Slowly Changing Dimensions (SCD Type 2)
  • Transformations: Deduplication, validation, standardization
  • Data Quality: Great Expectations integration
  • Key Feature: Audit-ready data lineage
</details> <details> <summary><b>๐Ÿฅ‡ Gold Layer - Business Ready</b></summary>
  • Purpose: Aggregations, KPIs, and business metrics
  • Pattern: Star/Snowflake schema
  • Optimization: Partitioned by date, optimized for queries
  • Refresh: Incremental or scheduled
  • Key Feature: Direct Lake semantic model integration
</details> <details> <summary><b>โšก Real-Time Intelligence</b></summary>
  • Eventstreams: Apache Kafka-compatible streaming
  • Eventhouse: KQL-based analytics database
  • Latency: Sub-second to seconds
  • Use Cases: Slot monitoring, player alerts, anomaly detection
</details>

๐Ÿ›๏ธ Phase 7: Industry Expansions

[!NOTE] Phase 7 Complete โ€” 71 features delivered across 5 waves with 197/197 tests passing and zero regressions.

Phase 7 expanded the Casino/Gaming POC to cover federal agencies, migration paths, streaming connectors, analytics pipelines, tribal healthcare, and DOT/FAA transportation.

flowchart TD
    subgraph Core["๐ŸŽฐ Casino/Gaming POC (Phases 1-6)"]
        C[Reference Implementation<br/>92/100 Audit Score]
    end

    subgraph W1["๐Ÿ›๏ธ Wave 1: Federal Agencies"]
        USDA[USDA<br/>Crop & Food Safety]
        SBA[SBA<br/>PPP & 7a Loans]
        NOAA[NOAA<br/>Weather & Storms]
        EPA[EPA<br/>Air & Water Quality]
        DOI[DOI<br/>Earthquakes & Land]
        DOJ[DOJ<br/>Crime & Antitrust]
    end

    subgraph W2["๐Ÿ”„ Wave 2: Migration & Streaming"]
        MIG[Migration Tutorials<br/>Snowflake ยท DB2 ยท Teradata]
        STR[8 Streaming Notebooks<br/>CDC ยท IoT ยท Kafka]
    end

    subgraph W3["๐Ÿ“Š Wave 3: Analytics"]
        VID[Video Security<br/>YOLO ยท DeepSORT]
        MOV[People Movement<br/>30 Zones ยท Queue Detection]
        GEO[Geolocation<br/>H3 ยท Geofencing]
    end

    subgraph W4["๐Ÿฅ Wave 4: Expansions"]
        TH[Tribal Healthcare<br/>HIPAA ยท IHS ยท FHIR]
        DOT[DOT/FAA<br/>FedRAMP ยท Aviation]
    end

    C --> W1
    C --> W2
    C --> W3
    W1 --> W4
    W2 --> W4
    W3 --> W4

    style Core fill:#ffd700,color:#000
    style W1 fill:#4a90d9,color:#fff
    style W2 fill:#50c878,color:#000
    style W3 fill:#ff6b6b,color:#fff
    style W4 fill:#9b59b6,color:#fff
WaveScopeFeaturesTestsStatus
Wave 1Federal Agencies (USDA, SBA, NOAA, EPA, DOI)2654๐ŸŸข Complete
Wave 2Migration & Streaming1920๐ŸŸข Complete
Wave 3Video, Movement, Geolocation Analytics1230๐ŸŸข Complete
Wave 4Tribal Healthcare + DOT/FAA15โ€”๐ŸŸข Complete
Wave 5Final Regression1197๐ŸŸข Complete
Total71197All Complete

๐Ÿ†• Phase 9-10: New Fabric Experience

[!NOTE] Phases 9-10 Complete โ€” Full coverage of the new Microsoft Fabric experience (July 2025 โ€“ April 2026 GA wave) with 40+ new documents, 8 Bicep modules, and 269/269 tests passing.

Phases 9 and 10 modernize the POC for the new Fabric experience, covering every major feature and enterprise best practice.

New Feature Documentation (22 features)

CategoryFeatures
AI & IntelligenceFabric IQ, AI Copilot, Data Agents, AutoML & Model Endpoints, Fabric MCP
Data IntegrationMirroring (Oracle/SAP/BigQuery/MySQL), Copy Job CDC, dbt Integration
AnalyticsDirect Lake, Real-Time Intelligence, Semantic Link, Eventhouse Vector DB
PlatformFabric SQL Database, API for GraphQL, Translytical Task Flows, Digital Twin Builder
GovernanceOneLake Security, OneLake Catalog, Workspace Monitoring, Data Mesh, Iceberg Interop
PerformanceMaterialized Lake Views, Lakehouse Schemas, Shortcut Transformations

Enterprise Best Practices (16 guides)

CategoryGuides
OperationsCapacity Planning & Cost Optimization, Monitoring & Observability, Testing Strategies
SecurityNetwork Security (PE/VNet/IP Firewall), Identity & RBAC, Customer-Managed Keys, Outbound Access Protection
ArchitectureMedallion Deep Dive, Multi-Tenant Workspace, Data Sharing & Federation, Migration Patterns
Data EngineeringIncremental Refresh & CDC, fabric-cicd CI/CD, Spark Runtime Migration, SQL Audit Logs
ResilienceDisaster Recovery & BCDR, Alerting & Data Activator

Infrastructure (Bicep)

ModulePurpose
fabric-warehouse.bicepFabric Warehouse configuration metadata
fabric-sql-database.bicepFabric SQL Database with DDM & CMK
fabric-pipeline.bicepData Factory Pipeline with scheduling
alerts-and-budgets.bicepCapacity alerts & budget management
workspace-identity.bicepWorkspace Identity (GA 2026)

๐Ÿ‘‰ See Feature Documentation and Best Practices for the complete guides.


๐Ÿณ Docker Support

Run the data generators and validation tools without installing any dependencies.

Available Services

ServiceCommandDescription
data-generatordocker-compose run --rm data-generatorGenerate full dataset (30 days)
demo-generatordocker-compose run --rm demo-generatorQuick demo dataset (7 days, smaller volumes)
streaming-generatordocker-compose up streaming-generatorReal-time streaming to Event Hub
data-validatordocker-compose run --rm data-validatorValidate generated data

Common Commands

# Build the Docker image
docker-compose build

# Generate all data with custom parameters
docker-compose run --rm data-generator --all --days 14 --format parquet

# Generate specific data types
docker-compose run --rm data-generator --slots 50000 --players 1000

# Stream events to Azure Event Hub (requires configuration)
EVENTHUB_CONNECTION_STRING="your-connection-string" \
EVENTHUB_NAME="slot-telemetry" \
docker-compose up streaming-generator

# Run validation on generated data
docker-compose run --rm data-validator

Environment Variables

VariableDefaultDescription
DATA_FORMATparquetOutput format (parquet, csv, json)
DATA_DAYS30Days of historical data to generate
EVENTHUB_CONNECTION_STRING-Azure Event Hub connection string
EVENTHUB_NAMEslot-telemetryEvent Hub name for streaming
STREAMING_RATE10Events per second for streaming

For detailed Docker documentation, see docker/README.md.


๐Ÿ’ป Dev Container

The Dev Container provides a complete, pre-configured development environment with all necessary tools.

Included Tools

ToolVersionPurpose
Python3.11Data generation, notebooks
Azure CLILatestAzure resource management
BicepLatestInfrastructure as Code
GitLatestVersion control
PowerShell7.xScripting
Docker CLILatestContainer management

VS Code Extensions (Pre-installed)

  • Azure Account
  • Bicep
  • Python
  • Jupyter
  • Docker
  • GitHub Copilot (if licensed)
  • Power BI (preview)

Features

  • Automatic Python environment: Virtual environment created on container start
  • Azure CLI authentication: Sign in once, stay authenticated
  • Port forwarding: Automatic forwarding for Jupyter and other services
  • GitHub Codespaces ready: Same experience in the cloud

Configuration Files

.devcontainer/
โ”œโ”€โ”€ devcontainer.json    # Main configuration
โ”œโ”€โ”€ Dockerfile           # Container image definition
โ””โ”€โ”€ post-create.sh       # Post-creation setup script

For customization options, see the Dev Containers documentation.


๐Ÿ“Š Power BI Reports

Pre-built Power BI report templates and semantic model definitions for quick deployment.

Available Reports

ReportDescriptionKey Visuals
Casino Executive DashboardHigh-level KPIs and trendsRevenue trends, floor performance, player metrics
Slot Performance AnalysisMachine-level analyticsHold percentage, utilization, jackpot frequency
Player 360 ViewCustomer analyticsPlayer segments, lifetime value, visit patterns
Compliance MonitoringRegulatory reportingCTR/SAR status, W-2G tracking, audit trails
Real-Time Floor MonitorLive casino floor statusMachine status, alerts, occupancy

Report Locations

reports/
โ”œโ”€โ”€ report-definitions/           # Power BI report definition files
โ”‚   โ”œโ”€โ”€ executive-dashboard/
โ”‚   โ”œโ”€โ”€ slot-performance/
โ”‚   โ””โ”€โ”€ player-360/
โ””โ”€โ”€ semantic-model/               # Direct Lake semantic model
    โ”œโ”€โ”€ tables/                   # Table definitions
    โ””โ”€โ”€ measures/                 # DAX measures

How to Import

  1. Connect to Fabric Workspace: Open Power BI Desktop, connect to your Fabric workspace
  2. Import Semantic Model: Use the definitions in reports/semantic-model/
  3. Import Reports: Open .pbip files from reports/report-definitions/
  4. Configure Data Source: Point to your Gold layer Lakehouse

For detailed instructions, see reports/README.md.


๐Ÿ’ฐ Cost Estimation

Understand Azure costs before deployment with our comprehensive cost guide.

Quick Reference

EnvironmentFabric SKUMonthly EstimateNotes
DevelopmentF4$450 - $6508 hrs/day weekdays
StagingF16$1,800 - $2,50012 hrs/day weekdays
Production POCF64$9,500 - $12,50024/7 operation
Production PilotF64 Reserved$6,500 - $9,0001-year reserved

Cost Breakdown (Production POC)

ComponentMonthly Cost% of Total
Fabric Capacity (F64)~$8,50075-80%
ADLS Gen2 Storage~$5004-5%
Microsoft Purview~$8007-8%
Log Analytics~$3002-3%
Key Vault~$10<1%
Networking~$2001-2%

Cost Optimization Tips

  • Pause capacity during off-hours (saves up to 76%)
  • Use reserved capacity for production (saves 25-30%)
  • Implement storage lifecycle policies (move cold data to Cool tier)
  • Set up Azure Cost Management alerts

๐Ÿ’ก Pro Tip: Enable auto-pause on dev/staging environments to automatically suspend compute during idle periods. This can reduce costs by up to 76% for non-production workloads.

For detailed cost scenarios and optimization strategies, see docs/COST_ESTIMATION.md.


๐Ÿ“ Sample Data

Pre-generated sample datasets for quick exploration without running data generators.

Available Datasets

DatasetRecordsFormatSizeLocation
Slot Telemetry (7 days)10,000CSV/Parquet~10 MBsample-data/bronze/
Player Profiles500CSV/Parquet~1 MBsample-data/bronze/
Table Games2,000CSV/Parquet~2 MBsample-data/bronze/
Financial Transactions1,000CSV/Parquet~1 MBsample-data/bronze/

Quick Exploration

# View sample data structure
ls sample-data/bronze/

# Load into Pandas (Python)
import pandas as pd
df = pd.read_parquet('sample-data/bronze/slot_telemetry_sample.parquet')
df.head()

# View schemas
ls sample-data/schemas/

Schema Definitions

Sample data includes matching schema definitions in sample-data/schemas/ that document:

  • Column names and data types
  • Business descriptions
  • Valid value ranges
  • PII handling requirements

๐Ÿ’ก Pro Tip: Sample data is perfect for initial exploration and testing notebooks without waiting for data generation. Use it to validate your environment setup before generating full datasets.

For generating larger custom datasets, see data_generation/README.md.


๐ŸŽฐ Casino/Gaming Data Domains

<table> <tr> <th width="15%">Domain</th> <th width="5%">Icon</th> <th width="40%">Description</th> <th width="25%">Key Entities</th> <th width="15%">Compliance</th> </tr> <tr> <td><b>Slot Machines</b></td> <td align="center">๐ŸŽฐ</td> <td>Telemetry, meter readings, jackpot events, machine performance analytics</td> <td>Machines, Meters, Jackpots, Sessions</td> <td>NIGC MICS</td> </tr> <tr> <td><b>Table Games</b></td> <td align="center">๐ŸŽฒ</td> <td>Hand results, chip tracking, table performance, dealer analytics</td> <td>Tables, Games, Hands, Chips</td> <td>NIGC MICS</td> </tr> <tr> <td><b>Player/Loyalty</b></td> <td align="center">๐Ÿ‘ค</td> <td>Player profiles, rewards programs, activity tracking, Player 360</td> <td>Players, Tiers, Points, Offers</td> <td>PCI-DSS, PII</td> </tr> <tr> <td><b>Financial/Cage</b></td> <td align="center">๐Ÿ’ฐ</td> <td>Transactions, fills, credits, cash management, cage operations</td> <td>Transactions, Fills, Drops</td> <td>FinCEN BSA</td> </tr> <tr> <td><b>Security</b></td> <td align="center">๐Ÿ”’</td> <td>Surveillance integration, access control, incident tracking</td> <td>Events, Incidents, Access Logs</td> <td>State Regs</td> </tr> <tr> <td><b>Compliance</b></td> <td align="center">๐Ÿ“‹</td> <td>CTR/SAR reporting, W-2G tax forms, regulatory filings</td> <td>CTRs, SARs, W-2Gs, Audits</td> <td>Federal/State</td> </tr> </table>

๐Ÿ“‚ Repository Structure

Suppercharge_Microsoft_Fabric/
โ”‚
โ”œโ”€โ”€ ๐Ÿ“ .devcontainer/                  # ๐Ÿ’ป Dev Container configuration
โ”‚   โ”œโ”€โ”€ devcontainer.json              # VS Code/Codespaces config
โ”‚   โ””โ”€โ”€ Dockerfile                     # Container image definition
โ”‚
โ”œโ”€โ”€ ๐Ÿ“ .vscode/                        # โš™๏ธ VS Code settings
โ”‚   โ”œโ”€โ”€ settings.json                  # Workspace settings
โ”‚   โ”œโ”€โ”€ extensions.json                # Recommended extensions
โ”‚   โ””โ”€โ”€ launch.json                    # Debug configurations
โ”‚
โ”œโ”€โ”€ ๐Ÿ“ docker/                         # ๐Ÿณ Docker configurations
โ”‚   โ”œโ”€โ”€ entrypoint.sh                  # Container entrypoint
โ”‚   โ””โ”€โ”€ generate-all.sh                # Data generation script
โ”‚
โ”œโ”€โ”€ ๐Ÿ“ scripts/                        # ๐Ÿ“œ Automation scripts
โ”‚   โ”œโ”€โ”€ deploy.ps1                     # Deployment automation
โ”‚   โ”œโ”€โ”€ generate-data.ps1              # Data generation wrapper
โ”‚   โ””โ”€โ”€ validate.ps1                   # Validation runner
โ”‚
โ”œโ”€โ”€ ๐Ÿ“ infra/                          # ๐Ÿš€ Infrastructure as Code (Bicep)
โ”‚   โ”œโ”€โ”€ main.bicep                     # Root orchestration template
โ”‚   โ”œโ”€โ”€ ๐Ÿ“ modules/                    # Reusable Bicep modules
โ”‚   โ””โ”€โ”€ ๐Ÿ“ environments/               # Environment-specific parameters
โ”‚       โ”œโ”€โ”€ dev/                       # Development configuration
โ”‚       โ”œโ”€โ”€ staging/                   # Staging configuration
โ”‚       โ””โ”€โ”€ prod/                      # Production configuration
โ”‚
โ”œโ”€โ”€ ๐Ÿ“ docs/                           # ๐Ÿ“š Documentation
โ”‚   โ”œโ”€โ”€ ARCHITECTURE.md                # Detailed architecture guide
โ”‚   โ”œโ”€โ”€ DEPLOYMENT.md                  # Deployment procedures
โ”‚   โ”œโ”€โ”€ SECURITY.md                    # Security & compliance guide
โ”‚   โ”œโ”€โ”€ PREREQUISITES.md               # Setup requirements
โ”‚   โ””โ”€โ”€ COST_ESTIMATION.md             # Azure cost planning
โ”‚
โ”œโ”€โ”€ ๐Ÿ“ tutorials/                      # ๐Ÿ“– Step-by-step tutorials
โ”‚   โ”œโ”€โ”€ 00-environment-setup/          # Initial setup
โ”‚   โ”œโ”€โ”€ 01-bronze-layer/               # Bronze implementation
โ”‚   โ”œโ”€โ”€ 02-silver-layer/               # Silver transformations
โ”‚   โ”œโ”€โ”€ 03-gold-layer/                 # Gold aggregations
โ”‚   โ”œโ”€โ”€ 04-real-time-analytics/        # Streaming analytics
โ”‚   โ”œโ”€โ”€ 05-direct-lake-powerbi/        # Power BI integration
โ”‚   โ”œโ”€โ”€ 06-data-pipelines/             # Pipeline orchestration
โ”‚   โ”œโ”€โ”€ 07-governance-purview/         # Data governance
โ”‚   โ”œโ”€โ”€ 08-database-mirroring/         # SQL mirroring
โ”‚   โ”œโ”€โ”€ 09-advanced-ai-ml/             # Machine learning
โ”‚   โ”œโ”€โ”€ 10-teradata-migration/        # Teradata modernization
โ”‚   โ”œโ”€โ”€ 24-snowflake-to-fabric/       # Snowflake migration
โ”‚   โ”œโ”€โ”€ 25-ibm-db2-source/            # IBM DB2 connectivity
โ”‚   โ”œโ”€โ”€ 26-multi-source-streaming/    # CDC & IoT streaming
โ”‚   โ”œโ”€โ”€ 27-video-security-analytics/  # AI video pipeline
โ”‚   โ”œโ”€โ”€ 28-people-movement-analytics/ # Foot traffic analytics
โ”‚   โ”œโ”€โ”€ 29-geolocation-analytics/     # H3 & geofencing
โ”‚   โ”œโ”€โ”€ 30-tribal-healthcare/         # HIPAA-compliant IHS
โ”‚   โ””โ”€โ”€ 31-federal-dot-faa/           # FedRAMP aviation
โ”‚
โ”œโ”€โ”€ ๐Ÿ“ sample-data/                    # ๐Ÿ“ Pre-generated sample data
โ”‚   โ”œโ”€โ”€ bronze/                        # Bronze layer samples
โ”‚   โ””โ”€โ”€ schemas/                       # Schema definitions
โ”‚
โ”œโ”€โ”€ ๐Ÿ“ reports/                        # ๐Ÿ“Š Power BI templates
โ”‚   โ”œโ”€โ”€ report-definitions/            # Report .pbip files
โ”‚   โ””โ”€โ”€ semantic-model/                # Direct Lake model definitions
โ”‚       โ”œโ”€โ”€ tables/                    # Table definitions
โ”‚       โ””โ”€โ”€ measures/                  # DAX measures
โ”‚
โ”œโ”€โ”€ ๐Ÿ“ poc-agenda/                     # ๐Ÿ“… 3-Day workshop materials
โ”œโ”€โ”€ ๐Ÿ“ data_generation/                # ๐ŸŽฒ Synthetic data generators
โ”œโ”€โ”€ ๐Ÿ“ notebooks/                      # ๐Ÿ““ Fabric-importable notebooks
โ”œโ”€โ”€ ๐Ÿ“ validation/                     # โœ… Testing & data quality
โ”‚
โ”œโ”€โ”€ ๐Ÿณ Dockerfile                      # Data generator Docker image
โ”œโ”€โ”€ ๐Ÿณ docker-compose.yml              # Multi-service orchestration
โ””โ”€โ”€ ๐Ÿ“„ CHANGELOG.md                    # Version history

๐Ÿ“Š 3-Day POC Agenda

A structured workshop to experience the full Microsoft Fabric platform:

DayThemeFocus AreasKey Deliverables
Day 1๐Ÿ—๏ธ FoundationEnvironment setup, Bronze & Silver layersWorking Lakehouse, data ingestion pipeline
Day 2โš™๏ธ TransformationGold layer, Real-time analyticsBusiness-ready datasets, streaming dashboard
Day 3๐Ÿ“Š IntelligenceDirect Lake, Power BI, PurviewSemantic model, reports, governance catalog
<details> <summary><b>๐Ÿ“… View Detailed Agenda</b></summary>

Day 1: Medallion Foundation (8 hours)

  • Morning: Environment provisioning, workspace setup
  • Afternoon: Bronze layer implementation, batch ingestion
  • Wrap-up: Silver layer transformations, data quality

Day 2: Transformations & Real-Time (8 hours)

  • Morning: Gold layer aggregations, star schema
  • Afternoon: Eventstreams, Eventhouse, KQL queries
  • Wrap-up: Real-time dashboard prototyping

Day 3: BI & Governance (8 hours)

  • Morning: Direct Lake semantic model creation
  • Afternoon: Power BI reports, Purview integration
  • Wrap-up: Review, Q&A, next steps
</details>

๐Ÿ‘‰ See POC Agenda for complete schedules and materials.


๐Ÿ“– Tutorials

Learning Path

flowchart LR
    subgraph L1["๐ŸŸข Level 1: Foundation"]
        T00[00-Setup]
        T01[01-Bronze]
    end

    subgraph L2["๐ŸŸก Level 2: Core"]
        T02[02-Silver]
        T03[03-Gold]
    end

    subgraph L3["๐ŸŸ  Level 3: Advanced"]
        T04[04-Real-Time]
        T05[05-Direct Lake]
    end

    subgraph L4["๐Ÿ”ด Level 4: Enterprise"]
        T06[06-Pipelines]
        T07[07-Governance]
        T08[08-Mirroring]
        T09[09-AI/ML]
    end

    subgraph L5["๐ŸŸฃ Migration & Streaming"]
        T10[10-Teradata]
        T24[24-Snowflake]
        T25[25-DB2]
        T26[26-Streaming]
    end

    subgraph L6["๐Ÿ”ต Analytics & Expansions"]
        T27[27-Video]
        T28[28-Movement]
        T29[29-Geo]
        T30[30-Healthcare]
        T31[31-DOT/FAA]
    end

    T00 --> T01 --> T02 --> T03 --> T04 --> T05
    T05 --> T06 --> T07 --> T08 --> T09
    T09 --> T10 --> T24 --> T25 --> T26
    T26 --> T27 --> T28 --> T29 --> T30 --> T31
<table> <tr> <th>๐ŸŽฏ Level</th> <th>๐Ÿ“– Tutorial</th> <th>๐Ÿ“ Description</th> <th>โฑ๏ธ Duration</th> </tr> <tr> <td rowspan="2"><b>๐ŸŸข Foundation</b><br/><sub>Start here</sub></td> <td><a href="tutorials/00-environment-setup/README.md"><b>00 - Environment Setup</b></a></td> <td>Azure & Fabric workspace provisioning</td> <td><code>~1 hour</code></td> </tr> <tr> <td><a href="tutorials/01-bronze-layer/README.md"><b>01 - Bronze Layer</b></a></td> <td>Raw data ingestion patterns</td> <td><code>~2 hours</code></td> </tr> <tr> <td rowspan="2"><b>๐ŸŸก Core</b><br/><sub>Essential skills</sub></td> <td><a href="tutorials/02-silver-layer/README.md"><b>02 - Silver Layer</b></a></td> <td>Data cleansing & validation</td> <td><code>~2 hours</code></td> </tr> <tr> <td><a href="tutorials/03-gold-layer/README.md"><b>03 - Gold Layer</b></a></td> <td>Business aggregations & KPIs</td> <td><code>~2 hours</code></td> </tr> <tr> <td rowspan="2"><b>๐ŸŸ  Advanced</b><br/><sub>Real-time & BI</sub></td> <td><a href="tutorials/04-real-time-analytics/README.md"><b>04 - Real-Time Analytics</b></a></td> <td>Eventstreams & Eventhouse</td> <td><code>~3 hours</code></td> </tr> <tr> <td><a href="tutorials/05-direct-lake-powerbi/README.md"><b>05 - Direct Lake & Power BI</b></a></td> <td>Semantic models & reports</td> <td><code>~2 hours</code></td> </tr> <tr> <td rowspan="4"><b>๐Ÿ”ด Enterprise</b><br/><sub>Production-ready</sub></td> <td><a href="tutorials/06-data-pipelines/README.md"><b>06 - Data Pipelines</b></a></td> <td>Orchestration & scheduling</td> <td><code>~2 hours</code></td> </tr> <tr> <td><a href="tutorials/07-governance-purview/README.md"><b>07 - Governance & Purview</b></a></td> <td>Data catalog & lineage</td> <td><code>~2 hours</code></td> </tr> <tr> <td><a href="tutorials/08-database-mirroring/README.md"><b>08 - Database Mirroring</b></a></td> <td>SQL Server replication</td> <td><code>~1 hour</code></td> </tr> <tr> <td><a href="tutorials/09-advanced-ai-ml/README.md"><b>09 - Advanced AI/ML</b></a></td> <td>Machine learning integration</td> <td><code>~3 hours</code></td> </tr> <tr> <td rowspan="4"><b>๐ŸŸฃ Migration</b><br/><sub>Platform migration</sub></td> <td><a href="tutorials/10-teradata-migration/README.md"><b>10 - Teradata Migration</b></a></td> <td>Teradata to Fabric modernization</td> <td><code>~3 hours</code></td> </tr> <tr> <td><a href="tutorials/24-snowflake-to-fabric/README.md"><b>24 - Snowflake to Fabric</b></a></td> <td>Snowflake migration & cost comparison</td> <td><code>~3 hours</code></td> </tr> <tr> <td><a href="tutorials/25-ibm-db2-source/README.md"><b>25 - IBM DB2 Source</b></a></td> <td>DB2 connectivity & CDC patterns</td> <td><code>~3 hours</code></td> </tr> <tr> <td><a href="tutorials/26-multi-source-streaming/README.md"><b>26 - Multi-Source Streaming</b></a></td> <td>8 CDC & IoT streaming connectors</td> <td><code>~3 hours</code></td> </tr> <tr> <td rowspan="5"><b>๐Ÿ”ต Analytics & Expansions</b><br/><sub>Industry verticals</sub></td> <td><a href="tutorials/27-video-security-analytics/README.md"><b>27 - Video Security</b></a></td> <td>AI video pipeline & edge processing</td> <td><code>~2.5 hours</code></td> </tr> <tr> <td><a href="tutorials/28-people-movement-analytics/README.md"><b>28 - People Movement</b></a></td> <td>Foot traffic & queue detection</td> <td><code>~2 hours</code></td> </tr> <tr> <td><a href="tutorials/29-geolocation-analytics/README.md"><b>29 - Geolocation Analytics</b></a></td> <td>H3 indexing & geofencing</td> <td><code>~2.5 hours</code></td> </tr> <tr> <td><a href="tutorials/30-tribal-healthcare/README.md"><b>30 - Tribal Healthcare</b></a></td> <td>HIPAA-compliant IHS analytics</td> <td><code>~3 hours</code></td> </tr> <tr> <td><a href="tutorials/31-federal-dot-faa/README.md"><b>31 - Federal DOT/FAA</b></a></td> <td>FedRAMP aviation analytics</td> <td><code>~2.5 hours</code></td> </tr> </table>

๐Ÿ“š Documentation Site

This repository includes a full MkDocs Material documentation site with search, dark mode, and comprehensive navigation.

Local Preview

# Install documentation dependencies
pip install -r requirements-docs.txt

# Start local documentation server
mkdocs serve

Then open http://127.0.0.1:8000 in your browser.

Quick References

ResourceDescription
โšก 5-Minute Quick StartFastest path to generating data and exploring the POC
๐Ÿ“‹ Cheat SheetCommands, shortcuts, and quick reference for all components

Build Documentation

# Build static site
mkdocs build

# Deploy to GitHub Pages
mkdocs gh-deploy

Live Site: Coming soon via GitHub Pages


๐Ÿ“œ Compliance Frameworks

This POC addresses regulatory requirements across gaming jurisdictions:

<table> <tr> <td align="center" width="25%"> <h3>๐Ÿ›๏ธ NIGC MICS</h3> <sub>Minimum Internal Control Standards</sub><br/> <sub>Gaming machine & table game controls</sub> </td> <td align="center" width="25%"> <h3>๐Ÿฆ FinCEN BSA</h3> <sub>Bank Secrecy Act</sub><br/> <sub>CTR/SAR reporting thresholds</sub> </td> <td align="center" width="25%"> <h3>๐Ÿ’ณ PCI-DSS</h3> <sub>Payment Card Industry</sub><br/> <sub>Card data security standards</sub> </td> <td align="center" width="25%"> <h3>๐Ÿด State Gaming</h3> <sub>Jurisdiction Requirements</sub><br/> <sub>State-specific regulations</sub> </td> </tr> </table>

[!TIP] Phase 7 also addresses HIPAA (Tribal Healthcare), FedRAMP (DOT/FAA), 42 CFR Part 2 (Behavioral Health), and FISMA/NIST 800-53 compliance requirements.


๐Ÿ›๏ธ Completed Expansions

Phase 7 delivered industry expansions beyond the core Casino/Gaming POC:

ExpansionComplianceKey CapabilitiesTutorial
๐ŸŒพ USDANASS, FSISCrop production, food safety recallsTutorial 32
๐Ÿ’ผ SBAPPP, 7(a)Loan analytics, 20 NAICS codesTutorial 33
๐ŸŒŠ NOAACDO APIWeather observations, storm eventsTutorial 34
๐Ÿญ EPAAirNow, TRIAir quality (AQI), water quality (MCL)Tutorial 35
๐Ÿ”๏ธ DOIUSGS, BLMEarthquakes, land use managementTutorial 36
๐Ÿฅ Tribal HealthcareHIPAA, 42 CFRIHS encounters, PHI masking, FHIRTutorial 30
โœˆ๏ธ DOT/FAAFedRAMP, FISMAFlight ops, safety, carrier analyticsTutorial 31
โš–๏ธ DOJFBI NIBRS, USSCCrime stats, sentencing, antitrust, DEATutorial 38
๐Ÿ“น Video Analyticsโ€”YOLO/DeepSORT, 50 cameras, 8 event typesTutorial 27
๐Ÿšถ People Movementโ€”30 zones, queue detection, heat mapsTutorial 28
๐Ÿ“ Geolocationโ€”H3 indexing, geofencing, proximity triggersTutorial 29

๐Ÿค Contributing

We welcome contributions! Please read our Contributing Guide before submitting pull requests.

<table> <tr> <td>

Ways to Contribute:

  • ๐Ÿ› Report bugs and issues
  • ๐Ÿ’ก Suggest new features
  • ๐Ÿ“ Improve documentation
  • ๐Ÿ”ง Submit pull requests
</td> <td>

Get Started:

  1. Fork the repository
  2. Create a feature branch
  3. Make your changes
  4. Submit a pull request
</td> </tr> </table>

๐Ÿ“„ License

This project is licensed under the MIT License - see the LICENSE file for details.


<div align="center" markdown>

โฌ† Back to Top

GitHub stars GitHub forks

</div>
Skills Info
Original Name:testingAuthor:fgarofalo56