SQL & Pipelines

Write and run KQL queries on Azure Data Explorer for logs and telemetry

Build Kusto graphs and run shortest-path and pattern queries from plain language

Plan data validation tiers and pipeline tests for DataOps and ML work

Set up end-to-end data sync pipelines on the TIS data integration platform

Port Databricks notebooks, jobs and Unity Catalog setups to Microsoft Fabric

Manage Fabric Dataflow Gen2 items, Power Query M edits and refreshes

Plan and build Bronze, Silver and Gold medallion data platforms on Fabric

Create and query Fabric Eventhouse and KQL databases for real-time analytics

Create and manage Fabric Event Schema Sets with event types and payload schemas

Build Fabric Eventstreams with sources, routing, operators and destinations

Port HDInsight Spark and Hive workloads to Fabric lakehouses and pipelines

Migrate Synapse Data Factory pipelines to Fabric Data Factory pipelines

Track, message and cancel long-running Project Osmos data engineering tasks in Fabric

Run and triage Fabric Spark notebooks, sessions and Materialized Lake Views

Manage Fabric Warehouses and Lakehouse SQL endpoints with T-SQL and diagnostics

Convert Synapse workspaces and dedicated SQL pools to Fabric items

Author portable bioinformatics pipelines in CWL with cwltool

Write reproducible Nextflow DSL2 pipelines with channels and processes

Run and configure nf-core Nextflow pipelines with pinned revisions and profiles

Author rule-based Snakemake pipelines with wildcards, checkpoints and conda envs

Write WDL pipelines for Cromwell and Terra cloud workflows

Query CSV, Parquet and JSON files with DuckDB SQL from MATLAB

Manage MongoDB Atlas Stream Processing workspaces, connections and processors

Discover table structure and run read-only SQL queries from plain-language questions

Run read-only SQL on BigQuery public datasets with cost limits and saved results

Write and deploy Python data transformations as Data Cloud code extensions

Inspect Data Cloud data lake and data model object fields over REST

Write and optimize SOQL and SOSL queries with query plan checks

Run ad hoc Python and PySpark on Fabric Spark compute without notebooks

Write, validate and test Power Query M partition expressions and query folding

Query Microsoft Fabric and Power BI semantic models with DAX and T-SQL

Query Wikidata with SPARQL for structured facts and cross-referenced identifiers