Browse Machine Learning News (149)

Samantha Kubota introduces Echoverse, a set of high-fidelity synthetic “worlds” for training computer-use agents, and explains why depth (stateful workflows and database-grounded grading) matters more than sheer environment count. The post shares results from supervised fine-tuning and reinforcement learning, plus links to released code and datasets.

diptiborkar summarizes why Microsoft Fabric and OneLake were recognized as a Leader in Forrester’s 2026 Data Lakehouses report, focusing on a unified lakehouse foundation for analytics and AI, open table formats, cross-cloud interoperability, and built-in governance and security across engines like Spark, SQL, KQL, and Power BI.

arindamc explains how Workspace Outbound Access Protection (OAP) in Microsoft Fabric controls outbound connectivity for Eventstream, so streaming pipelines can only read from approved sources and write to approved destinations (including cross-workspace routes) using data connection rules.

MattH_OneLake announces two Microsoft Fabric preview features that mirror Azure Monitor (Log Analytics) tables and AWS Glue Data Catalog-managed Apache Iceberg tables into OneLake. The post explains the zero-copy, metadata-based approach and outlines how to set up each mirroring source for analysis across Fabric workloads.

robece-msft outlines how to build event-driven applications in Microsoft Fabric using Business Events and User Data Functions, with code samples, architecture patterns, and practical scenarios aimed at teams building real-time, data-centric solutions.

Tzvia introduces Real-Time Dashboard in Microsoft Fabric, focusing on using streaming data to build live operational views that update in seconds so teams can spot spikes, slowdowns, and stalled processes quickly and respond while events are still unfolding.

ealroybrin introduces Microsoft Fabric Embed (Preview), which lets developers embed Fabric Real-Time Dashboards into JavaScript/TypeScript web apps using delegated Microsoft Entra ID authentication. The post outlines what the preview supports, key limitations (like no service principal auth), and how Fabric governance and permissions carry over to embedded experiences.

Santhosh_Ravin1 announces general availability of job concurrency and queue monitoring for Apache Spark in Microsoft Fabric, adding a capacity-level view to help diagnose why Spark jobs are queued or throttled and to understand how individual workspaces consume shared capacity over time.

Ilana Waitser introduces a preview capability that brings Azure Monitor telemetry into Microsoft Fabric so teams can connect operational signals (logs and metrics) with analytics workflows and understand business impact faster.

Santhosh_Ravin1 announces that Microsoft Fabric now extends customer-managed key (CMK) encryption to the Spark processing layer, covering data that Spark jobs read, write, and temporarily stage on compute clusters—aimed at meeting stricter security and compliance expectations for key control during active processing.

murray-kp rounds up the July 2026 Microsoft Fabric updates across CI/CD and Git integration, OneLake governance, Spark runtime and diagnostics, lakehouse and warehouse features, and Real-Time Intelligence improvements including Eventstream security and new connectors.

fredguis outlines upcoming OneLake Security changes for Microsoft Fabric SQL analytics endpoints, focusing on enterprise-friendly access control. The update improves nested group resolution, shortcut-backed table behavior in hub-and-spoke lakehouse setups, more consistent column-level security with group-based access, and broader service principal support for automated and app-owned data products.

aonelakeuser outlines summer updates to OneLake security in Microsoft Fabric, including broader engine coverage (Eventhouse and Fabric Graph), a simplified column-level security UI, faster Secure tab performance, a redesigned SQL Analytics Endpoint sync model, and generally available OneLake security APIs.

Santhosh_Ravin1 explains how Microsoft Fabric Spark’s Native Execution Engine now accelerates CSV reads with a native, SIMD-optimized reader, improving common data engineering workloads without requiring code changes.

AmirJafari announces updates to Fabric data agents in Microsoft Foundry, focusing on simpler MCP-based connectivity, OneLake Catalog discovery, support for attaching multiple data agents to a single Foundry agent, and improved production troubleshooting via Foundry Observability traces and logs.

mayurjain explains how the OpenAI Assistants API retirement on August 26, 2026 affects programmatic integrations with Microsoft Fabric Data Agents, and why Microsoft recommends moving to the Data Agent Model Context Protocol (MCP) endpoint instead of rebuilding directly on OpenAI’s Responses API.

robece-msft introduces the fundamentals of event-driven architecture in Microsoft Fabric, focusing on Real-Time Hub and how Fabric’s event capabilities help workloads react to meaningful business signals in real time.

arindamc explains how to build a real-time “row-to-intelligent-action” pipeline in Microsoft Fabric that captures shopping-cart signals via CDC, reshapes them into analytics-ready rows, and enriches each micro-batch with AI in a Spark Structured Streaming notebook to drive timely actions.

Steve Sweetman explains how AT&T built and scaled its telecom-focused OTel 2.0 models using Microsoft Foundry Managed Compute, combining open models from Hugging Face with AMD and NVIDIA GPU capacity to process around one trillion tokens while optimizing for cost, performance, and deployment speed.

HARMEETGILL announces the general availability of OneLake resource instance rules in Microsoft Fabric, explaining how workspace admins can allow secure service-to-service access from specific Azure resource instances (like Databricks or Azure SQL) without relying on broad IP allowlists or private networking everywhere.

avinandac introduces the generally available Lakehouse Query Explorer in Microsoft Fabric, an in-context Spark SQL editor inside the Lakehouse explorer for quick data exploration, validation, and iteration, with guidance on when to switch to notebooks or the SQL analytics endpoint for more advanced workflows.

MattH_OneLake explains how Microsoft Fabric mirroring can surface Snowflake-managed Apache Iceberg tables in OneLake without copying data, by replicating Iceberg metadata via shortcuts and virtualizing the tables as Delta Lake so they can be queried across Fabric engines.

olivialiu-micro explains how SQL Server 2025 enables governed outbound calls to external AI services while keeping control inside the database security model, including permissions, enablement switches, authentication options, and built-in auditing for REST invocation and external model objects.

Mabasile_MSFT announces general availability of OneLake Storage Tiers and Lifecycle Management in Microsoft Fabric, explaining how to keep frequently used data in the hot tier while automatically moving less-accessed data to cool or cold tiers to reduce long-term storage costs.

Mabasile_MSFT announces general availability of the OneLake storage report in Microsoft Fabric, which lets workspace admins generate an item-size breakdown of storage usage in a workspace, including visible, system, and soft-deleted data, plus billing status per item.

mk_sunitha explains a secure pattern for calling Microsoft Fabric REST APIs from User Data Functions (UDFs), using a service principal plus Azure Key Vault to keep secrets out of application code while still enabling governed automation like triggering Fabric pipelines and managing workspaces.

conxu-ms summarizes new Microsoft Fabric Data Factory updates focused on making pipeline orchestration easier, improving monitoring and troubleshooting, and adding AI-assisted operational capabilities for managing data workflows at scale.

goupadhy announces a preview of autoscaling for Microsoft Fabric Virtual Network (VNet) Data Gateway, explaining how gateway node counts scale in and out based on workload signals to balance performance, reliability, and cost, plus where admins configure limits and review diagnostics logs.

arindamc shows how to build a “row-to-intelligent-action” pipeline in Microsoft Fabric: capture Azure SQL changes via CDC into Fabric Eventstreams, reshape them with DeltaFlow, enrich each micro-batch in Spark Structured Streaming using AI Functions for PySpark, and publish Business Events for real-time routing and dashboards.

shiv_narayanan summarizes recent Dataverse Fabric Link updates that make it easier to control which Dataverse tables are synced into Microsoft Fabric, improve production-ready authentication options, and reduce sync latency so operational data shows up faster in OneLake-backed analytics workloads.

ofer announces a new OneLake Architectural Guidance whitepaper and summarizes five repeatable enterprise patterns for building a unified, governed data foundation in Microsoft Fabric, aimed at analytics modernization and AI readiness, including data access unification, medallion architecture, governed data mesh, platform simplification, and external data sharing.

Sridhar Baynes announces Aurora 1.5, an open-source update to Microsoft’s Earth-system foundation model that adds more weather variables, hourly resolution, and probabilistic ensemble forecasts, with results compared against ECMWF ensembles and examples including tropical cyclone track improvements.

spurthikommajos introduces the Oracle Database CDC source connector for Microsoft Fabric Eventstream (Preview), explaining how row-level inserts, updates, and deletes can be captured as structured change events and routed to Fabric destinations for real-time analytics, alerts, and downstream workflows.

Alicia Li summarizes the 2026 Q2 updates for Microsoft Fabric Eventstreams, covering new and updated connectors, the now-GA SQL operator, preview features like mirrored database change feed ingestion and business events publishing, plus AI Skills that generate and deploy eventstream topologies via Fabric REST APIs.

arindamc walks through a Microsoft Fabric “row-to-action” pattern where database row changes are mirrored into OneLake, streamed through Fabric Eventstreams, aggregated with windowing, and routed to Activator and Eventhouse for real-time triggers and live KQL dashboards.

bogdanc shares hands-on benchmark results for GPU-accelerated query execution in Microsoft Fabric Data Warehouse, including a transparent TPC-H methodology, single-user latency numbers, and high-concurrency throughput/latency comparisons against CPU execution on an F64 capacity.

JowoMSFT recaps the top community questions from a Rayfin AMA, covering how Fabric Apps can combine analytics with operational workflows, connect to Fabric data sources and external systems, and support AI-driven experiences while keeping governance, authentication, and row-level security in place.

ArshadAliTMMBA introduces Fabric Runtime Release Channels in Microsoft Fabric, explaining how the new default and early access channels let teams validate Spark runtime changes ahead of time, reduce surprise production breakages, and track exactly what runtime and VHD version their workloads are running.

rusteinberg explains how Microsoft Fabric sensitivity labels (defined in Microsoft Purview) can do more than enforce access control: they can also act as guidance signals for AI skills and agents, helping them choose the right data sources and avoid mixing sensitive and non-sensitive contexts in answers.

Aaron Merrill explains how OneLake security works with Microsoft Fabric shortcuts to enable zero-copy data distribution. He breaks down passthrough vs delegated shortcuts, how permissions are evaluated (including intersection behavior), and when each model fits—especially for large-scale sharing, cross-tenant scenarios, and external storage sources.