ARTICLES
Event Streaming is Topping Out | Big Data Stream | Stanislav Kozlovski | Market analysis
Kozlovski warns that the event-streaming industry has become oversubscribed. Too many companies chase a relatively small total addressable market, and even leader Confluent’s stock price has languished between roughly $20–30 for years. As cloud revenue growth decelerates, he predicts a wave of consolidation and questions whether real-time event streaming will ever match the scale of data warehousing
Fabric Workspace Structure That Scales | Xebia | Rik Adegeest | 5 min | Cloud & Data Engineering
To combat chaotic Microsoft Fabric workspaces filled with notebooks and pipelines, to simple, opinionated structure. Numbered stage folders (e.g., 1_ingest/, 2_validate/, 3_transform/) keep ingestion, validation and transformation artefacts organised. Descriptive names and a clear distinction between stage-specific items and shared assets remove the need for pl_/nb_ prefixes and speed up onboarding
Onehouse Quanton vs the Latest AWS EMR for Apache Spark™ Workloads | Onehouse | Kyle Weller | Lakehouse benchmarks
Benchmarks comparing Onehouse’s Quanton runtime with Amazon EMR reveal that EMR 7.12 delivers a 32 % performance bump but still trails in price/performance. Quanton’s lakehouse-optimised Spark shows roughly 2.5× better price/performance across 10 TB TPC‑DS workloads. While AWS narrows the gap with its Photon rival, the post notes that EMR still imposes significant operational overhead and treats lakehouse table formats as external plug-ins.
Analytics Translation is still around! Part 1: Ideation techniques | Xebia | Juan Venegas | 9 min | AI Product & Ideation
This opening instalment argues that analytics translators remain vital even in the GenAI era. Venegas introduces the AI Solution framework (ideate–experiment–industrialize) and explains why analytics translators are more than just project managers. They bridge business and data teams, organise ideation and prioritisation exercises, and bring human creativity that large language models can’t match
Use Your Favourite AI Tool to Read the Latest AWS News | Tobias Müller | 4 min | AI Tools & News Aggregation
Müller explains how to combine more than 40 AWS news feeds via an unofficial AWS News MCP server to give AI tools a single endpoint. The unauthenticated server exposes functions such as getLatestNews, searchNews and getNewsStats, and can be plugged into Claude, Cursor, VS Code, Amazon Q and other AI assistants for real-time, structured access to AWS updates.
Talk to Your Data Model: Introducing the Power BI Modeling MCP | pbidax | Jeffrey Wang | 7 min | BI Tools
On day one of Microsoft Ignite 2025, the Power BI team introduced powerbi‑modeling‑mcp, their first public Model Context Protocol (MCP) server. Built on the same APIs (TOM for metadata and ADOMD.NET for querying) that underpin Analysis Services and Power BI, it allows users to create and maintain models using natural language. The semantic interface supports synonyms, batch updates and transaction control. New capabilities include multi‑model orchestration, headless TMDL editing and cross‑platform independence
PODCASTS
Technology, Career and Finding a Purpose with Deana Solis | Packet Pushers Day Two DevOps #288 | 47 min
FinOps engineer Deana Solis joins the show to discuss communication, avoiding bias in AI models, and building a career with purpose. The conversation emphasises empathy, continuous learning and cost-awareness as core skills for modern DevOps roles.
DATA TUBE
Building Agentic Self‑Healing Data Pipeline – End to End Data Engineering Project | YouTube | CodeWithYu | ~1.5 h
A comprehensive tutorial on constructing a self-healing, agentic data pipeline. CodeWithYu demonstrates multi-agent orchestration for extraction, transformation and monitoring, highlighting automated error handling and continuous optimisation.
TOOL
TRAE positions itself as a “real AI engineer” that can understand requirements, execute tasks and deliver software solutions, effectively augmenting development teams and shortening delivery times
Pylar offers governed data access for AI agents by converting SQL views into Model Context Protocol (MCP) tools, giving agents safe, controlled access to structured data stacks
Warp’s terminal AI adds major upgrades, including full-terminal use for running interactive CLI programs, REPLs, debuggers, and database queries with transparent step-by-step execution; a /plan command for collaborative execution-plan review; interactive code review with diffs, inline comments, and agent-applied changes under human oversight; and first-party integrations with Slack, Linear, and GitHub Actions that bring agents into team workflows with real-time visibility and persisted records.
CONFS, EVENTS, WEBINARS AND MEETUPS
What’s New in Materialize: December 2025 – Webinar | Materialize | Dec 11 2025
Materialize experts Pranshu Maheshwari and Sid Sawhney unpack v26 enhancements, showing how to handle upstream schema changes without downtime and highlighting updates that boost security, efficiency and production readiness. Includes live demo and Q&A.
From Chaos to Control: MLOps in 2025 | JFrog Webinar | Dec 12, 2025
A practical workshop on stabilizing ML pipelines, packaging models, managing dependencies and reducing drift. Includes demos on automating model lifecycle workflows with artifact repositories.
PINNACLE PICKS
Your last week top picks:
Expanding Support for OneLake in Unity Catalog | Databricks | Michelle León, Ji-Shan Pappa & Jonathan Keller | 5 min | Interop & Governance
Databricks deepens interoperability with Microsoft OneLake: UC now supports directgovernance of OneLake files, automatic lineage capture, simplified credential passthrough and cross-cloud table management. A big step toward multi-engine, multi-cloud lake governance.
Track, compare, and optimize your LLM prompts with Datadog LLM Observability | Datadog | Jacob Simpher, Barry Eom, Yahoo Mouman, Will Potts | 6 min | LLM Ops
Databricks deepens interoperability with Microsoft OneLake: UC now supports directgovernance of OneLake files, automatic lineage capture, simplified credential passthrough and cross-cloud table management. A big step toward multi-engine, multi-cloud lake governance.
Track, compare, and optimize your LLM prompts with Datadog LLM Observability | Datadog | Jacob Simpher, Barry Eom, Yahoo Mouman, Will Potts | 6 min | LLM Ops
Datadog explains why prompt tracking is essential for debugging, evaluating and securing LLM apps. Key topics: multi-step prompt chains, attribution for cost & latency, structured logging, hallucination detection hints, plus examples of production logging patterns.
_____________________
Have any interesting content to share in the DATA Pill newsletter?
