Microsoft Fabric’s Data Factory is a robust cloud-based data integration service that enables you to create, schedule, and manage workflows across various data sources. When dealing with data sources that reside on-premises, Microsoft offers the On-Premises Data Gateway, which provides a secure connection between your on-premises environment and the cloud.
Continue reading
In this post, I’ll explain how to add the current date and time to an existing PySpark DataFrame in a Fabric Notebook. This is particularly helpful when inserting data into a Fabric Lakehouse table, as it allows you to track when each record was added. I’ll walk through an example using a DataFrame to first load some sample data and show how to append a new column with the current timestamp to capture the insertion time.
Continue reading
In today’s fast-paced business environment, efficiency and productivity are paramount. Microsoft Fabric, a robust and versatile platform, has introduced a new feature aimed at enhancing workflow management: Task Flow. This feature promises to streamline processes, reduce manual intervention, and ultimately, boost productivity. In this comprehensive guide, we will explore the ins and outs of Task Flow, its benefits, and how you can leverage it to optimize your operations.
Continue reading
Preparing for the DP-600 Fabric Engineer Associate Exam can be a challenging yet rewarding journey. As you aim to become proficient in designing and implementing data solutions on Microsoft Azure, it’s essential to have a comprehensive preparation strategy. This in-depth guide will provide you with the necessary steps and resources to ensure you’re ready to ace the exam.
Continue reading
I recently took Microsoft’s DP-600 exam/Fabric Analytics Engineer Associate(Twice 1 fail and 1 pass), and I noticed that several questions covered Power BI External tools, such as DAX Studio, and the correct use of DAX statements. Therefore, I think I ought to write a post on DAX studio for those of you who are also interested in taking this test.
In today’s data-driven world, organizations are increasingly relying on robust data infrastructure to manage and analyze vast amounts of information. Microsoft Fabric provides comprehensive solutions to address these needs, including data warehouses and data lakehouses. Understanding the differences between these two approaches is crucial for leveraging their capabilities effectively. In this blog, we’ll dive into the distinctions between data warehouses and data lakehouses within the Microsoft Fabric ecosystem.
Continue reading
With Fabric, as a data provider, you can centralize all your data and grant users access only to the information they need, instead of providing open access to each department. In the traditional data warehouse model, you might create a single dataset for the entire company. When the sales team needs something different, you make adjustments and generate a new dataset. Marketing may require additional modifications, leading to yet another dataset. Over time, the sole source of truth becomes a matter of conflicting interpretations.
Continue reading
Before diving into the process, it’s important to understand what a shortcut in OneLake entails. Essentially, a shortcut in this context is a reference or link to a dataset or specific data object within OneLake. This allows users to access data quickly without navigating through multiple layers of the data lake’s structure, facilitating faster decision-making and smoother workflows.
Continue readingA lot new terms come out Microsoft Fabric went G, one of them is direct lake. When you hear that for the first time, you may have the same response as me :”ain’t that the same thing as direct query” well, no, not really.
Continue reading
Many organizations have long depended on on-premise databases built on relational systems to manage their data. These setups have been crucial for structured data handling and analysis, offering stability and reliability. However, as data demands increase both in volume and complexity, more scalable, efficient, and cost-effective solutions are needed.
Continue reading