Nagaraj Venkatesan – författare

Over 90 recipes to help you orchestrate modern ETL/ELT workflows and perform analytics using Azure services more easilyKey FeaturesBuild highly efficient ETL pipelines using the Microsoft Azure Data servicesCreate and execute real-time processing solutions using Azure Databricks, Azure Stream Analytics, and Azure Data ExplorerDesign and execute batch processing solutions using Azure Data FactoryBook DescriptionData engineering is one of the faster growing job areas as Data Engineers are the ones who ensure that the data is extracted, provisioned and the data is of the highest quality for data analysis. This book uses various Azure services to implement and maintain infrastructure to extract data from multiple sources, and then transform and load it for data analysis.It takes you through different techniques for performing big data engineering using Microsoft Azure Data services. It begins by showing you how Azure Blob storage can be used for storing large amounts of unstructured data and how to use it for orchestrating a data workflow. You'll then work with different Cosmos DB APIs and Azure SQL Database. Moving on, you'll discover how to provision an Azure Synapse database and find out how to ingest and analyze data in Azure Synapse. As you advance, you'll cover the design and implementation of batch processing solutions using Azure Data Factory, and understand how to manage, maintain, and secure Azure Data Factory pipelines. You’ll also design and implement batch processing solutions using Azure Databricks and then manage and secure Azure Databricks clusters and jobs. In the concluding chapters, you'll learn how to process streaming data using Azure Stream Analytics and Data Explorer.By the end of this Azure book, you'll have gained the knowledge you need to be able to orchestrate batch and real-time ETL workflows in Microsoft Azure.What you will learnUse Azure Blob storage for storing large amounts of unstructured dataPerform CRUD operations on the Cosmos Table APIImplement elastic pools and business continuity with Azure SQL DatabaseIngest and analyze data using Azure Synapse AnalyticsDevelop Data Factory data flows to extract data from multiple sourcesManage, maintain, and secure Azure Data Factory pipelinesProcess streaming data using Azure Stream Analytics and Data ExplorerWho this book is forThis book is for Data Engineers, Database administrators, Database developers, and extract, load, transform (ETL) developers looking to build expertise in Azure Data engineering using a recipe-based approach. Technical architects and database architects with experience in designing data or ETL applications either on-premise or on any other cloud vendor who wants to learn Azure Data engineering concepts will also find this book useful. Prior knowledge of Azure fundamentals and data engineering concepts is needed.

Nearly 80 recipes to help you collect and transform data from multiple sources into a single data source, making it way easier to perform analytics on the dataKey FeaturesBuild data pipelines from scratch and find solutions to common data engineering problemsLearn how to work with Azure Data Factory, Data Lake, Databricks, and Synapse AnalyticsMonitor and maintain your data engineering pipelines using Log Analytics, Azure Monitor, and Azure PurviewBook DescriptionThe famous quote 'Data is the new oil' seems more true every day as the key to most organizations' long-term success lies in extracting insights from raw data. One of the major challenges organizations face in leveraging value out of data is building performant data engineering pipelines for data visualization, ingestion, storage, and processing. This second edition of the immensely successful book by Ahmad Osama brings to you several recent enhancements in Azure data engineering and shares approximately 80 useful recipes covering common scenarios in building data engineering pipelines in Microsoft Azure.You’ll explore recipes from Azure Synapse Analytics workspaces Gen 2 and get to grips with Synapse Spark pools, SQL Serverless pools, Synapse integration pipelines, and Synapse data flows. You’ll also understand Synapse SQL Pool optimization techniques in this second edition. Besides Synapse enhancements, you’ll discover helpful tips on managing Azure SQL Database and learn about security, high availability, and performance monitoring. Finally, the book takes you through overall data engineering pipeline management, focusing on monitoring using Log Analytics and tracking data lineage using Azure Purview.By the end of this book, you’ll be able to build superior data engineering pipelines along with having an invaluable go-to guide.What you will learnProcess data using Azure Databricks and Azure Synapse AnalyticsPerform data transformation using Azure Synapse data flowsPerform common administrative tasks in Azure SQL DatabaseBuild effective Synapse SQL pools which can be consumed by Power BIMonitor Synapse SQL and Spark pools using Log AnalyticsTrack data lineage using Microsoft Purview integration with pipelinesWho this book is forThis book is for data engineers, data architects, database administrators, and data professionals who want to get well versed with the Azure data services for building data pipelines. Basic understanding of cloud and data engineering concepts will help in getting the most out of this book.

Master Power BI and Microsoft Fabric to design scalable, secure, and efficient business intelligence solutionsFree with your book: DRM-free PDF version + access to Packt''s next-gen Reader*

Key Features

Make well-informed decisions while selecting the right Power BI component for a scenarioLearn how to design secure and performant solutions using Power BIFamiliarize yourself with the latest Power BI capabilities like AI features, Microsoft Fabric enhancements, and Git integrationPurchase of the print or Kindle book includes a free PDF eBook

Book Description

Business Intelligence (BI) tools like Power BI are used by a wide range of professionals, creating diverse and complex scenarios, and finding the right solution can be daunting, especially when multiple approaches exist for a single use case. The author distills his 17 years of experience on various data platform technologies in this book to walk you through various Power BI usage scenarios.The book is structured around Power BI usage scenarios, such as developing solutions for corporate BI reporting, self-service BI reporting, and Power BI for data scientists and independent software vendors (ISVs). Each part highlights common data issues encountered in the usage scenario, the correct approach to solve the problems, and supporting technical guidance. The chapters also introduce you to some of the latest enhancements in Power BI, such as Microsoft Fabric integration with Power BI, AI features like Copilot, Power BI Git integration, and Power BI Governance features.By the end of this book, you’ll have learned how to design optimal solutions using Power BI components and pick the right tool for the job, while adhering to security and performance best practices.*Email sign-up and proof of purchase required

What you will learn

Explore Power BI fundamentals and usage scenariosGet to grips with optimal data models and reports for corporate reportingLeverage AI while building self-service reporting solutionsDiscover AutoML, as well as Python and R integration featuresDevelop expert solutions for ISVs using Power BI EmbeddedUnderstand Microsoft Fabric integration features for Power BI

Who this book is for

This book is for anyone who uses Power BI at work. Solution architects, data engineers, Power BI administrators, and Power BI report developers will benefit from every section of the book. Business analysts and data scientists can use this book to learn about self-service BI features and data science capabilities, respectively. Although not mandatory, prior exposure to Power BI will help you get the most out of this book.