Listen Now

Azure's best-kept secret is now a part of Synapse! Watch this episode of Data Exposed with Henning Rauch to learn how telemetry data can be analyzed using Azure Synapse Data Explorer. It comes with an amazing real-world IoT scenario.[01:04] Azure Synapse Data Explorer[01:26] Key pillars of Azure Synapse Data Explorer[02:02] Scenarios[03:12] The solution[04:31] Demo[08:23] HighlightsResources:IoT analytics with Azure Data ExplorerAzure Synapse Data Explorer documentationAzure Synapse Data Explorer preview announcement blog

Learn about best practices of loading data to Azure SQL Database, how to efficiently utilize log generation rate and various techniques to efficiently load data into Azure SQL Database in this episode of Data Exposed with Denzil Ribeiro.[00:43] Data loading overview[03:05] Demo[16:32] Mistakes to be aware of

Join us for an introduction to the latest release of SQL Server and learn about all its new capabilities from cloud-connected to built-in query intelligence.[00:50] What's new[01:42] The next step for SQL Server[02:13] SQL Server 2022[05:09] Query Store and Intelligent Query Processing[07:09] Industry-leading database engine[08:37] Data lake virtualization and object storage[10:13] Extending T-SQL[11:47] Getting startedResources:Learn more about SQL Server 2022​Register to apply for the SQL Server 2022 Early Adoption Program and stay informed Watch technical deep-dives on SQL Server 2022SQL Server 2022 YouTube Playlist

Data engineering is one of the most involved, dull, and repetitive tasks in the data industry today. Bringing up the subject is a sure way to instantly clear the room at a party or make your friends groan in despair. The work includes a lot of complicated tools, many, many lines of code, and a not-insignificant amount of gnashing of teeth. But what if I told you there is a way to quickly, easily, and cheaply do both data engineering and data exploration on most data without even having to import it into a database? What if I told you that Azure Synapse has a just about magical tool that can instantly connect to flat files and make them available as nice, well-behaved tables? I'm talking about Azure Synapse serverless pools, a great tool for both initial exploration and surprisingly complex data engineering. I'll walk you through what it is, how to set it up, and give you a few examples of basic data exploration, as well as a tad more complex data engineering. Oh, and did I mention you can actually store the end result in several different formats as well...?[00:56] Azure Synapse Serverless Pools Overview[01:54] Demo[11:05] Getting startedResources:Andy Cutler's blog on serverless poolsAndy Mallon's blog on bucketing with T-SQLAbout Alexander Arvidsson:Alexander is a principal solutions architect at Attollo in Sweden. Nobody really knows what it means to be a principal solutions architect, but he spends his days speaking, teaching courses or helping clients of all shapes and sizes to take better care of their data.He has spent the last 25 years toying with data, databases and related infrastructure services such as storage, networking and virtualization, occasionally emerging from the technical darkness to attend a Star Wars convention somewhere in the world.He is a frequent international speaker, Data Platform MVP, podcaster, Pluralsight author, blogger and a Microsoft Certified Trainer, focusing on the Microsoft data platform stack.About MVPs:Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the "bleeding edge" and have an unstoppable urge to get their hands on new, exciting technologies. They have a very deep knowledge of Microsoft products and services, while also being able to bring together diverse platforms, products, and solutions, to solve real-world problems. MVPs make up a global community of over 4,000 technical experts and community leaders across 90 countries/regions and are driven by their passion, community spirit, and the quest for knowledge. Above all and in addition to their amazing technical abilities, MVPs are always willing to help others - that's what sets them apart. Learn more: https://aka.ms/mvpprogram

Did you know that Jupyter Notebooks can be automated? Join this episode with Julie Koesmarno to see an example of how you can use automate diagnostic notebooks automatically executed as an issue is assigned to you. We will be using Azure serverless architecture to illustrate this example. You will learn how you can leverage Azure Logic Apps and API that is available for executing Jupiter Notebook from command lines. [01:30] Automating Diagnostic Notebooks Overview[03:10] Demo[08:02] ArchitectureResources:Troubleshooting SQL Server made easy via Notebook

In this episode of Data Exposed with Julie Koesmarno, we will give you a sneak peek of what's new in Azure Data Studio. In this demo, Notebook view simplifies the workflow for your notebook consumers. At Microsoft, we continuously strive to come up with practical ideas that help our customers. With that, we have also been experimenting with converting a couple of highly used SQL Server docs to Notebooks.[00:58] Notebook Views overview[03:05] Demo[05:27] SQL Docs to Notebooks[07:33] Getting startedResources: Troubleshooting SQL Server made easy via Notebooks – seeking your feedback

Looking for a cross-platform Oracle schema conversion solution? Join Alexandra Ciortea, Alexander Ivanov, and Anna Hoffman to learn about the new experience we are building in Azure Data Studio. This feature is currently available in Insiders build of Azure Data Studio and will soon be available in the mainstream as well.[00:25] Introduction[01:15] What is DSCT[02:41] Demo[10:09] What to know when getting started[11:39] Scenarios[12:38] Roadmap Resources:Azure Data Studio – InsidersMigrating to SQL series playlist

Are you looking to modernize your on-premises databases to Azure SQL? Join Alexandra Ciortea, Raymond Truong, Wenjing Wang, and Anna Hoffman to understand how you can size your Azure SQL target accordingly, based on the current performance and business requirements. We will walk you through several approaches and models that can suit your needs.[00:40] Introductions[00:58] What is DMA[01:38] What is an SKU[02:23] SKU recommendation console application[03:43] Demo[12:34] How data is collected[14:10] Demo[20:11] How to migrateResources:Download Microsoft Data Migration Assistant v5.5Identify the right Azure SQL Database, Azure SQL Managed Instance or SQL Server on Azure VM SKU for your on-premises databaseRun Data Migration Assistant from the command line

In this episode of Data Exposed: MVP Edition, Javier Villegas will describe the concept of SQL Server Failover Cluster Instances (FCI) covering how we can use them for High Availability purposes using Azure Virtual Machines and the different Azure Storage options. Recently introduced in Azure VMs, SQL FCIs allows to easily migrate HA workload from on-premises environments to the cloud with the added benefit of application compatibility.[00:30] About Javier Villegas[01:20] Failover cluster overview[05:36] SQL Server Failover Cluster Instances in Azure[09:09] Demo: Created shared disc in Azure portal[11:42] Getting startedAbout Javier Villegas:Javier Villegas is IT Director (DBA & BI Services) at Mediterranean Shipping Company with more than 20 years of experience working with SQL Server, Including Azure SQL.His specialization is Administration, Performance Tuning, High Availability and Disaster Recovery.Javier is a Microsoft MVP Data Platform since 2016 and MCT.He is a frequent speaker in technical conferences and events such as SQL Saturdays, PASS Virtual Groups, PASS Marathons, 24 Hours SQL PASS , vOpen , GroupBy ,DataPlatformGeeks , Data Saturdays and Azure Global Bootcamps.He is one of the group leaders of SQL Argentina Community and Microsoft Azure Data Advisory Board Member.About MVPs:Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the "bleeding edge" and have an unstoppable urge to get their hands on new, exciting technologies. They have a very deep knowledge of Microsoft products and services, while also being able to bring together diverse platforms, products, and solutions, to solve real-world problems. MVPs make up a global community of over 4,000 technical experts and community leaders across 90 countries/regions and are driven by their passion, community spirit, and the quest for knowledge. Above all and in addition to their amazing technical abilities, MVPs are always willing to help others - that's what sets them apart. Learn more: https://aka.ms/mvpprogram

Looking for the next Microsoft Learn modules to complete? Bob Ward, Buck Woody, and Anna Hoffman give you a run-down of Microsoft Learn, the learning paths they've launched, and the two new Microsoft Learn modules - Azure SQL IoT and Azure Arc-enabled data services - they've been working on that are now live. Start learning today![00:33] Introductions[00:52] SQL Workshops[02:05] About Microsoft Learn[02:38] Microsoft Learning Path - Build serverless, full stack applications in Azure[03:28] Microsoft Learning Path - Azure SQL Fundamentals[05:11] Microsoft Learn Module - Introduction to Azure Arc-enabled data services[07:26] Microsoft Learning Path - Azure Arc[08:33] Microsoft Learning Module - Deploy IoT Solutions with Azure SQL Database[09:43] Getting startedResources:Microsoft LearnSQL Server and Azure SQL Labs and WorkshopsMicrosoft Learning Path - Build serverless, full stack applications in AzureMicrosoft Learning Path - Azure SQL FundamentalsMicrosoft Learn Module - Introduction to Azure Arc-enabled data servicesMicrosoft Learning Path - Manage hybrid infrastructure with Azure ArcMicrosoft Learning Module - Deploy IoT Solutions with Azure SQL DatabaseAzure Arc Jumpstart

If you're looking to scale your Postgres database, the Citus open-source extension to Postgres makes sharding simple. And Citus is available on Azure as a managed service, too. Join Claire Giordano on the Citus team to learn about how Citus uses the Postgres extension APIs to shard Postgres—and the best way to get started with Citus. [01:24] What is Citus[03:40] What applications sharding Postgre with Citus[05:34] How large can a Citus cluster get?[07:45] When to use Citus[08:45] Getting statedResources: Citus open source repo on GitHubGetting Started with Citus resourcesCitus on Azure documentationCitus monthly newsletterVideo: How Citus Distributes PostgreSQL

Query store hints enables changing query plan shapes without modifying application code. In this episode of Data Exposed with Denzil Ribeiro, we will look at an example of improving the performance of bulk loading data using query store hints. [00:30] Introduction Denzil Ribeiro[01:40] Memory Grants Overview [02:49] Demo[13:05] Getting Started Resources:Performance impact of memory grants on data loads into Columnstore tables

It is important to ensure that your Azure Virtual Machine is meeting the performance and stability standards you have established in your organization. PerfInsights can help identify and report on your Azure SQL VM health and provide references to how administrators can mitigate the risks. PerfInsights is a self-help diagnostics tool that can be run through the portal or as a standalone tool that collects diagnostic data, produces analytic reporting, summarizes system information, and produces a system log output that can help troubleshoot virtual machine performance problems in Azure for various scenarios including SQL Server, Windows OS, Linux, Azure storage, and more. PerfInsights allows administrators to run quick analysis, produce a benchmark result, analyze slow virtual machines, analyze Azure files, and perform advanced scenarios including xperf, network tracing, storport tracing, perf counter traces, and diskspeed benchmarks. In part five of this seven-part series, we will analyze PerfInsights captures to review SQL Server findings, review storage analysis against Azure storage thresholds, resource reporting, and will review the system summary information that can make it a lot easier to document your Azure SQL Virtual Machine environment. [00:58] PerfInsights Overview[02:20] Demo[15:48] Getting started Resources:Advanced performance analysis: https://aka.ms/perfinsights/advancedAzure Files analysis: https://aka.ms/perfinsights/azurefilesQuick performance analysis: https://aka.ms/perfinsights/quickPerformance analysis: https://aka.ms/perfinsights/vmslowBPCheck - SQL Best Practices and Performance checks: http://aka.ms/BPCheckPremium storage disk sizes: https://docs.microsoft.com/en-us/azure/virtual-machines/premium-storage-performance#premium-storage-disk-sizesAzure SQL Virtual Machine Reimagined Series: https://aka.ms/azuresqlvmyt   

As database professionals, we all know how to manage SQL Server Agent jobs using SQL Server Management Studio (SSMS), TSQL, and PowerShell. With Azure Data Studio and SQL Server Agent extension, we have new tools to create, maintain and manage SQL Agent jobs using Notebook. These are called Notebook Jobs. Once you successfully execute a Notebook job manually or via schedule, each run's results are saved into a separate Notebook, which you can easily share with others. In this episode of Data Exposed: MVP Edition, Taiob Ali will walk you through every step of Notebook Jobs.[00:31] About Taiob Ali[01:34] Benefits of SQL Server Agent Jobs[04:50] Demo[T012:30] Getting StartedResources:Github About Taiob Ali:Taiob Ali, Microsoft Data Platform MVP, is an accomplished technical leader with a proven record of success. During his last 15 years, he has worked with the Microsoft Data Platform and MongoDB, both on-premises and cloud. His experience includes all three major business sectors: finance, e-commerce, and healthcare. Taiob has hands-on experience managing large database projects, including massive data migration, intricate process design, testing and deployment, performance tuning, and long-term capacity planning. Taiob is currently working at "GMO LLC" as Database Solutions Manager, focusing on cloud migration, automation, improving, and streamlining operational workflow. He is a regular speaker at local and virtual chapters, Data Saturdays, and Azure conferences. He is a board member of New England SQL Server User Group, founder of 'Database Professionals Virtual Meetup Group', and organizer of Boston Data Saturday.About MVPs:Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the "bleeding edge" and have an unstoppable urge to get their hands on new, exciting technologies. They have a very deep knowledge of Microsoft products and services, while also being able to bring together diverse platforms, products, and solutions, to solve real-world problems. MVPs make up a global community of over 4,000 technical experts and community leaders across 90 countries/regions and are driven by their passion, community spirit, and the quest for knowledge. Above all and in addition to their amazing technical abilities, MVPs are always willing to help others - that's what sets them apart. Learn more. 

When migrating your SQL Server workloads to Azure VM, there are literally hundreds of different VM sizes to choose from. Hopefully, you've seen our videos on sizing so you have an idea of the methodology we recommend to choose the right size, but what if you have a new SQL Server workload that you don't have metrics for? Where should you start? In part 4 of this eight-part series, we will highlight the Edsv4-series VMs and show you why we think they are the best VMs for your SQL Server workloads.[00:44] What are considerations for VM sizes[02:30] Favorite VM series[03:04] Edv4 and Edsv4-series documentation[07:37] Getting startedResources:Edv4 and Edsv4-seriesVM size: Performance best practices for SQL Server on Azure VMsHow to get the biggest bang for your buck with SQL Server on Azure VMAzure SQL Virtual Machine Reimagined Series

 Azure Monitor is a technology used to collect telemetry data from your Azure and on-premises environments. You can use Azure Monitor to improve performance and support the stability of your applications by identifying issues quickly. Azure Monitor includes Azure Metrics and Azure Logs to store telemetry data and track data in real-time and for historical analysis.Azure Metrics track values collected at regular intervals and can be used to describe the health of your resources at a particular point in time. Azure Metrics are lightweight and useful for creating dashboard KPIs, alerting, and fast detection of issues.In part three of this seven-part Azure SQL VM series, we will use Azure metrics to identify the uncached and cached health of your virtual machine and disk resources. We will show how to find metrics at the VM scope, pin metrics to create a custom dashboard, how to manage alerts, and finally comparing cached and uncached metrics at the VM and disk levels. [00:48] Tracking VM cached health[02:55] Demo[09:23] Getting started Resources:Disk performance metricsAzure Monitor

In part two of this seven-part VM series, learn how to easily manage your Azure SQL virtual machines using the SQL IaaS Agent Extension with Pam Lahoud. Whether you are using an Azure Marketplace image or a custom image with a self-installed SQL Server, the SQL IaaS Agent Extension offers a number of features to discover and manage your SQL Server VMs quickly and easily through the Azure Portal. [00:44] What is SQL Server IaaS Agent Extension[01:30] Demo[05:23] Set-up[09:28] Getting started Resources:Automate Management with the SQL Server IaaS Agent ExtensionAutomatic Registration with SQL Server IaaS Agent Extension

Optimizing Virtual Machine storage is one of the most critical areas to focus on when architecting for performance with SQL Server on Azure Virtual Machines (VM). Virtual machines have input/output operations per second (IOPS) and throughput performance limits based on the virtual machine type and size as well as storage. In part one of this seven-part VM series, we'll cover how capping occurs at the virtual machine and storage levels and how caching can help remove the impact of these performance limits. [00:40] Optimizing Storage Performance[02:46] Azure Virtual Machine and Storage[03:49] Disk IO Capping[06:46] Azure VM IO Capping Resources:Checklist: Best practices for SQL Server on Azure VMsVM size: Performance best practices for SQL Server on Azure VMsStorage: Performance best practices for SQL Server on Azure VMsHow to get the biggest bang for your buck with SQL Server on Azure VMsDeep Dive: Azure SQL Virtual Machine Sizing | Data Exposed LiveAzure SQL Virtual Machine Reimagined Series

SQL Server object disks on Windows Server can be expanded at any time with no issues, but Linux doesn't quite work like that by default. In a situation where you run out of space, you're out of luck, unless you know some secrets about Linux. The mysterious Linux Logical Volume Manager must be used before you put anything on the disks to properly set up the disks so you can expand them in a pinch in the future. In this episode with David Klee, we're going to walk through how to use this service to set up your object volumes the right way from the beginning and show you how to expand the disks with no outage. Break out your pocket protectors and come learn with someone who was compiling Linux kernels while in elementary school! [00:37] About David Klee[01:18] Challenge overview[02:14] Linux Logical Volume Manager [03:00] Demo: Logical Volume Manager Setup[09:22] Who should this set up[10:05] Getting started Resources:$2 Million Reasons to Start with TuningDavid Klee's websiteHeraflux Data Platform ConsultantsSQLlibrium Training About David Klee:David Klee is a Microsoft Data Platform MVP and VMware vExpert with a lifelong passion for technology. David spends his days focusing on the convergence of data and infrastructure as the Founder of Heraflux Technologies and SQLibrium Education. His areas of expertise are cloud, virtualization, performance tuning, and business continuity. David speaks at a number of national and regional technology-related events, including the PASS Summit, VMware VMworld, SQLBits, SQL Saturday events, and many SQL Server User Groups. About MVPs:Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the "bleeding edge" and have an unstoppable urge to get their hands on new, exciting technologies. They have very deep knowledge of Microsoft products and services, while also being able to bring together diverse platforms, products and solutions, to solve real world problems. MVPs make up a global community of over 4,000 technical experts and community leaders across 90 countries/regions and are driven by their passion, community spirit, and quest for knowledge. Above all and in addition to their amazing technical abilities, MVPs are always willing to help others - that's what sets them apart. Learn more: https://aka.ms/mvpprogram

In this episode of Data Exposed with Davide Mauri, get an overview of the newly released feature for Azure SQL Hyperscale Database: Named replicas. Named replicas allow for incredible scalability, giving you the option to scale out the database up to 30 named replicas, so that you can sustain any workload of any size. We'll dive into the key features that make Named replicas unique, the use case where Named replicas excels and some tips and tricks to architect solutions to take advantage of them, to get great performance and also to save a substantial amount of money.[00:36] Introductions[02:38] Azure SQL Hyperscale Overview[04:15] Azure SQL Hyperscale Replicas[05:30] High-Availability Replica[07:22] Named Replica[11:02] Named Replica - Use Cases & Sample Scenarios[15:06] Demo[20:00] Getting startedResources:Named replica (in Preview)