Azure Weekly Issue 394: 6th November 2022

There's a mixed bag of interesting content this week. Firstly there's an article about Data mesh: A perspective on using Azure Synapse Analytics to build data products, which was the main theme at the recent Big Data LDN conference, which Eli Gascon covers in her blog post: Big Data LDN highlights and how to survive your first data conference

There's another theme this week around creating reliable software; Prepare for holiday shopping season with Azure Load Testing, and Chaos Engineering for Cloud native Apps and Build a globally resilient architecture with Azure Load Balancer

General Availability of Multivariate Anomaly Detection has been announced. Anomaly Detection is an incredibly useful technology that more orgs should make use of, we produced a talk about Detecting Anomalies in IoT Telemetry with Azure Synapse Analytics a couple of years ago. Well worth a watch. Roy Hopkins writes a fascinating article about Confidential Computing with Serverless Functions, and on the recent theme of optimising cloud budgets Azure App Service announces more ways to save on compute costs.

.NET Interactive Notebooks is now Polyglot Notebooks!. We absolutely love this technology. You can use them to run C#, F#, PowerShell, JavaScript, SQL, KQL (Kusto Query Language), HTML, and Mermaid diagrams. We use it to do experiments (not just data science, but any code based hypothesis testing), to perform benchmarking of Azure services and code. We use them to provide documentation including interactive code examples and we use them as runbooks to perform maintenance or migration operations. In short, it's a technology you should all be using.

Finally, our Modern Data DevOps with Azure Synapse Analytics Workshop in London was a big success. Hopefully we'll be running it again soon, possibly virtually. Well done Ian & Ed!

AI + Machine Learning

Covering: Anomaly detector, Azure Bot Service, Azure Machine Learning, Azure Open Datasets, Bing APIs, Cognitive Services, Computer Vision, Content moderator, Custom vision, Data Science Virtual Machines, Face, Form Recogniser, Immersive Reader, Ink Recogniser, Language Understanding (LUIS), Machine Learning Studio, Microsoft Genomics, ML.NET, Personaliser, Project Cortex, QnA Maker, Speaker Recognition, Speech-to-Text, Speech translation, Text Analytics, Text to Speech , Translator Speech, Translator Text

• Shelly Avery describes Healthcare Shorts: Pneumonia Prediction Model
• Louise Han announces General Availability of Multivariate Anomaly Detection

Analytics

Covering: Apache Spark for HDInsight, Apache Storm for HDInsight, Azure Analysis Services, Azure Data Explorer, Azure Data Share, Azure Databricks, Azure Stream Analytics, Azure Synapse Analytics, Data Catalog, Data Factory, Data Lake Analytics, Event Hubs, HDInsight, .NET for Apache Spark, R Server for HDInsight, Azure Purview

• The Azure Updates Team announces Generally available: Azure Databricks SQL Pro
• Amanjeet Singh blogs about Data mesh: A perspective on using Azure Synapse Analytics to build data products
• Eli Gascon (@elisendagascon) shares her Big Data LDN highlights and how to survive your first data conference - and includes notes about all the data mesh sessions she attended.
• Ryan Majidimehr (@rmajidimehr) blogs about Azure Synapse Analytics October Update 2022 - Microsoft Ignite Recap
• Michal Bar writes about ADX Web updates – October 2022
• Anna Hoffman, Marisa Brasile, Ebru Ersan, Bradley Ball, Silvano Coriani, Niko Neugebauer, and Pieter Vanhove explains how to Join Microsoft at PASS Data Community Summit 2022
• Meagan Longoria (@mmarie) covers The Reason We Use Only One Git Repo For All Environments of an Azure Data Factory Solution
• Sabyasachi Samaddar explains how to Install Third Party .WHL packages within Apache Spark Cluster running in a DEP enabled Azure Synapse
• Noelle Li blogs about Azure Data Factory October 2022 Monthly Update
• On episode 158 of thr Ctrl+Alt+Azure podcast, Tobias Zimmergren and Jussi Roine talk about Exporting data from Dataverse to Azure
  
• On SQL Server Central, John Miner discusses Leveraging the Script Activity within Azure Data Factory

Compute

Covering: Azure CycleCloud, Azure Dedicated Host, Azure Functions, Azure VMware Solution by CloudSimple, Batch, Cloud Services, Linux Virtual Machines, SAP HANA on Azure Large Instances, Service Fabric, Virtual Machines, Virtual Machine Scale Sets

• Rene van den Bedem blogs about Azure VMware Solution GitHub Repository is now live
• Jie Zhang covers NCCL Performance Impact with PCIe Relaxed Ordering
• Hopkins discusses Confidential Computing with Serverless Functions
• Bert O Neill covers Debugging Azure Functions
• Denver Brittain blogs about Getting Started with MongoDB Atlas and Azure Functions using Node.js
• Jose Angel Fernandez Rodrigues explains how to Automate the deployment of your CycleCloud server with Bicep

Containers

Covering: Azure Kubernetes Service (AKS), Azure Red Hat OpenShift, CNAB, CNCF, Container Instances, Container Registry, Porter, WSL, Web App for Containers

• On the Octopus Deploy Blog, Matthew Casperson describes how to SSH into a Kubernetes cluster
• Denis Mizetski writes about New OpenSSL v3 vulnerability: prepare with Microsoft Defender for Cloud
• Vinicius Apolinario (@vrapolinario) presents 5 tips for IIS on containers: 1 SSL certificate lifecycle management
• On The New Stack, B. Cameron Gain explains how to Is VMwares Carvel Donation Just Another CNCF Sandbox
• Yassine El Ghali announces sustainability guidance for Azure Kubernetes Service
• Daniel Neumann (@neumanndaniel) blogs about Azure Kubernetes Service news from KubeCon North America 2022
• Stefan Georgiev (@stg3orgi) writes about Best practices to harden your AKS environment
• Ahmed Sabbour (@sabbour) describes Code-to-cloud with Azure Kubernetes Service AKS

Databases

Covering: Azure Cosmos DB, Azure Database for MariaDB, Azure Database for MySQL, Azure Database for PostgreSQL, Azure SQL Database, Azure SQL Database Edge, Azure Cache for Redis, SQL Data Warehouse, SQL Server on virtual machines, SQL Server Stretch Database, Table storage

• Daniel Calbimonte asks Is Azure SQL Database a Good Choice for your Database Applications?
• Greg Low (@greglow) talks about Cosmos Down Under podcast 5 – Charles Feddersen on the Azure Cosmos DB for PostgreSQL API
• On the Azure Developer Community Blog, Daniel Kim talks about Azure Cosmos DB for PostgreSQL w/ React Quickstart
• Freist Li explains how to Persist Bot Conversation States in Azure Cosmos DB with Bot Framework Composer V2.1.2
• Bob Ward explains how to Take the SQL Server Mac challenge
• Jose M Jurado (@jmjuradodiaz) covers Lesson Learned 245: Azure SQL Database - Lessons Learned from the Trenches in PASS Summit 2019
• Varun Dhawan explains How to leverage built-in connection pooler PgBouncer in Azure PostgreSQL Flexible Server
• Thomas Thornton (@tamstar1234) walks through Creating multiple Azure postgresql server replicas using Terraform

Developer Tools

Covering: App Configuration, Azure Lab Services, CLIs, Developer tool integrations, SDKs, Visual Studio, Visual Studio Code, Visual Studio Online

• .NET Blog, Claudia Regio (@ClaudiaRegio) announces .NET Interactive Notebooks is now Polyglot Notebooks!
• Mads Kristensen (@mkristensen) talks about Cool features in Visual Studio 2022 and PHP in Visual Studio
• Geert Baeke (@GeertBaeke) provides A quick look at Azure App Configuration and the Python Provider
• David Ramel talks about Exploring the 'Almost Creepy' AI Engine in Visual Studio 2022
• David Ramel (@dramel) writes about VS Code v1.73 October 2022: Improved Search, New Audio Cues, Dev Container Tweaks
• On Code Project, Bert O Neill writes about Visual Studio - User Secrets

DevOps

Covering: Azure Artifacts, Azure Boards, Azure DevOps, Azure Pipelines, Azure Repos, Azure Test Plans, Azure DevTest Labs, DevOps tool integrations

• On episode 217 of the Azure DevOps podcast, Jeffrey Palermo (@jeffreypalermo) is joined by Nicholas Blumhardt to discuss Structured Logging
  
• Nagarjuna Vipparthi explains how to Prepare for holiday shopping season with Azure Load Testing
• Gerasimos Alexiou describes how to Pass secrets as ENV variables on docker build – Azure devops
• Kevin Chant provides A GitHub CI/CD experience for Azure Synapse Link for SQL Server 2022
• Chris Reddington (@reddobowen) and Ashish Bhalgat (@bhalgatashish) talk about Chaos Engineering for Cloud native Apps
• The Azure Updates Team talks about Public preview: Azure Automation supports PowerShell 7.2 and Python 3.10 runbooks

Hybrid + Multicloud

Covering: Azure Arc, Azure Stack

• Thomas Maurer (@thomasmaurer) describes Speaking at the Windows Server Summit 2022
• James van Den Berg covers MVPLABSerie Azure Arc enabled Servers AzureHybrid
• Aurnov Chattopadhyay says Ansible and Azure Arc-enabled servers are better together.
• David Engel explains how to Update: ODBC Driver 18.1.2 for SQL Server Released
• On the Microsoft Cloud IT Pro Podcast, Ben and Scott covers Episode 306 – Testing Azure Arc using Azure VMs
• Gregor Reimling blogs about Speaking at Cloud Brew 2022 about Azure Arc

Identity

Covering: Azure Active Directory (AD), Azure Active Directory B2C, Azure Active Directory Domain Services

• On the Redmond magazine site, Kurt Mackie (@kurmac) covers Microsoft and Yubico Preview Certificate-Based Authentication for Mobile Devices Using Security Keys
• The Azure Updates Team describes Azure Multi-Factor Authentication Server will be deprecated 30 September 2024
• Shirleyse Haley describes The 2-Minute Recap: Everything new with Security, Compliance, and Identity on Microsoft Learn
• Anna Hoffman, Marisa Brasile, Ebru Ersan, Bradley Ball, Silvano Coriani, Niko Neugebauer, and Pieter Vanhove discusses SQL Insider Series: Architect your Azure Data Estate with Well-Architected Framework Data Exposed and talks about SQL Insider Series: Architect your Azure Data Estate with Well-Architected Framework Data Exposed
• Alex Weinert announces Azure AD Certificate-based Authentication CBA on Mobile
• Bhalchandra Atre covers Deprecating Conversion of Distribution Lists to Microsoft 365 Groups
• Michael Hildebrand explains how to Create Emergency Access Accounts for Azure AD and Use Log Analytics to Monitor Sign-ins from Them
• Luis Aranda discusses Root certificates of Azure SQL DB and SQL Managed Instance
• Prakhar Srivastava blogs about Attestation: A necessity for Zero Trust
• On Microsoft Security blog, Emma Jones covers that Microsoft named a Leader in 2022 Gartner Magic Quadrant for Access Management for the 6th year

Integration

Covering: Azure API for FHIR, Event Grid, Logic Apps, Service Bus

• Divya Swarnkar talks about Announcement Public Preview of SWIFT message processing using Azure Logic Apps
• Alex Zúñiga delves into Azure Logic Apps Standard Now Supports Azure Functions v4
• Travis Harris provides A New Foundation For Logic Apps Designer
• Harold Campos covers Host Integration Server Product Roadmap Survey
• Stijn Moreels discusses Arcus Messaging v1.3: Added EventHubs Support, Correlated Service Bus Messages and Much More
• Divya Cherukuri describes Microsoft Azure Service Fabric 8.2 Sixth Refresh Release and describes Microsoft Azure Service Fabric 9.1 Release
• Japhlet Nwamu explains how to Build Exciting Applications with Microsoft Graph Live Join us 7th Nov
• Hilda Sun presents Supplemental Information forAPIM Self-hosted Gateway v1 & v2 Version

Internet of Things

Covering: Azure Digital Twins, Azure IoT Central, Azure IoT Edge, Azure IoT Hub, Azure IoT solution accelerators, Azure Maps, Azure Sphere, Azure Time Series Insights, IoT DevKit, WildernessLabs, Windows 10 IoT Core Services

• The Azure Updates Team writes about Generally available: Device Update for IoT Hub and writes about General availability: IoT Hub Service Upgrade
• The Azure Updates Team blogs about Public preview: New Azure Maps Creator feature - Dataset with GeoJSON
• Clemens Schotte highlights Managed identities for Azure Maps
• Clemens Schotte covers Azure Maps REST SDKs
• James Scott blogs about Azure Sphere – Image signing certificate update coming soon
• Nina Sui explains how to Earn a Digital Badge: 5G Modern Connected Apps Cloud Skills Challenge

Learning

Covering: Microsoft Certifications, Azure Certifications, Microsoft Learning Paths, Certification Pathway Information

• Nina Sui explains how to Earn a Digital Badge: 5G Modern Connected Apps Cloud Skills Challenge
• Asir Selvasingh (@asirselvasingh) ancounces Developer Experience Day - Build and Run Enterprise Spring Apps at Scale
• Oluwaseun Oyero covers MCT Microsoft Community Training Installation Guide

Management and Governance

Covering: Automation, Azure Advisor, Azure Backup, Azure Blueprints, Azure Lighthouse, Azure Managed Applications, Azure mobile app, Azure Monitor, Azure Policy, Azure Resource Manager, Azure Service Health, Azure Site Recovery, Cloud Shell, Cost Management, Microsoft Azure portal, Scheduler, Azure Purview

• Daniel Kim writes 'Winter is Coming - Keep your Azure services up to date.'
• Maxim Sergeev talks about Azure Monitor for Enterprises and not only. How does Azure CxP team leverage Policies at-scale
• Michael C. Bazarewsky walks through Custom Software Updating with Azure Update Management Center
• On  episode 444 of The Azure Podcast, the Podcast team (@AzurePodcast) are joined by Mark Eisenberg to talk about recent Azure Innovations
• Manuel Pereira describes How to troubleshoot sensitivity Labels – Part 2

Media

Covering: Azure Media Player, Content Protection, Encoding, Live and On-Demand Streaming, Media Analytics, Media Services, Video Indexer

Migration

Covering: Azure Database Migration Service, Azure Migrate, Data Box

Mobile

Covering: App Service (Mobile), Mobile apps, Notification Hubs, Visual Studio App Centre, Xamarin

• Junior Saravia writes about Awesome Mobile Forms with Xamarin Community Toolkit
• On the Azure podcast, the team delves into Azure Innovations announced by Mark Russinovich at Ignite.

Networking

Covering: Application Gateway, Azure Bastion, Azure DNS, Azure ExpressRoute, Azure Firewall, Azure Firewall Manager, Azure Front Door, Azure Internet Analyzer, Azure Private Link, Content Delivery Network, Load Balancer, Network Watcher, Traffic Manager, Virtual Network, Virtual WAN, VPN Gateway, Web Application Firewall

• The Azure Updates Team writes about Generally available: New KMS DNS in Azure US Government Cloud
• On the Azure blog, Mahip Deora explains how to Build a globally resilient architecture with Azure Load Balancer
• Eliran Azulai and Gunjan Jain discuss Text4Shell RCE vulnerability: Guidance for protecting against and detecting CVE-2022-42889
• Jerry Zhang describes How to enable IPv4+IPv6 dual-stack feature on Service Fabric cluster

Security

Covering: Azure DDoS Protection, Azure Information Protection, Azure Sentinel, Key Vault, Security Center

• The Azure Updates Team writes about General availability: Microsoft Azure Payment HSM Service
• Matthew Littleton writes 'Microsoft Priva is generally available to GCC, GCC High and DoD'
• Sarah Fender (@sarahfender), Principal Program Manager - Azure Cybersecurity, writes 'Microsoft is named a Leader in the 2022 Gartner Magic Quadrant for Security Information and Event'
• Charbel Nemnom (@charbelnemnom) explains How To Delete Microsoft Sentinel Analytics Rule Templates
• Denis Mizetski writes about a New OpenSSL v3 vulnerability: prepare with Microsoft Defender for Cloud
• On the Azure Medium blog, Andre Camillo describes Everything you need to get started with Architecting and Design Microsoft Sentinel 2022
• Keith Fleming walks through Introducing the Microsoft Defender for Cloud Apps data protection series
• Troy Lainhoff covers Using Microsoft Security APIs for Incident Response - Part 1 and Part 2
• Andre Camillo walks through Everything you need to get started with Architecting and Design Microsoft Sentinel 2022
• On the Azure blog, May Chen announces that Secure your digital payment system in the cloud with Azure Payment HSM—now generally available
• On the Azure blog, May Chen writes about Secure your digital payment system in the cloud with Azure Payment HSM—now generally available
• Daniel Krzyczkowski (@DKrzyczkowski) discusses DevSecOps on Azure - part10: Detect and respond to security events in Azure with Microsoft Sentinel

Storage

Covering: Archive Storage, Avere vFXT for Azure, Azure Data Lake Store, Azure FXT Edge Filer, Azure HPC Cache, Azure NetApp Files, Blob Storage, Disk Storage, File Storage, Managed Disks, Queue Storage, Storage Accounts, Storage Explorer, StorSimple

• The Azure Updates Team writes about Generally available: Encrypt storage account with cross-tenant customer-managed keys

Web

Covering: API apps, API Management, App Service (Web), Azure Cognitive Search, Azure SignalR Service, Azure Spring Cloud, Web apps

• Mayunk Jain (@mayunkj) describes Azure App Service announces more ways to save on compute costs
• Jing Wang explains How to build a FTP client in Azure Spring App
• Damien Bowden (@damien_bod) describes Switch tenants in an ASP.NET Core app using Azure AD with multi tenants
• Karthi Teja Malyala walks through Adding HSTS header in the NGINX based App Service and explains How to check if the uploaded certificate is added to Windows-My keystore on App Service-Windows
• Youna Hyun blogs about Migration app service resources across subscriptions with import certificate

Azure Virtual Desktop

Covering: Azure Virtual Desktop