Azure Weekly Issue 308: 24th January 2021
There's a lot of great content to highlight, so I'll jump right in. In the analytics space, Jon George shows how to trigger an Azure Synapse pipeline run from C#. Next - how to perform Group By in Synapse Analytics Spark, and the LIKE keyword support now generally available in Azure Cosmos DB.
In the Engineering, DevOps & Tooling space: Design for transient faults in Azure, an In-Depth Guide to Building a PowerShell Pipeline in Azure DevOps, the Best Visual Studio Code extensions to work for Azure (Part 2 - All Around Azure), and AI powered Azure tools.
In containers, "AKS Zero To Hero – Series for everyone", in APIM Importing an OpenAPI API into Azure API Management Service, in storage Prevent Shared Key authorization on Azure Storage accounts is in public preview, and in DevSecOps Secure DevOps Kit for Azure (AzSK).
Finally, an interesting post about a customer of ours, which delves into how the Earth's atmosphere has been modelled in Microsoft Azure as part of a project to tackle climate change caused by aviation, and an interesting podcast about Project Natick.
AI + Machine Learning
Covering: Anomaly detector, Azure Bot Service, Azure Machine Learning, Azure Open Datasets, Bing APIs, Cognitive Services, Computer Vision, Content moderator, Custom vision, Data Science Virtual Machines, Face, Form Recogniser, Immersive Reader, Ink Recogniser, Language Understanding (LUIS), Machine Learning Studio, Microsoft Genomics, ML.NET, Personaliser, Project Cortex, QnA Maker, Speaker Recognition, Speech-to-Text, Speech translation, Text Analytics, Text to Speech , Translator Speech, Translator Text
- On Tech Community blog, Baoping Zhang discusses AI powered Azure tools
- Also on Tech Community blog, Neha Rajput talks about a QnA with Azure Cognitive Search
Analytics
Covering: Apache Spark for HDInsight, Apache Storm for HDInsight, Azure Analysis Services, Azure Data Explorer, Azure Data Share, Azure Databricks, Azure Stream Analytics, Azure Synapse Analytics, Data Catalog, Data Factory, Data Lake Analytics, Event Hubs, HDInsight, .NET for Apache Spark, R Server for HDInsight, Azure Purview
- On the endjin blog, Jonathan George (@jon_george1) walks through How to trigger an Azure Synapse pipeline run from C#
- Derek Daniels blogs about Automating Azure Synapse Analytics and Azure Analysis Services Tabular, or Power BI Dataset
- Jake Wang talks about Data Validation at Scale with Azure Synapse
- Ed Elliott (@EdDebug) runs through some examples for using Synapse Analytics Spark, covering: Group By, ROW_NUMBER() and Common Table Expressions
- Sergio Fonseca (@FonsecaSergio) writes about how to Automatic pause all Synapse Pools and keeping your subscription costs under control
- On the SQL Server Blog, the SQL Server Team (@SQLServer) writes about Around the clock with Azure SQL and Azure Data Factory
- Mark Kromer (@kromerbigdata) describes Azure Data Factory Enables Data Wrangling at Scale with Power Query
- On the MSSQL Tips site, Ron L'Esteve discusses Azure Data Factory Pipeline Logging Error Details
- Andy Leonard (@AndyLeonard) discusses Learning ETL. Where Should I Focus?
- On the Microsoft News Centre, The Earths atmosphere has been modelled in Microsoft Azure as part of a project to tackle climate change caused by aviation
Compute
Covering: Azure CycleCloud, Azure Dedicated Host, Azure Functions, Azure VMware Solution by CloudSimple, Batch, Cloud Services, Linux Virtual Machines, SAP HANA on Azure Large Instances, Service Fabric, Virtual Machines, Virtual Machine Scale Sets
- On the DEV site, Justin Yoo (@justinchronicle) writes about using Durable Functions to Schedule Publish to Dev.To
- Thomas Maurer (@thomasmaurer) explains how to Find the Hostname of a Hyper-V VM
- On the MSSQL Tips site, Vitor Montalvao explains how to Create Azure VM from a VHD image
- On the Auth0 Blog, Samson Amaugo, demonstrates Making a CRUD API using Azure Functions and Azure Cosmos DB
Containers
Covering: Azure Kubernetes Service (AKS), Azure Red Hat OpenShift, CNAB, CNCF, Container Instances, Container Registry, Porter, WSL, Web App for Containers
- Gregor Suttie (@gregor_suttie) provides: "AKS Zero To Hero – Series for everyone"
- On .NET Rocks, Tom Kerkhove (@TomKerkhove) talks about Containers on Azure
- The Azure Updates Team announces two public previews: Dynamic IP allocation and enhanced subnet support in AKS, and Automatic Cluster Upgrades in AKS and the general availability of Optional Uptime SLA for Azure Kubernetes Service private clusters
- Daniel Neumann (@neumanndaniel) describes how you can Increase your application availability with pod anti-affinity settings in Azure Kubernetes Service
- Reshma Vishwanath explains How to rebuild new cluster by retaining rest of the resources in the Resource Group
- The Azure Updates Team announces that Azure Key Vault CSI driver support in Azure Kubernetes Service is in Public Preview
Databases
Covering: Azure Cosmos DB, Azure Database for MariaDB, Azure Database for MySQL, Azure Database for PostgreSQL, Azure SQL Database, Azure SQL Database Edge, Azure Cache for Redis, SQL Data Warehouse, SQL Server on virtual machines, SQL Server Stretch Database, Table storage
- The Azure Updates Team announces that Azure Cosmos DB Management with PowerShell cmdlets is now generally available, that Azure Cosmos DB: Multiple region Availability Zones support with single-region write now generally available and finally that LIKE keyword support now generally available in Azure Cosmos DB
- On the Revolution Analytics blog, Hong Ooi highlights AzureCosmosR: interface to Azure Cosmos DB
- Jakub Szymaszek (@JakubSzymaszek) highlights the Always Encrypted with secure enclaves in Azure SQL Database preview
- Silvano Coriani (@scoriani) discusses Azure SQL Connectivity Performance Tips & Tricks
- Tariq Rasheed Al-Qaralleh covers an issue: Importing bacpac failed to Azure SQL with User, group, or role XXX already exists
Developer Tools
Covering: App Configuration, Azure Lab Services, CLIs, Developer tool integrations, SDKs, Visual Studio, Visual Studio Code, Visual Studio Online
- On the DEV site, Aaron Powell (@slace) covers Extending the GitHub CLI
- On Channel 9, Brian Clark (@_clarkio) talks about the Best Visual Studio Code extensions to work for Azure (Part 2 - All Around Azure)
DevOps
Covering: Azure Artifacts, Azure Boards, Azure DevOps, Azure Pipelines, Azure Repos, Azure Test Plans, Azure DevTest Labs, DevOps tool integrations
- The Azure updates team announces New enhancements to Delivery Plans 2.0 in Azure Boards
- Barbara Forbes (@Ba4bes) walks through how to Deploy Azure PowerShell Functions with GitHub Actions
- On Hackernoon, Adam Bertram (@adbertram) describes How To Configure an Azure DevOps Pipeline
- Adam Bertram (@adbertram) provides an In-Depth Guide to Building a PowerShell Pipeline in Azure DevOps
- Thomas Thornton (@tamstar1234) discusses Keeping your ADO pipelines DRY (Dont Repeat Yourself)
- Magdy Salem highlights a Secure DevOps Kit for Azure (AzSK)
- On the Azure Developer Community Blog, Sagar Lankala covers a Customer Story: SharePoint Online Team leverages DevTest Labs to create Testing Environments
Hybrid
Covering: Azure Arc, Azure Stack
- Rick Claus (@RicksterCDN) highlights an "All Things Hybrid Event"
Identity
Covering: Azure Active Directory (AD), Azure Active Directory B2C, Azure Active Directory Domain Services
- Antti K. Koskela (@koskila) describes How to recover the private key of a .pfx certificate
- The Azure Updates Team announces that App Service Authentication portal experience is now in public preview
Integration
Covering: Azure API for FHIR, Event Grid, Logic Apps, Service Bus
- The Azure Updates Team announces that the The Azure Quota REST API to manage service limits quotas is now generally available, the general availability support for Java Message Service JMS 2.0 API on Azure Service Bus Premium, and that Service Bus support for large message payloads and Azure Log Analytics in UAE Central & Japan West are now in public preview
- Scarlett Liu discusses whether you should Complete Message Asynchronously or Synchronously in Azure Service Bus?
- On the Premier Developer blog, Bryan Soltis (@bryan_soltis) walks through Connecting an Azure Logic App to a local Web API
- Nidhi Pathak runs through how to Authenticate with managed identity for Azure AD OAuth-based connectors in Azure Logic Apps
- On Azure Sentinel blog, Lior Tamir highlights the new Managed Identity for Azure Sentinel Logic Apps connector
- On the Azure Medium blog, Adam Bertram (@adbertram) describes How to Send Email from Azure and Sam Cogan covers Sending Email in Azure
- Sean Feldman (@sfeldman) writes how to Automatically provision NServiceBus Service Bus Function endpoint topology
- Chris Reddington (@reddobowen) talks about Gatekeeper and Valet Key Patterns - Secure your APIs and Resources
Internet of Things
Covering: Azure Digital Twins, Azure IoT Central, Azure IoT Edge, Azure IoT Hub, Azure IoT solution accelerators, Azure Maps, Azure Sphere, Azure Time Series Insights, IoT DevKit, WildernessLabs, Windows 10 IoT Core Services
- The Azure Updates Team announces that Azure Sphere OS version 21.01 is now available for evaluation and that Azure IoT Edge for Linux on Windows is available for public preview
- Jeffrey Raymond Kitt covers the Creation Of An Exoskeleton With Microsoft Technologies
- Eric Van Aelstyn describes Whats New in Microsoft Edge for Education
Learning
Covering: Microsoft Certifications, Azure Certifications, Microsoft Learning Paths, Certification Pathway Information
- On the Azure DevOps podcast, Charles Flatt covers Learning as a Developer
Management and Governance
Covering: Automation, Azure Advisor, Azure Backup, Azure Blueprints, Azure Lighthouse, Azure Managed Applications, Azure mobile app, Azure Monitor, Azure Policy, Azure Resource Manager, Azure Service Health, Azure Site Recovery, Cloud Shell, Cost Management, Microsoft Azure portal, Scheduler, Azure Purview
- On The Azure Podcast, Ben Cutler discusses Project Natick
- Stanislav Zhelyazkov (@StanZhelyazkov) discusses: Azure Policy Policies not evaluated right away
- John Downs (@jdwns) covers The benefits of Infrastructure as Code
- Thuan Nguyen writes about Multi-homing Logging with new Azure Monitor Agent
- The Azure Updates Team has made a few announcements:
Azure Monitor ITSM Connector for ServiceNow ITOM with Secure Export,
Azure Log Analytics in Germany West Central, UAE North, & Switzerland West is now generally available,
Changes in Azure Monitor Logs for the AzureDiagnostics table is now available,
Application Insight in Germany West Central, UAE North, & Switzerland West is now generally available,
Azure Site Recovery update rollup 53 is now available - January 2021,
Automatic tracking of click events with Application Insights is now available,
Azure Monitor Network Insights is now generally available,
Encryption at rest using customer-managed keys is now generally available in Azure Backup
and Azure Automation is now available in Switzerland West - Arsen Vladimirskiy (@ArsenVlad) writes about a Simple Azure Managed Application: creating, testing, and publishing in Partner Center
- Guy Reginiano writes about the Azure Monitor for Azure Data Explorer preview
- Roy Gal talks about the Log Analytics UI - New experience for Agents Configuration
- Tao Yang (@MrTaoYang) provides an Azure Bicep Vs Terraform Overview
- Tobias Zimmergren & Jussi Roine (@CtrlAltAzure) discuss how to Design for transient faults in Azure
- Michael Bazarewsky (@ProMikeBaz) blogs about Azure Governance for ISVs
- Sarah Lean (@TechieLass) covers Azure Resource Mover
- Travis Roberts (@Ciraltos) walks through Starting Lab Computers with Stream Deck, a Webhook, and an Azure PowerShell Function
- On System Center Automation, Billy York describes How to use Grouping Azure Workbooks
- On Microsoft + Open Source, Peter Schinagl walks through Deploying SUSE SAP HA Automation in Microsoft Azure
- Kellyn Gorman (@DBAKevlar) describes Oracle Storage Snapshots with Azure Backup
- Asir Selvasingh (@asirselvasingh) discusses how to Effortlessly monitor applications and dependencies in Azure Spring Cloud
Media
Covering: Azure Media Player, Content Protection, Encoding, Live and On-Demand Streaming, Media Analytics, Media Services, Video Indexer
Migration
Covering: Azure Database Migration Service, Azure Migrate, Data Box
- On the Microsoft DevOps blog, Laurent Bugnion (@LBugnion) talks about Azure Migrations
Mobile
Covering: App Service (Mobile), Mobile apps, Notification Hubs, Visual Studio App Centre, Xamarin
Networking
Covering: Application Gateway, Azure Bastion, Azure DNS, Azure ExpressRoute, Azure Firewall, Azure Firewall Manager, Azure Front Door, Azure Internet Analyzer, Azure Private Link, Content Delivery Network, Load Balancer, Network Watcher, Traffic Manager, Virtual Network, Virtual WAN, VPN Gateway, Web Application Firewall
- Adam Listek describes Understanding and Setting up Azure NSGs with PowerShell
- Mark Heath (@mark_heath) talks about Automating Azure Access Restrictions with the Azure CLI
- Robert Smit (@Clustermvp) describes How to change Azure Public IP SKU upgrade Basic to Standard
- Jithin Jose discusses Accelerated Networking on HB, HC and HBv2
- Kamil Bugno (@KamilBugnoKrk) Shares How to protect Azure resources from DDoS
Security
Covering: Azure DDoS Protection, Azure Information Protection, Azure Sentinel, Key Vault, Security Center
- On Azure Sentinel blog, Sarah Young (@_sarahyo) discusses Dedicated clusters for Azure Sentinel
- On the DEV site, Adi Polak (@AdiPolak) discusses Data Management and External Organization Collaboration
- Andreas Wolter (@AndreasWolter) provides an Intro into security principles in the context of database systems
- Also on Tech Community blog, Andreas Wolter (@AndreasWolter) covers the Principle of Least Privilege (POLP)
- Fernanda Vela (@velahuer) talks about Security Control: Enable audit and logging
Storage
Covering: Archive Storage, Avere vFXT for Azure, Azure Data Lake Store, Azure FXT Edge Filer, Azure HPC Cache, Azure NetApp Files, Blob Storage, Disk Storage, File Storage, Managed Disks, Queue Storage, Storage Accounts, Storage Explorer, StorSimple
- The Azure Updates Team announces that Backup for Azure Managed Disk is in limited preview and that Prevent Shared Key authorization on Azure Storage accounts is in public preview
- Charbel Nemnom (@charbelnemnom) covers how to Sync Between Azure File Share and Azure Blob Container
- On SQL Server Central, Rajendra Gupta describes Azure Blob Storage Data Upload with SSIS
- On the Premier Developer blog, Bryan Soltis (@bryan_soltis) blogs about Working with Azure Storage Blobs with a Java Azure Function
Web
Covering: API apps, API Management, App Service (Web), Azure Cognitive Search, Azure SignalR Service, Azure Spring Cloud, Web apps
- On the Premier Developer blog, Bryan Soltis (@bryan_soltis) talks about Importing an OpenAPI API into Azure API Management Service
Windows Virtual Desktop
Covering: Windows Virtual Desktop
Azure Weekly Archive
If you would like to read more interesting articles from the Azure ecosystem check out our archive where you will find all of the back issues.
Contribute Content
If you would like to contribute any content to the Azure Weekly newsletter, please email azureweekly@endjin.com