Azure Weekly
Issue #206 - 6th January 2019
Happy New Year to all Azure Weekly Subscribers! After a short break over the festive, period we're back and ready to take on 2019!
In 2018 we published 49 issues and the readership grew by 30%. The amount of content being produced on a weekly basis shows that Azure has gained widespread adoption and the momentum from Microsoft has increased to an eye watering level.
It was also an amazing year for endjin; we grew the team by 60% and doubled revenues. We built a number of modern data platforms using everything from Data Lake, to Cosmos DB, Azure Analysis Services, Data Science Virtual Machines and ML.NET. We finally had a Microsoft case study published about the fascinating work we did to help TalkTalk in their journey to Azure including the Machine Learning powered Anomaly Detection platform and Data Lake reference archictecture we created. More on these topics soon! We've built a Data Governance Platform to help organisations manage their Data Lakes, which we hope to launch early in 2019, and we created an OpenAPI framework built on top of Azure Functions v2 for easy development of low cost, highly scalable Restful APIs, which we're hoping to open source soon. Amazingly, this only scratches the surface... In short, I really need to start blogging more in 2019!
We wanted to give back to the community in 2018 and sponsored "free to attend events" including dev:east, SQLGLA, SQL Saturday, dotnetsheff, DDD Scotland, DDD Wales, DDD South West, DDD East Anglia and DDD Reading, we also did talks at many of these events as well as .NET User Groups around the UK. We're hoping to do more of this in 2019 too.
I've spent a lot of the last 18 months researching large scale event processing from both a technology and an (water & telco) industry perspective. High-density reactive processing of events is going to be huge in this area; so I was suprised that the announcement that Microsoft open sourced Trill to deliver insights on a trillion events a day seemed to go unnoticed in the lull before Christmas. It is a fascinating example of how Microsoft is converting investments in pure research into innovative new cloud services.
Here are the (rather numerous) announcements and updates since our last issue:
- Azure Service Bus and Azure Event Hubs Virtual Networks and Firewall rules are now generally available
- Dev/test pricing for Azure SQL Database Managed Instance is now available
- Cheers to New CodePush Features
- Azure Scheduler will retire on September 30, 2019
- Azure DevTest Labs: CIS Windows Server 2016 Benchmark L2 available in your lab
- Virtual Network Service Endpoints for serverless messaging and big data generally available
- Transparent Data Encryption TDE with customer managed keys for Managed Instance
- Azure Cosmos DB emulator support for Cassandra API
- Self-service big data prep dataflows available in Power BI Embedded
- Power BI service December update
- The Power BI World Tour is back in 2019 as the Power Platform World Tour!
- Azure PowerShell Az Module version 1.0
- Azure Log Analytics is available in West US 2
- Azure Kubernetes Service December Update
- Resolve to be a "learn it all" with new Azure Certifications!
- Azure Marketplace new offers
- Azure IoT Edge 1.0.5 release
- Premium tier now available for the Azure Database Migration Service
- Support for SQL to Azure SQL DB Managed Instance online migrations
- Migrating to the Az.ApiManagement PowerShell module
- General Availability of Azure Database Migration Service DMS Premium Tier
- Cloud Platform Release Announcement for December 19, 2018
- Azure API Management update from December 20th
- Azure Migrate is now available in Azure Government
- Migrating to the New Azure Service Bus SDK
- AI updates from December 2018
The new year is a time for reflection, and there's a lot of 2018 to reflect upon! Here are a few blogs which showcase the highlights of the past year:
- Happy New Year from Power BI Desktop!
- New Year. New Plans
- A Year in Visual Studio App Center Test
- The biggest IoT stories of 2018
- 2018: Azure Security Center Year in Review
But it is also a time to look forward, so here's to another year of innovation in all things Azure... We're excited to discover what this year may bring!
⚙️ AI + Machine Learning
- On the Azure podcast, Russell Young (@youngr6) presents Episode 259 - AI and Hacks - Tales from the real world
- On the Revolution Analytics blog, David Smith (@revodavid) highlights his Notebooks from the Practical AI Workshop
- On the Azure blog, Xiaoyong Zhu (@zxzxy1988) explains how to Fine-tune natural language processing models using Azure Machine Learning service
- The Azure updates team announce that Cognitive Services Speech Services neural text-to-speech capability is in preview
- On MSDN, Nayan Patel explains how to Build an interactive assistant using QnA Maker
- Also on MSDN, Wriju Ghosh (@wrijugh) presents AI playground – Cognitive Services Labs
- On TechNet, Syed Shanu (@syedshanu3) talks about Microsoft Bot Framework: Real Life Example of Authentication Using Azure Bot Service And FitBit Web API
- Also on MSDN, Guy Barker (@gbarkerZ) writes From Windows 10 Eye Control and the Xbox Adaptive Controller, to Language Understanding and Custom Image Reco – What a journey!
- Also on Channel 9, Seth Juarez (@sethjuarez) talks about Building a Pet Detector in 30 minutes or less
- On Azure, Yochay Kiriaty (@yochayk) announces the AI updates from December 2018
🔎 Analytics
- On the Azure blog, James Terwilliger announces that Microsoft open sources Trill to deliver insights on a trillion events a day
- James Serra (@JamesSerra) describes Azure Data Factory Data Flow
- Chris Webb (@cwebb_bi) talks about ODBC Data Sources, The SqlCapabilities Option And Power Query/Power BI Data Refresh Performance
- On the MSSQL Tips site, Haroon Ashraf discusses Microsoft Azure Analysis Services Web Development Tools (Part 2)
- On the Azure blog, Gabi Lehner explains how to Connect Azure Data Explorer to Power BI for visual depiction of data
- Chris Webb (@cwebb_bi) describes Power BI And Column Order In M Queries And Dataset Tables, blogs about Making Power BI Drillthrough Return The Right Rows When You Use It With Complex Measures, discusses Data Privacy Settings And Data Refresh Performance In Excel And Power BI and announces his Fourteenth Blog Birthday
- On MSDN, Charles Sterling (@chass) announces The Power BI World Tour is back in 2019 as the Power Platform World Tour!
- On the Power BI blog, Swati Gupta talks about Power BI Premium Capacity Metrics app makes navigating and viewing metrics at workspace level easier, Kay Unkroth describes Workspace Management in the Admin Portal, Nikhil Gaekwad blogs about the Power BI Service and Mobile November & December Feature Summary and Sujata Narayana wishes you Happy New Year from Power BI Desktop!
- Also on MSDN, Ed Price (@UserEd_) describes a new reference architecture: Build a real-time recommendation API on Azure
- The Azure updates team announces that Self-service big data prep dataflows available in Power BI Embedded, Power BI Embedded new workspace experience creation API and the Power BI service December update, they delve into Power BI Embedded zero-downtime capacity scale, talk about using Power BI Embedded capacity metrics to monitor workloads, and discuss Azure Resource Health monitoring for Power BI Embedded,
- On TechNet, Theo van Kraay (@TheoKraay) describes Handling Device Telemetry into MongoDB using Azure IoT Hub, Stream Analytics, and Azure Functions
- Also on TechNet, Ed Price (@UserEd_) covers an Interview with a Wiki Ninja & Analytics Guru – Jayendran Arumugam
- On Microsoft Cloud Show, Andrew Connell and Chris Johnson talk about Azure Application Insights and PowerBI with Jason Himmelstein
- On Code Project, Allen O'Neil (@ajsondev) discusses Azure Digital Twins
- Also on TechNet, Amanda Buchholz presents: Learn how to build end-to-end cloud scale analytics solutions in Azure
- Yung Chou (@yungchou) provides A Shiny App for Monitoring Real-Time Data Stream
🖥️ Compute
- On the MSSQL Tips site, Daniel Farina presents Introduction to Bash Scripting: Functions
- On MSDN, Ed Price writes about a new reference architecture: Batch scoring of Python models on Azure
- Mark Heath (@mark_heath) discusses Managing Durable Functions Orchestration History
- On Code Project, Duncan Edwards Jones (@Merrion) discusses how to set custom status message in Durable Functions
- Also on Code Project, Sibeesh Passion (@SibeeshVenu) describes Azure Function as Output Job Topology of an Azure Stream Analytics Job and covers Realtime Serverless IoT Data using Azure SignalR and Azure Functions in Angular
🚢 Containers
- Simon J.K. Pedersen (@simped) explains how to Execute file permission for Azure Container Instances
- Steve Buchanan (@buchatech) blogs about Getting Started with Azure Kubernetes Service AKS
- The Azure updates team announces the Azure Kubernetes Service December Update
- Alex Ellis (@alexellisuk) explains how to Build your own bare-metal ARM cluster
- James van Den Berg explains how to View Container Live logs with Azure Monitoring
- On Channel 9, Damian Brady (@damovisa) talks about Running your First Docker Container in Azure
- Brian Bunke (@brianbunke) describes the vCenter Simulator Docker Container
- On Microsoft Cloud Show, Andrew Connell and Chris Johnson discuss KubeCon 2018, Deprecations and Clarity
- On MSDN, Steve Read (@swread) describes how to Setup an Application Developers Controlled Distribution ADCD in IBM zD&T v12
🗄️ Databases
- On the Azure blog, Jovan Popovic (@jocapc) talks about Transforming your data in Azure SQL Database to columnstore format
- Also on the Azure blog, Kate Baroni describes how A fintech startup pivots to Azure Cosmos DB
- the Azure updates team describes SQL Data Warehouse integration with Informatica iPaaS on Azure, and announces Azure Cosmos DB emulator support for Cassandra API and that Dev/test pricing for Azure SQL Database Managed Instance is now available!
- On MSDN, Jose M Jurado (@jmjuradodiaz) discusses how Adding PK led to transaction log full error and writes that Azure Database for MySQL – Server is not configured to allow ipv6 connections
- On TechNet, Mat Stephen, Data Solutions Architect, talks about Sharing Data with Azure
- On Code Project, Microsoft explains how to Build a .NET Core console app to manage data in Azure Cosmos DB SQL API account SDK Version 3 Preview, covers Azure Cosmos DB: SQL API getting started tutorial, and explains how to Build a Node.js console app with the JavaScript SDK to manage Azure Cosmos DB SQL API data and Build a .NET web app with Azure Cosmos DB using the SQL API and the Azure portal
- Also on Code Project, Anthony Chu discusses how to Broadcast Real-time Updates from Azure Cosmos DB with SignalR Service and Azure Functions
- Also on Code Project, Matas Quaranta presents Azure Cosmos DB + Functions Cookbook— static client
- Also on Code Project, Vivek Johari (@VivekJohari) describes Creating an Azure SQL Database
- Also on MSDN, Jose M Jurado (@jmjuradodiaz) highlights Managed Instance – Import via Sqlpackage.exe doesnt allow autogrow
- Also on MSDN, the AzureCAT team talks about data warehousing (Azure Data Architecture Guide)
- Also on the Azure blog, Swati Sachdeva announces that Azure Backup can automatically protect SQL databases in Azure VM through auto-protect
- On the Database Journal site, Greg Larsen delves into Customizing the Default Azure Data Studio Dashboards
🛠️ Developer Tools
- On Geeks with Blogs, Anirudha Gupta (@anirugu) discusses Making app in Blazor (Web Assembly) in Visual Studio
- Ravikanth Chaganti (@ravikanth) talks about Speaking at Experts Live India – Azure at the command line – Choosing the right tool
- On Code Project, Viano Piero explains How to obtain continous integration using Visual Studio with no cost.
- Scott Hanselman (@shanselman) describes Using Visual Studio Code to program Circuit Python with an AdaFruit NeoTrellis M4
- On MSDN, Julien Oudot writes about Why you should consider VS Code for your Kubernetes/Docker work
- Also on MSDN, Amanda Chew (@chewamanda) provides A New Year Ahead – the HockeyApp Cutover Experience
- Also on MSDN, Glenn Wester (@glennwester) provides A Year in Visual Studio App Center Test
- Also on MSDN, Robert Green writes about Visual Studio Toolbox: Building Bots (Part 2)
- Also on MSDN, the Visual Studio Blog explains how to Build Visual Studio extensions using Visual Studio extensions
- Also on MSDN, Xin Shi explains how to Continue using Hyper-V container for IoT Edge on Windows 10 1083
- Also on MSDN, Zakeel Muhammad says Cheers to New CodePush Features
- On Channel 9, Ross Heise and Eliot Cowley ask What makes a great extension for VSCode? and Can you use Git in VSCode?
- On Visual Studio Magazine, David Ramel (@dramel) writes about 2018: When VS Code Eclipsed Visual Studio IDE
- Also on Code Project, Jicking D. Bebiro (@jicking) covers how to Setup an ExpressJS 4 App using Visual Studio 2017
- On TechNet, David Branscome covers Setting Up a Kali Linux Machine in Azure
- Also on MSDN, Wriju Ghosh (@wrijugh) writes about Free Trainings for Azure Certifications AZ-*
- Gregor Suttie (@gregor_suttie) talks about Ambition and Drive to Learn Azure
- Also on TechNet, Mike Griswold (@GrizzlyCM) writes: New Year. New Plans
- Mark Heath (@mark_heath) writes about 2018 in Review
- On Channel 9, Dan Fernandez, Donovan Brown and Rob Caron talk about Azure Docs tips and tricks and Architecture and interactive APIs for .NET and REST APIs
- Also on TechNet, the Cloud Platform Team highlights the Cloud Platform Release Announcement for December 19, 2018
- On the Azure blog, Rob Caron (@RobCaronMSFT) presents Azure.Source - Volume 62 and Azure.Source Volume 63
- On MSDN, Mike Lapierre, David Lipien, Leonel Mora and Doug Owens say Resolve to be a "learn it all" with new Azure Certifications!
- Also on MSDN, Lee Stott (@lee_stott) walks through Providing Students access to centrally provided Azure Resources when they do not have Azure Subscription credentials
- Also on MSDN, Ed Price (@UserEd_) highlights a new E-Book: "Deploy Agisoft PhotoScan on Azure with Avere vFXT for Azure or BeeGFS"
- Also on the Azure blog, Christine Alford (@heyalford) highlights Azure Marketplace new offers
🔩 DevOps
- The Azure updates team announces: Azure DevTest Labs: CIS Windows Server 2016 Benchmark L2 available in your lab!
- On Channel 9, Aaron Bjork (@aaronbjork) talks about How the Azure DevOps teams plan
- On the Black Marble blog, Richard Fennell (@richardfennell) provides A task for documenting your Azure DevOps Pipeline extensions for YAML usage
- On MSDN, Stephane Eyskens (@stephaneeyskens) describes Enforcing security controls right from CI/CD pipeline with AzSK
- On TechNet, Kamlesh Kumar (@kkjha00007) lists the Top Contributors Awards! Azure DevOps: Survival Guide and many more!
- Abel Wang (@AbelSquidHead) discusses Microsoft AzureDevOps – Azure Pipelines, Azure Boards + GitHub
🎭 Identity
- On Code Project, Allen O'Neil (@ajsondev) gives an Overview of Azure Active Directory
- David O'Brien (@david_obrien) blogs about the flaws in Azure AD Logs in Log Analytics
- Daniel Krzyczkowski (@DKrzyczkowski) covers Microsoft Azure AD B2C – Custom Policies with Identity Experience Framework
- On TechNet, Goran Mihelčić gives a Step by step MIM PAM setup and evaluation Guide (Part 1)
🔌 Integration
- The Azure updates team announces that Azure Scheduler will retire on September 30, 2019 and that Azure Service Bus and Azure Event Hubs Virtual Networks and Firewall rules are now generally available
- Mark Heath (@mark_heath) walks through Migrating to the New Azure Service Bus SDK
- On Code Project, Roman Kiss describes the Azure Event Grid Tester
- On the Serverless360 blog, Sean Feldman (@sfeldman) describes Auto Forwarding, a hidden gem of Service Bus
- Also on the Serverless360 blog, Steef-Jan Wiggers (@SteefJan) discusses Azure Durable Functions – Patterns & Best Practices
- Also on the Serverless360 blog, Surya Venkatasubramanian discusses Building Intelligent Serverless Applications using Azure
💡 Internet of Things
- On MSDN, Microsoft Azure (@Azure) highlights The biggest IoT stories of 2018
- On Code Project, Sibeesh Passion (@SibeeshVenu) blogs about IoTHubTrigger Azure Function and Azure IoT Hub and Realtime Serverless IoT Data using Azure SignalR and Azure Functions in Angular
- On the Azure blog, Ed Nightingale discusses the Anatomy of a secured MCU
- On Channel 9, Remco Ploeg (@remcoploeg) shows a live demo of BeSense, an application built by Winvision on Azure Digital Twins
- The Azure updates team announces the Azure IoT Edge 1.0.5 release
- On Channel 9, Pericles Alves (@PericlesAlves) talks about how to Connect devices from other IoT clouds to Azure IoT Central
- Daniel Neumann (@neumanndaniel) discusses Stream Analytics on IoT Edge – deployment changes
- Also on MSDN, Richard Newell writes about Remote Monitoring of IoT Devices Using Azure and HoloLens
- On MSDN, Nathan Vanderby describes a SonarQube Hosted On Azure App Service
⚖️ Management and Governance
- On the Kloud blog, Asish Padhy (@asishpadhy) explains how to Retrieve Office 365 Audit logs using PowerShell and store in Azure table for quick retrieval
- On the MSSQL Tips site, John Martin (@SQLDiplomat) explains how to Install DBATools with Azure VM Custom Script Extension Azure Portal and John Miner explains how to Update an Azure SQL Data Mart with ADLS files
- Henry Been (@henry_been) describes how to Automatically fix or augment unwanted ARM template deployments
- On the Azure blog, Mark Cowlishaw announces Azure PowerShell Az Module version 1.0
- The Azure updates team blogs about Azure Monitor for Containers agent updates, announces that Azure Log Analytics is available in West US 2 and that Log Analytics solutions and views will soon drill in to the new Logs UX
- On MSDN, Lee Stott (@lee_stott) blogs about running a Data Science Virtual Machine with GPU for $0.18/Hour using Low Priority VMs
- On TechNet, Ed Price (@UserEd_) presents an Interview with a Wiki Ninja and Backup/Recovery Expert – Leon Laude
- Stanislav Zhelyazkov (@StanZhelyazkov) describes Finding Diagnostic Logs for Azure Services
- On the Microsoft Cloud IT Pro Podcast, Ben Stegink (@benstegink) and Scott Hoag (@ciphertxt) present Episode 105 – From AzureRm to Az in Azure PowerShell
- Stefan Roth (@stefanroth_net) describes the Azure Bot Service – MAX Automation and Monitoring Bot
- Sam Cogan (@samcogan) explains how to Do More With ARM Templates using Functions
- Also on the Kloud blog, Darren Robinson (@darrenjrobinson) covers Azure Self Service Password Reset Reporting using PowerShell
- The Azure updates team announces Azure API Management update from December 20th
🎬 Media
- The Azure updates team announces the Retirement of Media Hyperlapse in preview on March 29, 2019
⚙️ Microsoft Azure Stack
- On the MSSQL Tips site, Koen Verbeeck (@Ko_Ver) explains how to Connect to On-premises Data in Azure Data Factory with the Self-hosted Integration Runtime Part 2
- Thomas Maurer (@thomasmaurer) explains how to Extended Security Updates for SQL Server and Windows Server 2008 and 2008 R2 on Azure Stack
- On the Azure blog, Ricardo Mendes (@rlfmendes) explores The year in review: Hybrid applications for developers
- Thomas Maurer (@thomasmaurer) announces Extended Security Updates for SQL Server and Windows Server 2008 and 2008 R2 on Azure Stack
- On MSDN, Wriju Ghosh (@wrijugh) explains how to Start Free with Azure Stack Development Kit
- On the Azure blog, Rob Caron (@RobCaronMSFT) lists the Top 3 free resources developers need for learning Azure
🚌 Migration
- The Azure updates team announces Premium tier now available for the Azure Database Migration Service, Support for SQL to Azure SQL DB Managed Instance online migrations and discusses Migrating to the Az.ApiManagement PowerShell module
- Simon Waight (@simonwaight) explains how to Migrate a static website from AWS to Azure
- On the Azure blog, Madeleine Clayton describes How to migrate from AzureRM to Az in Azure PowerShell
- The Azure updates team announces that Azure Migrate is now available in Azure Government
- On MSDN, Raj Pochiraju announces General Availability of Azure Database Migration Service DMS Premium Tier
📱 Mobile
- On the Xamarin blog, James Montemagno (@JamesMontemagno) talks about Accessing Native Features the Cross-Platform Way with Xamarin.Essentials
- On Channel 9, Christos Matskas (@ChristosMatskas) showcases Visual Azure Provisioning From a Whiteboard The Xamarin Show
- Also on the Xamarin blog, Jayme Singleton (@JaymeSingleton1) highlights Xamarin and .NET Community Events in January
- On MSDN, Kazuki Ota explains how to Add AI feature to Xamarin.Forms app
- On Channel 9, James Montemagno (@JamesMontemagno) talks about Best Practices for User Interface Automation
🌐 Networking
- On the Azure blog, Ashish Chhabria (@ashishc1) announces Virtual Network Service Endpoints for serverless messaging and big data generally available
🔐 Security
- On TechNet, Yuri Diogenes (@yuridiogenes) presents: 2018: Azure Security Center Year in Review
- On the Azure blog, Alice Kupcik announces Transparent Data Encryption TDE with customer managed keys for Managed Instance
- Also on TechNet, Stanislav Belov covers Infrastructure + Security for December 2018
- On MSDN, The Mvp Award Program presents: Check out this weeks Friday Five on Dev Day Belgium, GDPR, and More
- On Code Project, Allen O'Neil (@ajsondev) talks about Policy management with Azure
- James van Den Berg discusses Managing and Working with Azure Network Security Groups NSG Security IaC AzureDevOps
📦 Storage
- Gregor Suttie (@gregor_suttie) discusses Azure Blobs from C# and Visual Studio
- On TechNet, Muhammad Raslan explains how to Publish Your Home Internet Connection IP Address Using Azure Blobs (Part 1)
- On Channel 9, Cale Teeter (@Windozer) talks about IPFS in Azure
- On MSDN, Arsen Vladimirskiy (@ArsenVlad) talks about Using Snowflake on Azure for Querying Azure Event Hubs Capture Avro Files
- Charbel Nemnom (@charbelnemnom) describes How To Mount And Persist An Azure File Share With Windows AzureFiles AzureFileSync
- On the Revolution Analytics blog, Hong Ooi blogs about AzureStor: an R package for working with Azure storage
- Sam Cogan (@samcogan) covers Updating Packer Builds to Use Managed Disks
- On the MSSQL Tips site, AUTHOR explains How To Schedule SQL Scripts On SQL Server Express Edition
🔗 Web
- On the Tech Radar site, Mike Williamsdesire Athow blogs about The best CDN providers of 2019 to speed up any website
- Shahed Chowdhuri (@shahedC) writes about Real-time ASP .NET Core Web Apps with SignalR
- On Code Project, Prabakaran Rajendran (@rajpraba_1986) explains how to Create, Build and Deploy ASP.NET Core MVC App to Azure App Services