420 likes | 608 Views
Monitor your infrastructure and analyze operational logs at scale with Azure Monitor. Ketan Ghelani - Principal GPM Keiko Harada – Senior Program Manager. BRK 3354. Azure Monitor. Full observability for your infra, app and network. Metrics. Common Store. Data Driven Insights.
E N D
Monitor your infrastructure and analyze operational logs at scale with Azure Monitor Ketan Ghelani - Principal GPM Keiko Harada – Senior Program Manager BRK 3354
Azure Monitor Full observability for your infra, app and network Metrics Common Store Data Driven Insights Workflow Integrations Unified Monitoring Logs A common platform for all metrics, logs and other monitoring telemetry Advanced diagnostics and analytics powered by machine learning capabilities Rich ecosystem of popular DevOps, issue management, SIEM, and ITSM tools
Azure Monitor Unified Monitoring Application Containers VM Monitoring Solutions Insights Application Visualize Dashboards Views Power BI Workbooks Metrics Operating System Azure Resources Analyze Metrics Explorer Log Analytics Logs Azure Subscription Custom Sources Azure Tenant Respond Alerts Autoscale Integrate Event Hubs Logic Apps Ingest & Export APIs
Hard to… Challenges in VM Monitoring Determine whether how back-end dependencies are affecting clients “The scenario I am imagining is in an Ops room, with a large screen, where we can see at a glance on multiple graphs how all VM's are performing in terms of CPU, Mem, Disk, Network etc.?” “We had a process that was putting everything at a standstill – we had high latency due to a poorly scheduled process that was taking up bandwidth. Show me all the processes running on the servers, and show how much they're trying to transmit.” Determine health and availability of Azure VMs across Resource Groups Troubleshoot how guest-level resource constrains impacts workloads/apps Identify VM hotspots at scale based on resource utilization “It’s too difficult to wire together all the diagnostics for memory. I can always RDP into boxes, but I want to see it automatically.” Disambiguate the issues in the VM, caused due to its usage or Azure itself Figure out what and how to Monitor “I need to know how VMs from my customers communicate.”
Health Diagnostics Azure Monitor for VMs KB articles on common causes and resolution Pre-defined health monitors to jump-start VM monitoring Near real-time monitoring of core VM components (CPU, Memory,..) Customizable alerting thresholds on health monitors Health diagnostics, that helps to localize the issue fast
Performance Azure Monitor for VMs Drill through performance diagnostics for root cause analysis Aggregation of VM metrics across thousands of VMs Drill through to advanced analytics on VM logs Built in views for key performance indicators Top N performance views identify resource constrained VMs @ scale
Maps Azure Monitor for VMs Live connection metrics between processes and VMs identifying spikes in network traffic Visualize VMs and process interaction for resource groups, VM scale sets and subscriptions Drill through dependent VMs to Alerts and Logs Identify surprise dependencies and connection failures
On boarding Azure Monitor for VMs Remediation policy to on board VMs falling out of compliance Built-in monitoring policy to on board Azure VMs @ scale Policy supports existing VMs and new VMs created
Just got better Azure Monitor Alerts Unified Alert lifecycle Management One Alert Mgmt experience Smart grouping to reduce noise Dynamic threshold base Alerting Configure Alerts at Scale Multi-resource alerting
Demo Azure Monitor for VMs
Common Container Monitoring Pain points… Is my cluster healthy? “I am having an issue with my application but cannot find any issues?“ “many tools have nice graphs but does not help where to go to troubleshoot next” “I want to dig within the cluster but have filter to focus on my workloads.” Drill down experience with filters Troubleshooting Guidance “if I am using Azure, can Microsoft provide monitoring tools for me?” Native Monitoring Experience Lower Maintenance Cost “I don’t want my devs to touch kubectl commands. It is another tool with additional learning.” Usability and Control “I know OSS monitoring products, but I want to focus on my products rather maintaining monitoring tools.”
Enhancements Azure Monitor for Containers Public Preview in May //build 2018 Cross subscription multi-cluster health roll up view NEW! Integrated in Azure DevOps Project Monitor containers on demand for AKS with virtual nodes NEW! Analyze Kubernetes event & container logs for troubleshooting View overall health and perf across nodes, controllers and containers Drill down monitoring experience with namespace, service, and node filters NEW!
Norwegian utility automates meter reading, improves customer service, and saves time and labor As the power grid operator that serves 1.5 million Norwegians, Hafslund always looks for ways to optimize operations. For example, the company is replacing manual methods of reading customers’ electric meters with networked smart-metering. Hafslund chose Microsoft Azure as its cloud platform and Azure Kubernetes Service (AKS) to manage the company’s containerized software. Now, metering is faster and more accurate, billing is simpler, and collected data provides actionable insights into energy consumption patterns. Norway Power and utilities Microsoft Azure Azure Kubernetes Service (AKS) Azure Monitor for containers Approx. 500 employees
Log Analytics Azure Monitor Logs Run analytics queries for investigations, statistics, and root cause + trend analysis Training: http://aka.ms/kqlpluralsight Log Analytics advanced query experience now in Azure Portal Utilize ML algorithms for clustering and anomaly detection RBAC per type
Recap Azure Monitor for VMs Azure Monitor for Containers Azure Monitor Logs Monitor VMs @ Scale Identify & isolate host-level or guest-level health problems Visualize service dependencies & connection failures in Maps On board VMs at Scale using PowerShell and/or Azure Policy Monitor multi-cluster health & node/pod status Monitor containers on demand in AKS with virtual nodes Drill through Kube events On board monitoring using azaks cli commands Log Analytics advanced query experience now in Azure Portal Utilize ML algorithms for clustering and anomaly detection RBAC per type http://aka.ms/kqlpluralsight
Azure Monitor Roadmap • Rich insights for Azure Storage, SQL & Service Fabric Mesh • RBAC per data type in Log Analytics • Support for containers on demand for AKS with virtual nodes • Support live logs for containers and Kubernetes events • Smart detections and alerts with Dynamic Thresholds • Expanded Azure support and interoperability for Distributed Tracing • Exception tracking and custom metrics for Python and Go apps • Auto enablement of app monitoring for App Services / Windows VMs (with WAD) • Expanded region availability across public & sovereign clouds • Latency improvements for Alerts, Logs & Metrics
Resources & related sessions Azure Monitor Documentation – https://aka.ms/MonitoringDocs Azure Monitor for VMs – http://aka.ms/vminsightsdocs Resources, Tutorials & What’s New – https://aka.ms/AzMonOverview Query Language Course on Pluralsight – https://aka.ms/KQLPluralsight Breakout sessions BRK3346 Build the right solution for your business by Continuous DevOps Monitoring and Learning BRK3349 Everything about Azure Monitor telemetry and building integration with ITSM/SIEM tools BRK3354 Monitor your infrastructure and analyze operational logs at scale with Azure Monitor BRK3298 Monitoring your networks in Azure Theater Sessions Get insights from all your virtual machines with Azure Monitor Smart Alert Management with Machine Learning from Azure Monitor Technology Workshop End to end, full stack monitoring with Azure Monitor Meet us at our Expo booth #177 - Azure Monitor
Please evaluate this sessionYour feedback is important to us! Please evaluate this session through MyEvaluations on the mobile appor website. Download the app:https://aka.ms/ignite.mobileApp Go to the website: https://myignite.techcommunity.microsoft.com/evaluations