Application performance management
In the fields of information technology and systems management, application performance management (APM) is the monitoring and management of performance and availability of software applications. APM strives to detect and diagnose complex application performance problems to maintain an expected level of service. APM is "the translation of IT metrics into business meaning ([i.e.] value)."
Measuring application performance
Two sets of performance metrics are closely monitored. The first set of performance metrics defines the performance experienced by end users of the application. One example of performance is average response times under peak load. The components of the set include load and response times.
- The load is the volume of transactions processed by the application, e.g., transactions per second (tps), requests per second, pages per second. Without being loaded by computer-based demands for searches, calculations, transmissions, etc., most applications are fast enough, which is why programmers may not catch performance problems during development.
The second set of performance metrics measures the computational resources used by the application for the load, indicating whether there is adequate capacity to support the load, as well as possible locations of a performance bottleneck. Measurement of these quantities establishes an empirical performance baseline for the application. The baseline can then be used to detect changes in performance. Changes in performance can be correlated with external events and subsequently used to predict future changes in application performance.
The use of APM is common for Web applications, which lends itself best to the more detailed monitoring techniques. In addition to measuring response time for a user, response times for components of a Web application can also be monitored to help pinpoint causes of delay. There also exist HTTP appliances that can decode transaction-specific response times at the Web server layer of the application.
In their APM Conceptual Framework, Gartner Research describes five dimensions of APM:
- End user experience monitoring – (active and passive)
- Application runtime architecture discovery and modeling
- User-defined transaction profiling (also called business transaction management)
- Application component monitoring
- Reporting & Application data analytics
Since the first half of 2013, APM has entered into a period of intense competition of technology and strategy with a multiplicity of vendors and viewpoints. This has caused an upheaval in the marketplace with vendors from unrelated backgrounds (including network monitoring, systems management, application instrumentation, and web performance monitoring) adopting messaging around APM. As a result, the term APM has become diluted and has evolved into a concept for managing application performance across many diverse computing platforms, rather than a single market.
Two challenges for implementing APM are (1) it can be difficult to instrument an application to monitor application performance, especially among components of an application, and (2) applications can be virtualized, which increases the variability of the measurements. To alleviate the first problem application service management (ASM) provides an application-centric approach, where business service performance visibility is a key objective. The second aspect present in distributed, virtual and cloud-based applications poses a unique challenge for application performance monitoring because most of the key system components are no longer hosted on a single machine. Each function is now likely to have been designed as an Internet service that runs on multiple virtualized systems. The applications themselves are very likely to be moving from one system to another to meet service-level objectives and deal with momentary outages.
The APM conceptual framework
Applications themselves are becoming increasingly difficult to manage as they move toward highly distributed, multi-tier, multi-element constructs that in many cases rely on application development frameworks such as .NET or Java. The APM Conceptual Framework was designed to help prioritize an approach on what to focus on first for a quick implementation and overall understanding of the five-dimensional APM model. The framework slide outlines three areas of focus for each dimension and describes their potential benefits. These areas are referenced as "Primary" below, with the lower priority dimensions referenced as "Secondary. "
End user experience – (primary)
Measuring the transit of traffic from user request to data and back again is part of capturing the end-user-experience (EUE). The outcome of this measuring is referred to as Real-time Application monitoring (aka Top Down monitoring), which has two components, passive and active. Passive monitoring is usually an agentless appliance implemented using network port mirroring. A key feature to consider in this solution is the ability to support multiple protocol analytics (e.g., XML, SQL, PHP) since most companies have more than just web-based applications to support. Active monitoring, on the other hand, consists of synthetic probes and web robots predefined to report system availability and business transactions. Active monitoring is a good complement to passive monitoring; together, these two components help provide visibility into application health during off peak hours when transaction volume is low.
Runtime application architecture (secondary)
Application Discovery and Dependency Mapping (ADDM) solutions exist to automate the process of mapping transactions and applications to underlying infrastructure components. When preparing to implement a runtime application architecture, it is necessary to ensure that up/down monitoring is in place for all nodes and servers within the environment (aka, bottom-up monitoring). This helps lay the foundation for event correlation and provides the basis for a general understanding on how network topologies interact with application architectures.
Business transaction (primary)
Focus on user-defined transactions or the URL page definitions that have some meaning to the business community. For example, if there are 200 to 300 unique page definitions for a given application, group them together into 8-12 high-level categories. This allows for meaningful SLA reports, and provides trending information on application performance from a business perspective: start with broad categories and refine them over time. For a deeper understanding, see Business transaction management.
Deep Dive Component Monitoring (secondary)
Deep Dive Component Monitoring (DDCM) requires an agent install and is generally targeted in the middleware space focusing on the web, application, and messaging servers. It should provide a real-time view of the J2EE and .NET stacks, tying them back to the user-defined business transactions. A robust solution shows a clear path from a code execution standpoint (e.g., Spring, Struts, etc.) to the URL rendered and finally to the user request. Since DDCM is closely related to the second dimension in the APM model, most products in this space also provide application discovery dependency mapping (ADDM) as part of their broader solution.
It is important to arrive at a common set of metrics to collect and report on for each application, then standardize on a common view on how to present the application performance data. Collecting raw data from the other tool sets across the APM model provides flexibility in application reporting. This allows for answering a wide variety of performance questions as they arise, despite the different platforms each application may be running on. Too much information is overwhelming. That is why it is important to keep reports simple or they won’t be used.
- Application Response Measurement
- Application service management
- Business transaction performance
- List of performance analysis tools
- Network management
- Website monitoring
- User Experience Rating
- IBM Application Performance Management
- "The Anatomy of APM". APM Digest. 4 April 2012.
- Dubie, Denise. "Performance management from the client's point of view". NetworkWorld. Retrieved 22 March 2013.
- "APM and MoM -Symbiotic Solution Sets". APM Digest. 11 May 2012.
- "What You Should Know About APM – Part 1". Realtime NEXUS. 2013.
- "Keep the Five Functional Dimensions of APM Distinct". Gartner Research (ID Number=G00206101). 16 September 2010.
- "Analytics vs. APM". APM Digest. 28 January 2013.
- "A Comparison of Application Performance Management Suites from CA, HP and Oracle" (PDF). Crimson consulting group. Retrieved 22 March 2013.
- "Magic Quadrant for Application Performance Monitoring". Gartner. Retrieved 18 December 2013.
- "APM Convergence: Monitoring vs. Management". APM Digest. 6 March 2013.
- "Application Performance Management Spectrum" (PDF). TRAC Research. 11 March 2013.
- Khanna, Gunjan; Beaty, Kirk A.; Kar, Gautam; Kochut, Andrzej (2006). "Application Performance Management in Virtualized Server Environment". Network Operations and Management Symposium, 2006. NOMS 2006. 10th IEEE/IFIP: 373–381. doi:10.1109/NOMS.2006.1687567. Retrieved 22 March 2013.
- Matchett, Mike. "Is Virtualization Stalled On Performance?". Virtualization Review. Retrieved 22 March 2013.
- "Differences between approaches to APM - a chat with Jesse Rothstein of Extrahop". ZDNet. 9 December 2011.
- "The Five Essential Elements of Application Performance Monitoring". Realtime NEXUS. 2010.
- "Priorizing Gartner's APM Model: The APM Conceptual Framework". APM Digest. 15 March 2012.
- "Application performance monitoring tools: Three vendor strategies". SearchNetworking. 25 March 2013.
- "Insight from the User Experience Management Panel in Boston". APM Digest. 23 March 2012.
- "Research and Markets: Radar for Application Discovery and Dependency Mapping (ADDM)". Business Wire. 19 May 2011.
- "Big Data and Advanced Analytics: Success Stories From the Front Lines". Forbes. 3 December 2012.