The Functional Difference Between Synthetic and Real User Monitoring
By Aaron Rudger | February 27, 2015
If your business depends on the performance of your website and/or apps, you should consider ordering monitoring services right now. There are two primary types—real user monitoring (aka RUM) and synthetic monitoring, and it is important to learn their intrinsic differences before making a decision. Both of them have pros and cons, but most experts suggest that businesses opt for a customized solution that incorporates a combination of both since they complement one another. Together, they will show you exactly how long your pages are taking to load for real users while providing the detailed analysis required to diagnose and improve performance. Both of these monitoring types can be utilized for web, mobile, and tablet browsers.
Synthetic monitoring is more predictable than real user monitoring because the script executes a known set of steps at intervals from a known location. It is better for setting alerts and for assessing site availability and network problems, especially if it utilizes integrated network insight. With full client control, synthetic monitoring yields amazingly detailed waterfall charts, resource-by-resource performance, and screenshots/videos of page loads in action.
- Consistent and stable baseline
- Sensitive to small changes in performance
- Nothing to install
- Tests site availability even when usage is low or non-existant
- Ability to measure and compare any website
- Provides detailed assets analysis
- Records the user experience via screenshot and (sometimes) video
- Performance waterfall charts
- Limited sample size and page reach
- Limited geographic coverage
- Difficult to maintain for fast-changing sites
Real User Monitoring
- How many customers may be impacted by outages and performance issues detected by active “clean room” measurements?
- What issues are impacting user behavior including conversion, abandonment, and engagement?
- How is the entirety of my site performing beyond the home page and a few other transaction pages?
- Large sample size
- Real network and browser conditions
- Limitless geography
- Conversion and KPI correlation with performance metrics
- Limited performance metrics
- Limited ability to provide detailed assets analysis
- Requires significant site usage to yield reliable results
Keynote’s integrated active and real user monitoring capabilities give you a complete and actionable solution for identifying issues and opportunities. Contact Keynote today to see how a customized solution can help you understand and improve user experience—after all, your customers are your greatest asset and deserve the best monitoring solution.