Hey Ryan, thanks for the suggestion.
We have are currently planning to switch the Benchmark check over to using our RBC platform under the covers to perform the tests. This makes many more metrics available to Benchmark check, include DomContentLoad, Fully Loaded, as well as future things we add to RBC, such as SpeedIndex.
Currently we are able to define steps. For Single Page Apps, there is only 1 "pageload" everything else is IFrames and XHR/Ajax. We need a way to measure performance of later steps, possibly via the W3C user timings API57 votes
Step 1 is adding support for custom user timings, since a selenium scripts walking through a flow on a SPA doesn’t generate multiple HARs it generates 1 HAR.
We recently upgrade our version of FireFox used by RBC, allowing us to leverage the custom user timings API to collect metrics and then report/graph/alert on them. We are planning our SPA/custom user timings project now
Include DOM Load Time inside custom reports: I would like to be able to see the DOM Load Time/Render Time as an option during the creation of a custom_report. The goal here is to see dom load time/render time instead of load/response time.22 votes
This is a great idea Chris and I 100% agree. Right now, custom reports offer only the measurements that all checks offer, so all those great stats with collect in RBC aren’t available. We are fixing that. First step is we are about to introduce a bunch of additional RBC metrics we collect. Then we are revamping Custom Reports so that RBC checks can include more metrics, like DomContentLoaded, etc
We currently have our RBC's setup to Notify through a Webhook (HipChat). It would be great if we could setup a second Webhook in Escalations. This way we'd could configure all escalations via OpsGenie.1 vote
Totally agree. We are reviewing use cases to define the success criteria for a complete rework of the notification system. One of those being allowing the to both notify and escalate to different webhooks
Create a relay agent so internal enterprise sites can be tested.8 votes
It's great that we can export this, but let's make it available via the API as well.0 votes
Exposing the HAR via an API is how the Rigor Monitoring → Rigor Optimization integration works. We can work to make this public for our users
Right now Rigor captures screenshots of page failures and they're great for troubleshooting. It would be an added bonus if we also captured video of successful tests and failed tests so that users can compare visual render time of specific elements.3 votes
100% agree. If WebPageTest can do it, which should be capable of doing it as well!
To calculate SpeedIndex (another thing we are doing), we need to take lots of screenshots anyway. So stitching them together into a video makes total sense and would be a great eye candy feature
Moving to Planned
We should include a User Agent string configuration option for Benchmark checks so that users can easily run Benchmark checks on mobile sites.14 votes
100% agree. We have big plans for the Benchmark checks, and the first step is to allow both User-Agent and ViewPort settings when configuring
- Don't see your idea?