We have a need to bulk update some HTTP check parameters. I thought this might be a good opportunity to dig into the Monitoring API and maybe write an Ansible module for managing HTTP checks. I ran into problems when I found that, while I could create and delete HTTP checks, the API provided no method of updating existing checks.21 votes
This makes sense. fundamentally we need to provide a comprehensive way to update a checks settings via the API. A v1.0 of this could be to just allow updating check settings, but not say RBC steps (since bulk updating selenium steps could be challenging). Reaching out to reporters with some clarifying questions.
Our company uses splunk to log the inner workings of our services. I would love to be able to formulate a splunk query by crafting the url from output coming from a failed test and then display it below the failure explanation to quickly transport from rigor to splunk (or any query service that the user specifies for that matter). Just being able to parse the time window, an index, and some piece of data could go a long way in simplifying the debugging process.4 votes
this could be an interesting integration for us
1. When the test succeeds, allow the user to look at the request, response, etc. for every step the test executed.
2. When the test fails, in addition to giving the details of the failing step, the user should be able to view the request, response, etc. for any other step in that test.
This idea is important to me, because I want to compare successful tests with failed tests. Additionally, if a step fails it is sometimes useful to be able to see what happened in the steps leading up to it.1 vote
We are looking at how to offer this. Currently we don’t store the results of successful runs due to the volume of data
We would like to have the ability to show the response times per step in a multi step API script. Some steps are necessary but may take longer than others.6 votes
This makes total sense. It also adds consistency with our RBC check, which can report metrics about each page visited when running a check that loads multiple URLs
When viewing the check results there is an option to filter based on location and date. The filter only applies to the graph not to the individual run results and alert listings. Pleasse apply the filters on everything on the page.3 votes
This makes sense. We are currently reviewing how our system sets and remembers time ranges when looking at check histories. This is an natural extension
For reporting and daily dashboarding it would be usefull to filter on result status. Currently the low en high results are based on succesfull and onsuccesfull results. There is no way to see the performance of the succesfull runs.1 vote
I believe this is asking for the ability to only show successful runs in the check performance history graph. Emailing Arie for clarification.
We use Rigor to check our customer SLA adherance.
For most of our customers have several checks running and at the end of each month we have to do a bunch of math to calculate our SLA for that customer. It would be great if you
1) exposed the data in the report of how many runs and fails
2) provided a totals line which allows us to
This is pretty close but does not have the totals at the bottom for each month
Makes sense. We have various ways to display this currently in the app UI, reports, and in summary emails. Reaching out to Alex to ask a few clarifying questions about exactly what he is looking for.
We have a non interactive dashboard on large monitors in the office. It would be great if i could order the results. At he moment uptime checks come at the top and i would want them below the real browser checks1 vote
Interesting idea. Reviewing how to do it.
A work around would be to do 2 API requests, one for RBC checks, and one for Uptime checks, and display them in whatever order you want.
Please add an option to turn on collecting a screen print for all runs including successful runs. This would be helpful for us to compare ads that display on failed runs versus passed runs.3 votes
Sounds like Kathy is just asking for screen shots for successful runs as well as failed runs. Emailing to clarify
To collect speedindex, we have to take a bunch of screen shots, even on successful runs, so we could expose those to the user even for successful runs.
In a lot of scripts we need to use a date to be able to make a transaction unique. Due to leap years et cetera it would be nice to easily create a date with format and the option to add a number of days, moths or years1 vote
Not entirely clear on the ask. Sounds like a current date/time variable could solve this issue. Emailing Arie for clarification.
It would be nice to be able to get a report of all requests on the page that contributed to slow page load. This way we can see if there are ad partners/networks that are repeat offenders and doesn't require someone to have to manually go through each failed waterfall.1 vote
Good idea! We should do a better job surfacing obvious or slow URLs/Domains when a check fails, and potentially across multiple runs/checks
The rigor test we have is simulating a user session. currently the rigor script sends requests back to back with 1/4 second in between. we need there to be one or two seconds in between though.2 votes
I can see how this is valuable. You want the rate at which Rigor runs a check to more accurately reflect how a user would use the app
The third party host summary has number of requests on y-axis and total size on x-axis. And the size of circle also represents the Total size. So total size is represented twice in that graph. Instead, have a filter to change the x-axis to either - average time to connect, avg time to download content, avg time dns lookup. That way one can keep track of 3rd party domains1 vote
This is an excellent idea. Right now, Optimization just focuses on analysis, but I can see pulling this data from the HAR, or including this chart in Monitoring
Hey Ryan, thanks for the suggestion.
We have are currently planning to switch the Benchmark check over to using our RBC platform under the covers to perform the tests. This makes many more metrics available to Benchmark check, include DomContentLoad, Fully Loaded, as well as future things we add to RBC, such as SpeedIndex.
In the old (deprecated) api if you got a list of all checks like this
It would detail the url that was being checked in the returned data as a url: entry
In the v2 of the api using https://monitoring-api.rigor.com/v2/checks?type=uptime
the url: entry is no longer visible which makes it very hard to pull data out for internal statistical analysis.
Thanks for the idea. This makes a lot of sense, and we are reviewing how we can improve our API
Rather than repeatedly poll the snapshots endpoint to determine when snapshots' statuses have changed, it would be great if we could provide a URL that would receive a POST request when the status, etc. change. (similar to how GitHub provides webhooks - https://developer.github.com/webhooks/)28 votes
Makes total sense. Optimization should better support webhooks
Add SSO auth for larger organizations to effectively use read only reports across their delivery process with multiple stakeholders.27 votes
Thanks for the idea. Adding a support for external authentication provides, such as various SSO systems or even “Login with Google Apps” is something we are reviewing
In addition, the ability to export page performance report data as a CSV or the option to include page level data in custom reports would allow better use of real browser checks (no need to create one for each step of a funnel to export and share with the team).1 vote
We are right now in the middle of reworking our data storage and aggregation system for RBC and Page Performance Report. When finished (Should be very soon), we will be providing the mean, median, max, and min for all the stats available for all the Page Performance report metrics (including some new ones like Fully Loaded)
Besides load time it would be really helpful to see render time and server time. Load time can be misleading because we have a significant number of marketing tags that load in the background, so could be misleading.1 vote
Totally agree Raymond. And as we add additional metrics to RBC, such as SpeedIndex, those make sense as well. Starting to collect use cases for improved Status pages UI.
Just so you know, we currently do this because the status page can show any type of check, and render time is something that is RBC specific. We only some the metrics that all checks have, even if you have only selected RBC checks. This should be improved. Moving to under review.
Currently the test now button is sending the test to the north carolina test location. Because tests can differ on the location where they are tested from it would be handy if the default test location could be changed to make sure the test result is equal to the one when running from the proper location.
Latency and location my influence testing results.1 vote
We are reviewing how we can make test check more accurate and valuable (such as also allowing your to test notifications)
- Don't see your idea?