Rigor Product Suggestions

I suggest you improve Rigor by...

You've used all your votes and won't be able to post a new idea, but you can still search and comment on existing ideas.

There are two ways to get more votes:

  • When an admin closes an idea you've voted on, you'll get your votes back from that idea.
  • You can remove your votes from an open idea you support.
  • To see ideas you have already voted on, select the "My feedback" filter and select "My open ideas".
(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  1. RBC: Fully support SPA and ajax enabled sites to monitor and report based on steps

    Currently we are able to define steps. For Single Page Apps, there is only 1 "pageload" everything else is IFrames and XHR/Ajax. We need a way to measure performance of later steps, possibly via the W3C user timings API

    53 votes
    Vote
    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      I agree to the terms of service
      Signed in as (Sign out)
      You have left! (?) (thinking…)

      Step 1 is adding support for custom user timings, since a selenium scripts walking through a flow on a SPA doesn’t generate multiple HARs it generates 1 HAR.

      We recently upgrade our version of FireFox used by RBC, allowing us to leverage the custom user timings API to collect metrics and then report/graph/alert on them. We are planning our SPA/custom user timings project now

    • Grouping and Folders for Uptime and Real Browser checks

      Having to monitor multiple sites and growing under Uptime and Browser Checks we would like to be able to create folders/groups to move the checks into without having to use tags. This would clean the UI for users have multiple sites so that the information we need is where we need it. We have been managing this with naming convention but when growing to 100+ checks this will become a monster to view.

      52 votes
      Vote
      Sign in
      Check!
      (thinking…)
      Reset
      or sign in with
      • facebook
      • google
        Password icon
        I agree to the terms of service
        Signed in as (Sign out)
        You have left! (?) (thinking…)

        Makes total sense. We are reviewing our UI to see how to better organize things so that customers with large numbers of checks can help navigate and review things

      • I would like to have a rerun option for failed step in RBC check

        While developing test case in RBC and when any test step fails during run due to logic fail or improper element passed, we should have an option to run from failed step. This option save our time and helps us to verify the fix quickly

        24 votes
        Vote
        Sign in
        Check!
        (thinking…)
        Reset
        or sign in with
        • facebook
        • google
          Password icon
          I agree to the terms of service
          Signed in as (Sign out)
          You have left! (?) (thinking…)
        • Custom Reports: Include render time as a reporting option

          Include DOM Load Time inside custom reports: I would like to be able to see the DOM Load Time/Render Time as an option during the creation of a custom_report. The goal here is to see dom load time/render time instead of load/response time.

          22 votes
          Vote
          Sign in
          Check!
          (thinking…)
          Reset
          or sign in with
          • facebook
          • google
            Password icon
            I agree to the terms of service
            Signed in as (Sign out)
            You have left! (?) (thinking…)

            This is a great idea Chris and I 100% agree. Right now, custom reports offer only the measurements that all checks offer, so all those great stats with collect in RBC aren’t available. We are fixing that. First step is we are about to introduce a bunch of additional RBC metrics we collect. Then we are revamping Custom Reports so that RBC checks can include more metrics, like DomContentLoaded, etc

          • API: Support updating HTTP check settings via the Monitoring API

            We have a need to bulk update some HTTP check parameters. I thought this might be a good opportunity to dig into the Monitoring API and maybe write an Ansible module for managing HTTP checks. I ran into problems when I found that, while I could create and delete HTTP checks, the API provided no method of updating existing checks.

            18 votes
            Vote
            Sign in
            Check!
            (thinking…)
            Reset
            or sign in with
            • facebook
            • google
              Password icon
              I agree to the terms of service
              Signed in as (Sign out)
              You have left! (?) (thinking…)

              This makes sense. fundamentally we need to provide a comprehensive way to update a checks settings via the API. A v1.0 of this could be to just allow updating check settings, but not say RBC steps (since bulk updating selenium steps could be challenging). Reaching out to reporters with some clarifying questions.

            • RBC: Simulate handheld devices and networks for mobile testing

              Mobile devices have two major potential bottlenecks that desktop browsers do not have: limited hardware resources to execute JS, render images, etc; and a slower network. Particularly when implementing a responsive site, it's important to know how these limitations are affecting mobile users, given that the payload for responsive sites will often (and maybe mistakenly) be similar for mobile and desktop sites, but performance could vary widely between the two. To account for this, it would be helpful for mobile tests to be run by simulated mobile devices using either/both throttled hardware and a throttled network to more closely simulate…

              8 votes
              Vote
              Sign in
              Check!
              (thinking…)
              Reset
              or sign in with
              • facebook
              • google
                Password icon
                I agree to the terms of service
                Signed in as (Sign out)
                You have left! (?) (thinking…)

                Great idea! Simulating device constraints like CPU/RAM via throttling could be challenging, but network throttling is a clear and easy first step. Reviewing this now

              • Content Check: Filter Content Check links by 'results', and bulk ignore

                The 'ignore' option on our Content Check is awesome. It would be great if we could also filter the table by 'results' > select all with similar results > and ignore en masse.

                8 votes
                Vote
                Sign in
                Check!
                (thinking…)
                Reset
                or sign in with
                • facebook
                • google
                  Password icon
                  I agree to the terms of service
                  Signed in as (Sign out)
                  You have left! (?) (thinking…)

                  Totally agree. Basically you want a way to select multiple checks in the table and then mark all of them as ignore, similar to the in-table-bulk-operations that Rigor Optimization provides.

                  There is a larger need to move bulk actions like this out of Monitoring “Bulk Edit” page and into individual tables, but this could be a good place to start

                • Provide Graphs in Emails

                  Provide a graphical representation of performance trending in emails, similar to what is displayed in the monitoring dashboard.

                  7 votes
                  Vote
                  Sign in
                  Check!
                  (thinking…)
                  Reset
                  or sign in with
                  • facebook
                  • google
                    Password icon
                    I agree to the terms of service
                    Signed in as (Sign out)
                    You have left! (?) (thinking…)
                  • Option to Delete multiple steps in RBC Test case

                    If I want to copy my RBC test case and create a new test case with customized steps, after creating the copy, I should have the option of selecting unwanted steps and deleting those steps. At present I need to delete one by one.

                    7 votes
                    Vote
                    Sign in
                    Check!
                    (thinking…)
                    Reset
                    or sign in with
                    • facebook
                    • google
                      Password icon
                      I agree to the terms of service
                      Signed in as (Sign out)
                      You have left! (?) (thinking…)
                    • Notifications: Send emails on 1 failure *and* then emails + SMS on 2 failures

                      Hi Rigor, I noticed that we cannot set up alerts for a test so that if it failed once it immediately emailed the group, but then if it failed twice it would text and email the group. It seems like you can only do one or the other. There are times we want to know about 'noise', but just not by text. however, if that 'noise' continues, then please text. We use the email alerts for review more then logging into Rigor to look and see if any noise occurred. Hopefully others find this useful as well.

                      5 votes
                      Vote
                      Sign in
                      Check!
                      (thinking…)
                      Reset
                      or sign in with
                      • facebook
                      • google
                        Password icon
                        I agree to the terms of service
                        Signed in as (Sign out)
                        You have left! (?) (thinking…)

                        Totally agree. Our notification system needs to be more flexible in allowing multiple different levels of alerting based on the conditions.

                        We are currently gathering use cases for a complete revamp of the notification system. This is a great one to include. Thanks for the suggestion Scott!

                      • RBC: Add option to upload images with actions

                        It would be nice to be able to upload images or files via Real Browser Checks. This could be useful for sites that require applications or images to upload as part of an application.

                        4 votes
                        Vote
                        Sign in
                        Check!
                        (thinking…)
                        Reset
                        or sign in with
                        • facebook
                        • google
                          Password icon
                          I agree to the terms of service
                          Signed in as (Sign out)
                          You have left! (?) (thinking…)
                        • UI: Add numbering column to Check Tables landing

                          Since the system/contracts are based on # of allowed checks, add a count column on the landing page. Otherwise you have to manually count them. Example: http://prntscr.com/8p76bs

                          4 votes
                          Vote
                          Sign in
                          Check!
                          (thinking…)
                          Reset
                          or sign in with
                          • facebook
                          • google
                            Password icon
                            I agree to the terms of service
                            Signed in as (Sign out)
                            You have left! (?) (thinking…)
                          • When a node is unavailable do not send failure response

                            When a node goes down for maintenance or other reasons the response it sends when trying to make either a uptime or real browser check should not be a failure. Currently this will trigger false positives where the node is down yet the service or page it is monitoring is actually indeed working.

                            3 votes
                            Vote
                            Sign in
                            Check!
                            (thinking…)
                            Reset
                            or sign in with
                            • facebook
                            • google
                              Password icon
                              I agree to the terms of service
                              Signed in as (Sign out)
                              You have left! (?) (thinking…)
                            • ICMP Ping

                              A simple (ICMP) ping would be nice for monitoring devices that don't have a web-frontend.

                              3 votes
                              Vote
                              Sign in
                              Check!
                              (thinking…)
                              Reset
                              or sign in with
                              • facebook
                              • google
                                Password icon
                                I agree to the terms of service
                                Signed in as (Sign out)
                                You have left! (?) (thinking…)
                              • Email Reports: Include percentage change

                                It's great that we include green arrows or red arrows in email reports to indicate change in performance. It would be even better if we also included the percentage change, so it would be easier to see if there was a big difference from previous days.

                                3 votes
                                Vote
                                Sign in
                                Check!
                                (thinking…)
                                Reset
                                or sign in with
                                • facebook
                                • google
                                  Password icon
                                  I agree to the terms of service
                                  Signed in as (Sign out)
                                  You have left! (?) (thinking…)
                                • Set Custom color legend thresholds on Dashboards

                                  In trying to set up an Executive Dashboard, the default thresholds for how the coloring (Green, Yellow, Red) is applied to the dashboard are looser than the thresholds our executives would like to see.

                                  Example: The executive dashboards default to showing any avg uptime of 98-100% as green, 90-97% as yellow, and <90% as red. But because our sites need to be highly available, we'd rather have those thresholds be 99.9-100% green, 99.5-99.9% yellow, and <99.5% red. Similarly we'd like to be able to set thresholds for Response times.

                                  3 votes
                                  Vote
                                  Sign in
                                  Check!
                                  (thinking…)
                                  Reset
                                  or sign in with
                                  • facebook
                                  • google
                                    Password icon
                                    I agree to the terms of service
                                    Signed in as (Sign out)
                                    You have left! (?) (thinking…)
                                  • Notifications: Notify on specific error to a separate contact

                                    At the moment, we set up an alert and a single contact (be it a group or email address). It would be great if we were able to add multiple notification entries and apply the alert thresholds to each entry. So for example if the entire test fails it would go to the NOC, if a specific error occurs like a 4XX then go to a particular email address like a developer for example. We shouldn't have to create multiple tests for this.

                                    3 votes
                                    Vote
                                    Sign in
                                    Check!
                                    (thinking…)
                                    Reset
                                    or sign in with
                                    • facebook
                                    • google
                                      Password icon
                                      I agree to the terms of service
                                      Signed in as (Sign out)
                                      You have left! (?) (thinking…)

                                      Thanks for writing in William. I totally agree. We should allow specific notification settings to tie to 1 or more threshold monitors.

                                      We are currently defining use cases for a completely revamped notification system. This seems like a logical one to include. Moving to under review while we plan.

                                    • Reports: Add option to see tag reports over time frames < or = 24 hours

                                      Current tag reports are based on daily rollups. It would be nice if users could easily see individual runs within smaller time frames on the tag report or have the option to create on the fly performance history reports based on tags.

                                      3 votes
                                      Vote
                                      Sign in
                                      Check!
                                      (thinking…)
                                      Reset
                                      or sign in with
                                      • facebook
                                      • google
                                        Password icon
                                        I agree to the terms of service
                                        Signed in as (Sign out)
                                        You have left! (?) (thinking…)

                                        I know inside the app, we should run-level metrics for a tag set under the “Dashboards”. Makes sense to apply this out to reports as well. Reaching out to Melanie to get some clarifying details.

                                      • Conditional alerting

                                        The notification conditions could be broadened to include notify after x failures within y time units.

                                        It would also be useful to have an option at the end of the test to send an alert or not based on the content of the json response. Some of our alerts are time sensitive, some can be dealt with later.

                                        3 votes
                                        Vote
                                        Sign in
                                        Check!
                                        (thinking…)
                                        Reset
                                        or sign in with
                                        • facebook
                                        • google
                                          Password icon
                                          I agree to the terms of service
                                          Signed in as (Sign out)
                                          You have left! (?) (thinking…)
                                        • Status Pages: Allow annotations to be placed on service outage/degradation icons for public status pages.

                                          Will help inform users of issues and possible post-mortem actions taken.

                                          3 votes
                                          Vote
                                          Sign in
                                          Check!
                                          (thinking…)
                                          Reset
                                          or sign in with
                                          • facebook
                                          • google
                                            Password icon
                                            I agree to the terms of service
                                            Signed in as (Sign out)
                                            You have left! (?) (thinking…)
                                          ← Previous 1 3
                                          • Don't see your idea?

                                          Rigor Product Suggestions

                                          Feedback and Knowledge Base