Production Statistics
The Stats tab shows, at a glance, how much a source object, a source version, a rule or a rule version is tested and how much it is used in production. Use it to see whether a rule is running at all, whether it has started to fail, how busy it is from day to day, and whether its tests have been run. Every number on the tab is also a way in: click it to see the records it counts.
The production numbers come from the evaluations your application records with Audit. Without Audit, or without permission to see evaluations, the tab shows only the test numbers.
What the Stats Tab Shows
The Stats tab is in the dialog of every source object, source version, rule and rule version. Its label carries two numbers: the tests not run yet, in blue, and the evaluations in total, in grey, so you can read them without opening the tab.
On the tab:
- Saved Tests and Not Run: two bars that count the saved tests of the object and those that have not been run yet. Click Not Run to open the Tests grid on the tests still waiting to be run.
- Three evaluation bars: the total number of evaluations (Σ), those that ran (a green check mark) and those that ended in an error (a red cross). Click a bar to open the Live Evaluations grid filtered to this object and, for the green or red bar, to that status.
- Live Evaluations: a chart of the evaluations over time. Each period has two bars side by side: green for the evaluations that ran and red for those that ended in an error. Point at a bar to see its count. A period with no evaluations still shows a thin bar, so a zero is visibly a zero.
- The period selector in the chart's upper right corner: Last 10 days (the default), Last 3 months or Last 12 months. Days and months are counted in your own time zone, and the current day or month is included.
What is counted depends on the dialog: a rule version's tab counts that version alone, a rule's tab all its versions, a source version's tab every rule version written against it, and a source object's tab all of its versions.
Checking How a Rule Is Doing in Production
- Open the rule: click Rules at the top of the screen and click the rule's row. The Rule dialog opens.
- Click the Stats tab.
- Compare the green and red bars. Many red ones mean the rule is failing in production: click the red bar to see those evaluations, and open one to see the error.
- In the chart, choose Last 3 months or Last 12 months to see a longer trend, such as a rule that stopped running after a change in your application.
- To compare versions, open a rule version's dialog instead (from the Rule Versions grid or Show related...) and look at its own Stats tab.
Counts in the Grids
The Source Objects, Source Versions, Rules and Rule Versions grids repeat these numbers in their last three columns: tests not run (≠), evaluations that ran (a green check mark) and evaluations that ended in an error (a red cross). Point at a column's heading to see what it counts. Sort by one of them to find, for example, the rules that fail most often.