StatS

StatS is a standalone subsystem part of the CGRateS infrastructure, designed to aggregate and calculate statistical metrics for the generic Events (hashmaps) it receives.

Both receiving of Events as well as Metrics displaying is performed via a complete set of CGRateS RPC APIs.

Due it’s real-time nature, StatS are designed towards high throughput being able to process thousands of Events per second. This is doable since each StatQueue is a very light object, held in memory and eventually backed up in DataDB.

Processing logic

When a new Event is received, StatS will pass it to FilterS in order to find all StatProfiles matching the Event.

As a result of the selection process we will further get an ordered list of StatProfiles which are matching the Event and are active at the request time.

For each of these profiles we will further calculate the metrics it has configured for the Event received. If ThresholdIDs are not *none, we will include the Metrics into special StatUpdate events, defined internally, and pass them further to the [ThresholdS](ThresholdS) for processing.

Depending on configuration each StatQueue can be backed up regularly and asynchronously to DataDB so it can survive process restarts.

Parameters

StatS

StatS is the CGRateS component responsible of handling the StatQueues.

It is configured within stats section from JSON configuration via the following parameters:

enabled

Will enable starting of the service. Possible values: <true|false>.

store_interval

Time interval for backing up the stats into DataDB.

store_uncompressed_limit

After this limit is hit the events within StatQueue will be stored aggregated.

thresholds_conns

Connections IDs towards ThresholdS component. If not defined, there will be no notifications sent to ThresholdS on StatQueue changes.

indexed_selects

Enable profile matching exclusively on indexes. If not enabled, the StatQueues are checked one by one which for a larger number can slow down the processing time. Possible values: <true|false>.

string_indexed_fields

Query string indexes based only on these fields for faster processing. If commented out, each field from the event will be checked against indexes. If uncommented and defined as empty list, no fields will be checked.

prefix_indexed_fields

Query prefix indexes based only on these fields for faster processing. If defined as empty list, no fields will be checked.

nested_fields

Applied when all event fields are checked against indexes, and decides whether subfields are also checked.

StatQueueProfile

Ís made of the following fields:

Tenant

The tenant on the platform (one can see the tenant as partition ID).

ID

Identifier for the StatQueueProfile, unique within a Tenant.

FilterIDs

List of FilterProfileIDs which should match in order to consider the profile matching the event.

ActivationInterval

The time interval when this profile becomes active. If undefined, the profile is always active. Other options are start time, end time or both.

QueueLength

Maximum number of items stored in the queue. Once the QueueLength is reached, new items entering will cause oldest one to be dropped (FIFO mode).

TTL

Time duration causing items in the queue to expire and be removed automatically from the queue.

Metrics

List of statistical metrics to build for items within this StatQueue. See [bellow](#statqueue-metrics) for possible values here.

ThresholdIDs

List of threshold IDs to check on when new items are updating the queue metrics.

Blocker

Do not process further StatQueues.

Stored

Enable offline backups for this StatQueue

Weight

Order the StatQueues matching the event. Higher value - higher priority.

MinItems

Display metrics only if the number of items in the queue is higher than this.

StatQueue Metrics

Following metrics are implemented:

*asr

Answer-seizure ratio. Relies on AnswerTime field in the Event.

*acd

Average call duration. Uses AnswerTime and Usage fields in the Event.

*tcd

Total call duration. Uses Usage out of Event.

*acc

Average call cost. Uses Cost field out of Event.

*tcc

Total call cost. Uses Cost field out of Event.

*pdd

Post dial delay <https://www.voip-info.org/pdd/>. Uses PDD field in the event.

*ddc

Distinct destination count will keep the number of unique destinations found in Events. Relies on Destination field in the Event.

*sum

Generic metric to calculate mathematical sum for a specific field in the Events. Format: <*sum:FieldName>.

*average

Generic metric to calculate the mathematical average of a specific field in the Events. Format: <*average:FieldName>.

*distinct

Generic metric to return the distinct number of appearance of a field name within Events. Format: <*distinct:FieldName>.

Use cases

  • Aggregate various traffic metrics for traffic transparency.

  • Revenue assurance applications.

  • Fraud detection by aggregating specific billing metrics during sensitive time intervals (*acc, *tcc, *tcd).

  • Building call patterns.

  • Building statistical information to train systems capable of artificial intelligence.

  • Building quality metrics used in traffic routing.