Performance Monitoring
To monitor API performance and by inference, the performance of underlying systems, APs and TPPs should provide built-in performance metric gathering into their APIs. For APs, this information may be published in the Meta Directory under the Get Performance API call. If published, TPPs can query this information on a scheduled basis to determine which APs are operating optimally per time and may apply this intelligence to load scheduling and optimal path routing.
However, TPPs can make such decisions using metrics they maintain if not published by APs via APIs. Note that reporting requirements of this standard instruct that APs must provide monthly reports showcasing these performance metrics in daily summary and detailed formats. Alternatively, APs can provide performance monitoring dashboards which registered TPPs can access at any time to generate reports or locate patterns.
The following types of performance information are required from all APIs published by APs:
1
msg_validation_time
Average time it takes to validate the message e.g. sender authentication, time stamp checking, message signature verification, Authentication token verification, message fields validation etc.
2
network_proc_time
Network processing time i.e. time between the timestamp in the request message and the timestamp on the API server at the time of receipt.
3
avg_db_time
Average time it takes to perform database operations
4
avg_ext_call_time
Average time it takes to perform subroutine API calls from within the API
5
avg_log_time
Average time it takes to log API calls.
6
avg_total_proc_time
Average total processing time i.e. time between receiving a request and dispatching a response.
7
avg_req_proc_time
Average request processing time i.e. time between when a request is received and dispatched to internal micro-services for processing
8
avg_rsp_proc_time
Average response processing time i.e. time between when a response is received internally, formatted and sent to the client system.
9
total_api_calls
Total number of API calls processed
10
%_success
Relates to messages successfully received, unpacked and responded to
11
%_approved
Relates to messages that achieved the function for which the call was made.
12
calls_per_sec
Average calls per second.
APs should record individual API performance metrics with at most 5 minute intervals between data points. Any interval missed is assumed to be downtime except within a period coinciding with a scheduled change or maintenance activity. For investigative purposes, these metrics can also be kept on a transactional level at the discretion of the AP. In addition, APs are required to provide API availability metrics. These metrics should be collected:
From outside the APs' networks
Over the internet
Through at least two major Internet Service Provider routes.
Per API endpoint e.g. one for branch related methods, another for ATM related methods etc.
The metrics give an external view of the organization's availability cutting across network, operating systems and application layers. External solutions or organizations can be engaged to provide and publish this data on behalf of APs.
Last updated