IDA has decided to conduct half-yearly tests on the performance for the Short Message Service (SMS) provided by Public Cellular Mobile Telephone Service (PCMTS) operators and to publish the survey results on the IDA website for public information. This is in recognition of the increasing importance and widespread use of SMS as a means of communication amongst users in Singapore. The objective of the SMS Performance Test is to ascertain the end-to-end response time of SMS across local mobile networks.
The transmission speed of the SMS involving the three PCMTS operators, namely, SingTel Mobile, M1 and StarHub Mobile is measured. Specifically, the parameters measured in the test, for both intra-operator SMS (SMS sent and received within a single operator's network) and inter-operator SMS (SMS sent and received across different operators' network) are:
-
Percentage of SMS messages delivered within 15 seconds;
-
Percentage of SMS messages delivered within 15 minutes; and
-
Percentage of SMS messages delivered within 12 hours.
IDA may include additional parameters as and when necessary.
Note: IDA has revised the delivery timeframes of the SMS Performance Tests with effect from 1H 2012. Prior to 1H 2012, the parameters measured in the test were: (i) percentage of SMS messages delivered in less than 20 seconds; (ii) percentage of SMS messages delivered in 1 hour or more; and (iii) percentage of SMS messages not delivered.
Percentage of SMS messages delivered within 15 seconds refers to SMS messages that were successfully sent from one network and received by another or within the same network in less than 15 seconds.
Percentage of SMS messages delivered within 15 minutes refers to SMS messages that were successfully sent from one network and received by another or within the same network in less than 15 minutes.
Percentage of SMS messages delivered within 12 hours refers to SMS messages that were successfully sent from one network and received by another or within the same network in less than 12 hours .
IDA's SMS Performance Tests will be conducted half-yearly. Prior to 2009, only the Fixed mode test is conducted. Starting from 2009, the test will comprise of both the Fixed and Mobile Test mode. Each test period will be randomly selected by IDA.
During the Fixed mode test period, SMS messages will be sent within and amongst all three PCMTS operators' network for 24 hours a day, with an interval of 5 minutes between each SMS message.
During the Mobile mode test period, SMS messages will be sent within and amongst all three PCMTS operators' network, with an interval of 30 seconds between each SMS message. This test will be conducted outdoor on an islandwide basis.
The test will use the same handset model for all PCMTS operators to avoid possible distortion of the test results due to technical differences in handsets. Two handsets will be used for each PCMTS operator, one for sending the SMS message and another for receiving the SMS message sent.
The test will be conducted using a standard maximum message length of 160 characters*. All handsets will be placed in a fixed location or in a vehicle for fixed and mobile tests, respectively.
All test messages will be computer-generated and collection of results will be fully automated.
At the end of each test period, timings will be consolidated and analysed.
In interpreting the results, it should be noted that:
-
The SMS performance tests results represent a snapshot of the SMS performance during the time of testing. The reported results may not reflect end users' experience at all time.
-
The inter-operator SMS performance is dependent on the originating and terminating networks. Network failure or congestion in any of the two networks will affect the inter-operator SMS performance.
*
According to the Global System for Mobile communication ("GSM") standards, a standard SMS message usually has a maximum length of 160 characters.
