An independent study about quality of service (QoS) conducted by the Pakistan Telecommunication Authority (PTA) found that telcos only partially satisfied the key performance indicators (KPIs) set in their licenses and the applicable regulations with regard to voice services, webpage loading, and latency.
PTA conducted an impartial Quality of Service (QoS) survey in the second quarter of 2024 in 23 cities of Pakistan. The Quality of Service (QoS) Regulations 2021 for telcos have been applied to evaluate CMO performance during the survey.
PTA conducted an impartial Quality of Service (QoS) survey in the first quarter of 2024 in 16 cities of Pakistan.
To fully reach the studied cities, the survey drive required 83 days and over 4000 kilometers of travel for every CMO. 57500 calls and SMS tests, as well as 0.38 million mobile broadband tests, were carried out during the survey.
Quality of Service tests were carried out in the following domains during the survey: voice, short messaging service (SMS), mobile broadband (i.e., data (Automode), data (Ookla), latency (Ookla), and web browsing).
On survey routes, samples of 4G/LTE signal strength were acquired during data tests in technology auto-detect mode. While some CMOs did meet the KPI, none of the operators were compliant in every area that was assessed.
Samples of the 3G signal strength were also taken along the survey routes during the survey, whenever the network transitioned to 3G while the mobile device remained in technology auto-detect mode. Although some CMOs did meet the KPI, none of the operators were compliant in every area that was assessed.
Because latency has a significant impact on user experience, it is an essential indication of mobile broadband performance. During the survey, network latency was measured by calculating the ping between different websites and Ookla Speed Test servers. Nonetheless, in the majority of the instances, it was discovered that the four operators had failed to meet the KPI.
Not a single operator was determined to be compliant in every aspect of the survey, when many national and international websites’ load times were measured. The operators met the KPI somewhat.
In total, 28,837 call attempts were made, of which 537 were unsuccessful. Of the 28,300 calls that were successfully placed, 233 were dropped before the two minutes were over, and 28,067 calls stayed connected the entire time. While evaluating voice services in the cities under study, the five QoS KPIs (Network Accessibility, Call Setup Success Rate, Call Setup Time, Call Completion Rate, and Mean Opinion Score) were recorded. The operators met the KPI somewhat.
There were 28,713 tries to send SMS in total; 28,626 of those efforts were successfully communicated by the A-Party, while 28,310 of those attempts were successfully received by the B-Party. Measured during the testing of SMS services in the cities under study are the two x SMS QoS KPIs, which are delivery time and success rate. The operators only partially met the KPI.
Ufone was ranked first, Zong second, Jazz third, and Telenor fourth in the classification of CMOs in Mobile Network Coverage, or Signal Strength of 4G/LTE and 3G Networks (in case of backup) assessed in Technology Auto Detect Mode.
In terms of download data throughput, Jazz is in the lead, followed by Zong, Ufone, and Telenor.
In terms of upload data throughput, Zong leads, followed by Jazz, Telenor, and Ufone.
Regarding how each CMO is categorized based on the cities’ maximum compliance with latency, Telenor is ranked top, followed by Zong, Jazz, and Ufone.