KPIs - 5G N66 deployment in western canada.pptx

5g kpi including accessability, throughput.

1. 5G NSA KPIs overview Accessibility Retainability Mobility Service integrity Traffic KPI architecture Availability Utilization User Uplink/Downlink Average Throughput Cell Uplink/Downlink Average Throughput PRB Usage CPU Usage Radio Network Unavailability Rate Uplink/Downlink Traffic Volume Average/Maximum User Number SgNB addition success rate SgNB PScell modification success rate SgNB abnormal release rate

2. Counter ID Counter Name Counter Description Measurement Point 1911816746 N.NsaDc.SgNB.Add.Att Number of SgNB addition requests in the LTE-NR NSA DC scenario As shown at point A in Figure 1, the N.NsaDc.SgNB.Add.Att counter is incremented by 1 each time the gNodeB receives an SgNB Addition Request message from the eNodeB . 1911816747 N.NsaDc.SgNB.Add.Succ Number of successful SgNB additions in the LTE-NR NSA DC scenario As shown at point B in Figure 1, the N.NsaDc.SgNB.Add.Succ counter is incremented by 1 each time the gNodeB receives an SgNB Reconfiguration Complete message from the eNodeB . Figure 1 Accessibility Accessibility KPI is used to evaluate the SgNB additions successful rate in the LTE-NR NSA DC scenario SgNB addition success rate= N.NsaDc.SgNB.Add.Succ / N.NsaDc.SgNB.Add.Att

3. Retainability Retainability KPI is used to evaluate the ratio of abnormal SgNB releases due to the radio layer and transport layer in LTE-NR NSA DC scenarios Counter ID Counter Name Counter Description Measurement Point 1911816752 N.NsaDc.SgNB.Rel Total number of SgNB releases in the LTE-NR NSA DC scenario As shown at point A in figure 1, the N.NsaDc.SgNB.Rel counter is incremented each time the eNodeB sends an SgNB Release Request message to the gNodeB . As shown at point A in figure 2, the N.NsaDc.SgNB.Rel counter is incremented each time the eNodeB sends an SgNB Release Confirm message to the gNodeB . 1911817843 N.NsaDc.SgNB.AbnormRel Total number of abnormal SgNB releases triggered by SgNB in LTE-NR NSA DC scenarios As shown at point A in figure 2, If the cause value is "Radio Connection With UE Lost", "Failure in the Radio Interface", " TDCoverall Expiry", "Transport Resource Unavailable", or "Unspecified", the N.NsaDc.SgNB.AbnormRel counter is incremented by 1. Figure 2 Figure 1 SgNB abnormal release rate= N.NsaDc.SgNB.AbnormRel / N.NsaDc.SgNB.Rel

4. Mobility Mobility KPI is used to evaluate the successful rate of PSCell changes in the LTE-NR NSA DC scenario SgNB PScell modification success rate= (N.NsaDc.IntraSgNB.PSCell.Change.Succ+N.NsaDc.InterSgNB.PSCell.Change.Succ)/(N.NsaDc.IntraSgNB.PSCell.Change.Att+N.NsaDc.InterSgNB.PSCell.Change.Att) Counter ID Counter Name Counter Description Measurement Point 1911816748 N.NsaDc.InterSgNB.PSCell.Change.Att Number of inter- SgNB PSCell change requests in the LTE-NR NSA DC scenario As shown at point A in Figure 1, the N.NsaDc.InterSgNB.PSCell.Change.Att counter is incremented by 1 each time the gNodeB sends an SgNB Change Required message to the eNodeB . 1911816749 N.NsaDc.InterSgNB.PSCell.Change.Succ Number of successful inter- SgNB PSCell changes in the LTE-NR NSA DC scenario As shown at point B in Figure 1, the N.NsaDc.InterSgNB.PSCell.Change.Succ counter is incremented by 1 each time the gNodeB receives an SgNB Change Confirm message from the eNodeB 1911816750 N.NsaDc.IntraSgNB.PSCell.Change.Att Number of intra- SgNB PSCell change requests in the LTE-NR NSA DC scenario As shown at point A in Figure 2, the N.NsaDc.IntraSgNB.PSCell.Change.Att counter is incremented by 1 each time the gNodeB sends an SgNB Modification Required message to the eNodeB to request a PSCell change 1911816751 N.NsaDc.IntraSgNB.PSCell.Change.Succ Number of successful intra- SgNB PSCell changes in the LTE-NR NSA DC scenario As shown at point B in Figure 2, the N.NsaDc.IntraSgNB.PSCell.Change.Succ counter is incremented by 1 each time the gNodeB is notified of a PSCell change via an SgNB Modification Confirm message from the eNodeB Figure 1 Figure 2

5. Service Integrity KPIs - User Uplink/Downlink Average Throughput These KPIs indicate the average uplink and downlink UE throughputs in a cell. Name User Uplink Average Throughput Formula UserULAveThp = UserULRmvSmallPktTrafficVolume / UserULRmvSmallPktTransferTime Associated Counter User Uplink Average Throughput = ( N.ThpVol.UL – N.ThpVol.UE.UL.SmallPkt )/ N.ThpTime.UE.UL.RmvSmallPkt Unit Gbit /s Name User Downlink Average Throughput Formula UserDLAveThp = UserDLRmvLastSlotTrafficVolume / UserDLRmvLastSlotTransferTime   Associated Counter User Downlink Average Throughput = ( N.ThpVol.DL – N.ThpVol.DL.LastSlot )/ N.ThpTime.DL.RmvLastSlot Unit Gbit /s Counter ID Counter Name Counter Description 1911816645 N.ThpVol.UL Total volume of uplink data received at the RLC layer in a cell 1911816851 N.ThpVol.UE.UL.SmallPkt Uplink volume of small packets received at the RLC layer 1911816853 N.ThpTime.UE.UL.RmvSmallPkt Uplink data transmission duration excluding that of small packets 1911816643 N.ThpVol.DL Total volume of downlink data sent at the RLC layer in a cell 1911816848 N.ThpVol.DL.LastSlot Downlink volume of RLC SDUs sent in the last timeslot during which the buffer becomes empty 1911816850 N.ThpTime.DL.RmvLastSlot Data transmission duration excluding the last timeslot during which the downlink buffer becomes empty

6. Service Integrity KPIs - Cell Uplink/Downlink Average Throughput These KPIs evaluate the uplink/downlink capacity of a cell. Name Cell Uplink Average Throughput Formula CellULAveThp = CellULTrafficVolume / CellULTransferTime Associated Counter Cell Uplink Average Throughput = N.ThpVol.UL.Cell / N.ThpTime.UL.Cell Unit Gbit /s Name Cell Downlink Average Throughput Formula CellDLAveThp = CellDLTrafficVolume / CellDLTransferTime Associated Counter Cell Downlink Average Throughput = N.ThpVol.DL.Cell / N.ThpTime.DL.Cell Unit Gbit /s Counter ID Counter Name Counter Description 1911816696 N.ThpVol.UL.Cell Total volume of uplink data received at the MAC layer in a cell 1911816697 N.ThpTime.UL.Cell Duration of uplink data transmission at the MAC layer in a cell 1911816694 N.ThpVol.DL.Cell Total volume of downlink data sent at the MAC layer in a cell 1911816695 N.ThpTime.DL.Cell Duration of downlink data transmission at the MAC layer in a cell

7. Utilization KPIs - Uplink/Downlink Resource Block Utilizing Rate These KPIs indicate the busy-hour uplink and downlink RB usages in a cell or RAN. Name Uplink Resource Block Utilizing Rate Measurement Object Cell or RAN Formula RB_URUL = ( RB_UsedUL / RB_AvailableUL ) × 100% Associated Counter Uplink Resource Block Utilizing Rate = ( N.PRB.UL.Used.Avg / N.PRB.UL.Avail.Avg ) × 100% Unit % Name Downlink Resource Block Utilizing Rate Measurement Object Cell or RAN Formula RB_URDL = ( RB_UsedDL / RB_AvailableDL ) × 100% Associated Counter Downlink Resource Block Utilizing Rate = ( N.PRB.DL.Used.Avg / N.PRB.DL.Avail.Avg ) × 100% Unit %

8. Utilization KPI - Average CPU Load This KPI indicates the CPU usage during busy hours. Name Average CPU Load Measurement Object CPU Formula MeanCPUUtility Associated Counter Average CPU Load = VS.BBUBoard.CPULoad.Mean Unit % The CPU usage is sampled every second , and the average CPU usage of each 5s is used as the sampling result.

9. Availability KPI - Radio Network Unavailability Rate This KPI indicates the percentage of time when cells in a radio network are unavailable. Name Radio Network Unavailability Rate Measurement Object Radio network Formula RAN_Unavail_Rate = ( Avg( CellUnavailTime )/({SP} × 60)) × 100% Associated Counter Radio Network Unavailability Rate = (( N.Cell.Unavail.Dur.System.Avg + N.Cell.Unavail.Dur.Manual.Avg )/({SP} × 60)) × 100% Note: SP represents the reporting period of counters. The unit is minute. Unit %

10. Traffic KPIs - Uplink/Downlink Traffic Volume These KPIs indicate the uplink and downlink traffic volumes in a cell, which are measured at the Radio Link Control (RLC) layer. Name Uplink Traffic Volume Measurement Object Cell or RAN Formula ULTraffic Volume Associated Counter Uplink Traffic Volume = N.ThpVol.UL Unit kbit Name Downlink Traffic Volume Measurement Object Cell or RAN Formula DLTrafficVolume Associated Counter Downlink Traffic Volume = N.ThpVol.DL Unit kbit

11. Traffic KPI - Average/Maximum User Number These KPIs indicate the number of UEs in RRC_CONNECTED mode in a cell. Name Average User Number Measurement Object Cell or RAN Formula AvgUserNumber Associated Counter Average User Number = N.User.RRCConn.Avg Unit N/A Name Maximum User Number Measurement Object Cell or RAN Formula MaxUserNumber Associated Counter Maximum User Number = N.User.RRCConn.Max Unit N/A The number of UEs in RRC_CONNECTED mode in a cell is sampled per second .

12. KPI Architecture Description Formula Accessibility SgNB addition success rate Accessibility KPI is used to evaluate the SgNB additions successful rate in the LTE-NR NSA SgNB addition success rate= N.NsaDc.SgNB.Add.Succ / N.NsaDc.SgNB.Add.Att Retainability SgNB abnormal release rate Retainability KPI is used to evaluate the ratio of abnormal SgNB releases due to the radio layer and transport layer SgNB abnormal release rate= N.NsaDc.SgNB.AbnormRel/N.NsaDc.SgNB.Rel Mobility SgNB PScell modification success rate Mobility KPI is used to evaluate the successful rate of PSCell changes in the LTE-NR NSA SgNB PScell modification success rate= (N.NsaDc.IntraSgNB.PSCell.Change.Succ+N.NsaDc.InterSgNB.PSCell.Change.Succ)/(N.NsaDc.IntraSgNB.PSCell.Change.Att+N.NsaDc.InterSgNB.PSCell.Change.Att) Service integrity User Uplink/Downlink Average Throughput Evaluate the service quality of end users in the 5G RAN UserULAveThp = serULRmvSmallPktTrafficVolume/UserULRmvSmallPktTransferTime UserDLAveThp = UserDLRmvLastSlotTrafficVolume/UserDLRmvLastSlotTransferTime  Cell Uplink/Downlink Average Throughput Evaluate the service quality of end users in the 5G RAN CellULAveThp = CellULTrafficVolume/CellULTransferTime CellDLAveThp = CellDLTrafficVolume/CellDLTransferTime Utilization PRB Usage Busy-hour uplink and downlink RB usages in a cell or RAN RB_URUL = (RB_UsedUL/RB_AvailableUL) × 100% RB_URDL = (RB_UsedDL/RB_AvailableDL) × 100% CPU Usage CPU usage during busy hours MeanCPUUtility Availability Radio Network Unavailability Rate Percentage of time when cells in a radio network are unavailable RAN_Unavail_Rate = ( Avg(CellUnavailTime)/({SP} × 60)) × 100% Traffic Uplink/Downlink Traffic Volume These KPIs indicate the uplink and downlink traffic volumes in a cell ULTraffic Volume/DLTrafficVolume Average/Maximum User Number Number of UEs in RRC_CONNECTED mode in a cell AvgUserNumber / MaxUserNumber Summary