SERVER DASHBOARD ANDROID TEST REPORT ANALYZE Drive Test Engineer Static Box Nationwide Automatic Unit in Vehicles Central Log Dashboard Central Unit Control Root Cause Analysis Export to ACTIX & Gladiator TEST,UPLOAD AND GET ACTIONABLE DRIVE TEST DATA & REPORT IN 10 MINUTES! OVERVIEW Automatic Report PC REPLAY Benchmark 2
TEST REPORT ANALYZE OVERVIEW S5 SM-G900F DRIVE TEST GRADE ON LOCAL PHONES Runs on locally AZQ-certified Qualcomm Android Devices Runs on < 250 USD phone ( Xperia E3) to flagship (Galaxy S5) Same grade of L3 & Radio data as hand tools from US & EU Cell Functions LTE cell lock/WCDMA SC stay etc. Record PCAP logs for full IP & radio analysis Standard Test Scripts Voice , FTP , HTTP , SMS , PING etc. User Experience Test Scripts Line , OOKLA , YouTube etc. Officially licensed by Qualcomm 3
TEST REPORT ANALYZE OVERVIEW THE OPTIMIZATION DATA & CELL FUNCTIONS ENGINEER NEEDS 4
TEST REPORT ANALYZE OVERVIEW API BASED USERS’ PERSPECTIVE TEST 5
TEST REPORT ANALYZE OVERVIEW RADIO & L3 COLLECTED AS STANDARD PCAP OPTIONAL 6
TEST REPORT ANALYZE OVERVIEW Sony Xperia E3 AUTOMATIC TEST THE AUTOMATIC MODE OF AZENQOS ANDROID Mode 1 Unit starts test when power is plugged in and upload when power is unplugged Mode 2 Unit can also test based on time & day of week assigned from the dashboard Deployed on affordable devices like Xperia E3, entire country can be benchmarked 24/7 affordably Provides the same actionable drive test grade data and function whether deployed on Xperia E3 or Galaxy S5 Successful pan-country deployment in India & Thailand 7
TEST REPORT ANALYZE OVERVIEW UPLOADED LOGS ARE TURNED INTO REPORTS IN MINUTES COVERAGE PERFORMANCE PROBLEMS SCORING .KML .CSV .EXCEL .MIF ACTIONABLE DATA FOR EVERY TEST 8
TEST REPORT ANALYZE OVERVIEW IN THE REPORT : COVERAGE OF KEY PARAMETERS COVERAGE PERFORMANCE PROBLEMS SCORING OUTDOORS INDOORS 9
COVERAGE PERFORMANCE PROBLEMS SCORING TEST REPORT ANALYZE OVERVIEW IN THE REPORT : PERFORMANCE OF NETWORK & SERVICES KPI 10
COVERAGE PERFORMANCE PROBLEMS SCORING TEST REPORT ANALYZE OVERVIEW IN THE REPORT : PROBLEMS AND CAUSES SUMMARY 11
COVERAGE PERFORMANCE PROBLEMS SCORING TEST REPORT ANALYZE OVERVIEW IN THE REPORT : SCORECARD FOR EASY NETWORK TEST & ROLLOUT 12
TEST REPORT ANALYZE OVERVIEW DOWNLOAD LOG TO ANALYZE ROOT CAUSE ON PC 13
TEST REPORT ANALYZE OVERVIEW REPLAY LOGS , VIEW L3 MESSAGES AND RADIO PARAMETERS 14
TEST REPORT ANALYZE OVERVIEW CREATE BENCHMARK REPORTS 15
TEST REPORT ANALYZE OVERVIEW Easier : Easy to use by non-engineers Cheaper : Local phones for large scale deployment World-Class : Deep Radio parameters , Locking functions Faster : Report creation is now automated into minutes Visualized : Systematic Coverage , Performance, Problems, Scoring for each and every test Centralized : Testing can be done by anyone and doesn’t require skill or time back to create reports. Comprehensive : Automatic report does for 80% of the work but engineers can still deep dive for optimization & troubleshooting Personalized : Create their own template report if required 16
ASIA AFRICA USA SHOWCASE BLUE : CURRENT CUSTOMER , RED : UNDERGOING TRIAL & DEMO 17
ROADMAP VOLTE Undergoing development, target Q1 2015 TDD-LTE Key parameters developed, currently testing with Bharti in India, target Q1 2015 FDD-LTE LTE metrics derived from L3 Messages and L1 parameters/states for better root cause analysis, target Q2 2015 SIP decoding and tighter integration for future IP network testing, Q2 2015 WI-FI layer messages & offloading for LTE and WCDMA under feasibility study 2015 LTE & AIPN FOCUS RADIO & REPLAY ANDROID DASHBOARD 18
ROADMAP CUSTOMER CENTRIC TEST Email undergoing development, other tests ( Facebook , whatsapp , VDO streaming etc) TABLET Integration with test devices for benchmark testing NEW DEVICES SAMSUNG GALAXY NOTE 4 and NEXUS 6 on current roadmap NO ROOTING method of installation for selected newer devices (currently support S5,Nexus 5, E3) NON-RADIO & NON-QUALCOMM DEVICES Can execute SIP, PCAP and other service testing without L3 and radio messages. 2015 SERVICE TESTING,NEW DEVICES SUPPORT RADIO & REPLAY ANDROID DASHBOARD 19
ROADMAP OPENSTREETMAP OpenStreetMap integration into automatic test report ROOT CAUSE ANALYSIS Overshoot, signal black hole, cross sector ALARM & TICKET When test results fail below threshold KPI MORE VISIBLE Coverage, Problems, Performance, Scoring matrix 2015 AUTOMATION & BIG PICTURE VISUALIZATION RADIO & REPLAY ANDROID DASHBOARD 20
KPI LIST GSM RADIO SERVICE 21 SERVING CGI BSIC ARFCN BCCH RxLev Full ( dBm ) RxLev Sub ( dBm ) RxQual Full RxQual Sub TA TxPwr DSC Ciphering Algorithm Vocoder FER Speech Codec RX Speech Codec TX TCH Band C/I Worst C/I Worst ARFCN C/I C/I Per ARFCN C/I Avg Neighbor Cell ID Neighbor Cell ID (Hex) Neighbor BSIC Neighbor ARFCN Neighbor RxLev ( dBm ) Neighbor C1 Neighbor C2 Neighbor Cellname Neighbor Band GSM RR State State GSM MISSING NEIGHBOR Band Index Radio link timeout Data Bearer Mode Data LAC Data RAC Attach Duration PDP Context Activation Duration PDP Context De-Activation Duration RLC DL Throughput RLC UL Throughput DL Coding Scheme UL Coding Scheme DL Timeslot Used UL Timeslot Used GPRS C/I RLC BLER
KPI LIST WCDMA/HSDPA RADIO SERVICE 22 SERVING CGI EC/IO RSCP TxPower Max TxPower RSSI BLER Average RRC State A Set UARCFN A Set CellID A Set SC A Set EC/IO A Set RSCP M Set UARCFN M Set CellID M Set SC M Set EC/IO M Set RSCP D Set UARCFN D Set CellID D Set SC D Set EC/IO D Set RSCP Scheduled Rate Served Rate Final HS-DSCH Throuhput SBLER SBLER on 1 st Transmission Retransmission Rate HS-DSCH Code Used AVG. MOD QPSK/16QAM/64QAM% HSDPA CQI HSDPA Meas. N. Slots HSDPA N.Demod Attempt HSDPA N.Demod Valid HSDPA HS-SCCH Usage% HSPA+ CQI B HSPA+ CQI A HSPA+ CQI DC Pri.Carrier HSPA+ CQI DC Sec.Carrier HSPA+ Dual Carrier On / On % HSPA+ 2TB Requested % HSPA+ 1TB Requested % HSPA+ 64QAM Configured HSPA+ MIMO_Enabled HSPA+ UE_Category
KPI LIST WCDMA/HSUPA RADIO SERVICE 23 AVG Raw Throughput AVG Scheduled Throughput Final E-DPDCH Throughput HSUPA SBLER% HSUPA TTI HSUPA Happy bit TTIs(%) HSUPA New transmission(%) HSUPA Retransmission(%) HSUPA DTX(%) HSUPA AVG AGCH HSUPA AVG SGI HSUPA N NACK after max retrans HSUPA N MAC Resets HSUPA Power Limited TTIs HSUPA Serv. Grant TTIs HSUPA Buffer Limited TTIs HSUPA Buffer Empty TTIs HSUPA Scheduled/Non scheduled buffer empty TTIs
KPI LIST LTE RADIO SERVICE 24 Band EARFCN PCI RSRP RSRQ SINR RX(0) SINR RX(1) RSSI Tx Power Timing Advance Transmission Mode RRC State Allowed Access MNC MCC TAC Cell ID E NodeB ID DL EARFCN UL EARFCN DL BANDWIDTH UL BANDWIDTH Serving Cell Band Serving Cell PCI Serving Cell RSRP Serving Cell RSRQ Neighbor Cell Band Neighbor Cell PCI Neighbor Cell RSRP Neighbor Cell RSRQ RRC State L1 PSDSCH Throughput Transmission mode (RRC-tm) Transmission mode Current Serving PCI RNTI Type/RNTI ID Serv N Tx / Rx Ant Spatial Rank / Rank Indicatior CQI N RBs Allocated / Max DL Bandwidth Time Scheduled % Stream(0) Block Size Bits Stream(0) Modulation Traffic to pilot ratio Stream(1) Block Size Bits Stream(1) Modulation BLER N Sub-bands
KPI LIST Wi-Fi RADIO SERVICE 25 BSSID SSID Wifi RSSI IP Addr . Link speed MAC Addr . Encryption Freq Channel ISP Scanned BSSID Scanned SSID Scanned Freq Scanned Encryption Scanned Level Scanned Channel
OVERVIEW SHOWCASE ROADMAP KPI LIST THANK YOU ANDROID DASHBOARD REPLAY 26