OTT Video Testing Services

Hughes Systique offers Testing Services in several niche areas; multimedia testing services is one of them. Our testing services include prototype, building, and testing multi-screen experience, cross-platform compatibility (Android, iOS, Windows), and building immersive user experience.

HSC has extensive experience of testing OTT applications on multimedia devices at all levels which includes manual and automated end to end testing across all major set-top boxes, Smart TVs, Windows, Mac OS, and hand-held devices.

• UI / UX Testing: Testing of User functionality and ensure a good user experience
  • User interactions with the player (play/pause/seek/switch/background)
  • A typical UI/App-Level test set-up is illustrated below: 

• Quality of Experience Measurement: Different parameters monitored and compared for different releases
  • Startup time
  • Rebuffer time
  • Video freeze
  • Video Startup failure
  • Video Playback failure
  • Average Bitrate
  • Video Interruptions (stalling)

• Functional Testing: Testing functional flow against functional specs. (Dynamic Ads, Multiple Transitions from one show to another, Blackout/Spotlight, features, Multiple clips in a single show, AV/CC out of sync, Frame dropping / Deja vu effect, Concurrency Service, etc.)
  • Validating graceful handling by testing exceptional scenarios.
  • Generic framework
  • Has the capability to integrate with any test tool & repository
• Analytics Certification Testing
  • Adobe
  • Nielsen
  • Conviva
  • Comscore
• Streaming Performance Testing
  • Simulate various Network scenarios in Lab – Lossy NW, Low Bandwidth Networks, High Latency Network
  • Measure streaming performance using Wireshark and custom analyzers
  • Measure and Graph various parameters like throughout, connect latency, request latency, lost connections
  • Objectively measure performance by deriving Quality of Experience (QoE)

A typical test setup to simulate network scenarios and measure streaming performance is illustrated below:

• Media head-end Testing:
  • Testing Content-Ingestion, Encoding and Origin / CDN
  • Stream Delivery in various formats (HLS / DASH / MSS etc)
  • Ad Testing for Server-Side Ads or VMAP / VAST Client Ads
  • Stream performance and Profile switching with network simulation
  • Measure and Graph various parameters like throughout, connect latency, request latency, lost connections
  • Introduce HTTP failures (like range request not supported)/ HTTP Redirects
  • Introduce metadata/interface failures
  • Drop or delay responses from Middleware sub-systems like CMS/UMS
  • Authorization/Heartbeat failures
  • Metadata errors
  • Introduce content errors
  • Dynamic Ad errors
  • Analytics errors
  • Load testing
  • HTTP interceptors can be used to intercept and modify HTTP responses
  • To introduce variations in metadata locally hosted QMX/QVT/m3u8 files shall be modified
• OTT Middleware / API Testing:
  • Functional testing of APIs / Middleware features.
  • Subscriber and Subscription flow from registration to purchase and stream entitlement.
  • Load / Stress testing of APIs for benchmarking user load and concurrency.
  • Testing Operator / Admin Dashboard applications
  • Testing system wide integrations (internal + external) for resilience, robustness & recovery.
• Test Monitor (24*7) Tool
  • Test Monitor tool run 24*7 in the Production environment from different Geo and send alerts for any client/server error and give chance to fix before major outage trigger
•  CDN/Server Simulator
• M3U8/HLS content shall be downloaded from the origin and hosted on a local machine
• CDN degradation/variations