OTT Media Testing

OTT Video Testing Services

Hughes Systique offers Testing Services in several niche areas; multimedia testing services is one of them. Our testing services include prototype, building, and testing multi-screen experience, cross-platform compatibility (Android, iOS, Windows), and building immersive user experience.

HSC has extensive experience of testing OTT applications on multimedia devices at all levels which includes manual and automated end to end testing across all major set-top boxes, Smart TVs, Windows, Mac OS, and hand-held devices.

• UI / UX Testing: Testing User functionality and ensure a good user experience
  • User interactions with the player (play/pause/seek/switch/background)
  • Validating graceful handling by testing exceptional scenarios
  • Generic Framework
  • Has capability to integrate with any test tool and repository
  • A typical UI/App-Level test set-up is illustrated below:

• Functional Testing: Testing functional flow against functional specs. (Dynamic Ads, Multiple Transitions from one show to another, Blackout/Spotlight, features, Multiple clips in a single show, AV/CC out of sync, Frame dropping / Deja vu effect, Concurrency Service, etc.)
• Quality of Experience Measurement: Different parameters monitored and compared for different releases
  • Startup time
  • Rebuffer time
  • Video freeze
  • Video Startup failure
  • Video Playback failure
  • Average Bitrate
  • Video Interruptions (stalling)

• Analytics Certification Testing
  • Adobe
  • Nielsen
  • Conviva
  • Comscore

• Streaming Performance Testing
  • Simulate various Network scenarios in Lab – Lossy NW, Low Bandwidth Networks, High Latency Network
  • Measure streaming performance using Wireshark and custom analyzers
  • Measure and Graph various parameters like throughout, connect latency, request latency, lost connections
  • Objectively measure performance by deriving Quality of Experience (QoE)

A typical test setup to simulate network scenarios and measure streaming performance is illustrated below:

• Test Monitor (24*7) Tool
  • Test Monitor tool run 24*7 in the Production environment from different geographies and send alerts for any client/server error and give chance to fix before major outage trigger
• OTT Middleware / API Testing:
  • Functional testing of APIs / Middleware features.
  • Subscriber and Subscription flow from registration to purchase and stream entitlement.
  • Load / Stress testing of APIs for benchmarking user load and concurrency
  • Testing Operator / Admin Dashboard applications
  • Testing system-wide integrations (internal + external) for resilience, robustness recovery
• Media head-end Testing:
  • Testing Content-Ingestion, Encoding and Origin / CDN
  • Stream Delivery in various formats (HLS / DASH / MSS etc)
  • Ad Testing for Server-Side Ads or VMAP / VAST Client Ads
  • Stream performance and Profile switching with network simulation
  • Measure and Graph various parameters like throughout, connect latency, request latency, lost connections
  • Introduce HTTP failures (like range requests not supported)/ HTTP Redirects
  • Introduce metadata/interface failures
  • Drop or delay responses from Middleware sub-systems like CMS/UMS
  • Authorization/Heartbeat failures
  • Metadata errors
  • Introduce content errors
  • Dynamic Ad errors
  • Analytics errors
  • Load testing
  • HTTP interceptors can be used to intercept and modify HTTP responses
  • To introduce variations in metadata locally hosted QMX/QVT/m3u8 files shall be modified