Trust page

Testing Methodology

The nine test categories

CategoryWhat it coversStatus
InstallationInstall path, error handling, permission prompts on each device typeNot yet tested
CompatibilityBehaviour across phone, tablet, TV and emulator form factorsNot yet tested
PerformanceStartup time, channel switch time, playback stabilityNot yet tested
UI and navigationLayout, D-pad reachability, accessibility of controlsNot yet tested
StabilityCrash frequency across a sustained multi-hour sessionNot yet tested
Permission reviewManifest audit against the app's stated functionNot yet tested
Update behaviourUpdate mechanism, signature continuity after an update, data retentionNot yet tested
Stream handlingBitrate switching, buffering behaviour and recovery on a constrained connectionNot yet tested
Device supportWhich named hardware models install and run the buildNot yet tested

How results are reported

  • The device model, Android version and app version string used.
  • The date the test was run.
  • The observed result stated plainly, including failures and partial results.
  • Any condition that would make the result non-reproducible for another reader.

What is out of scope

We do not test, measure or rate the legality, licensing or content quality of any stream. We also do not publish speed or quality comparisons against paid services, because a comparison of a licensed service and a sideloaded app is not a like-for-like measurement.