Skip to content

Manual Testing

Jump to bottom
Sarath edited this page Mar 18, 2021 · 3 revisions

Cleanup Mac:

rm -r /Applications/OONI\ Probe.app \
~/Library/ApplicationSupport/OONI\ Probe/ \
~/Library/LaunchAgents/org.ooni.probe-desktop.plist

Cleanup Windows:

Uninstall app
rm -rf ~/AppData/Roaming/OONI\ Probe/

Fresh Install

  • Starts with onboarding
  • Shows dashboard after onboarding
  • Click "Run" on top
  • Runs all tests one after another
  • Shows results screen after tests
  • Wait a few seconds for the autorun prompt
  • Select "Remind me Later"
  • Open each result and each measurement (one or two for websites)
  • Make sure raw data can be inspected and explorer link opens page
  • Go to Dashboard -> Websites -> Choose Websites
  • Add a couple of websites, delete a few and run test
  • Shows results screen after tests
  • Wait for autorun prompt again and click "Sounds Great"
  • Confirm the websites chosen were tested
  • Go to settings and confirm "Run tests automatically" is enabled
  • Change language, look around and come back to switch to English
  • Edit categories to test, de-select all, select one (like gambling), run websites from dashboard and confirm in results
  • This time there should be no prompt on results screen
  • Enable all categories again
  • Disable "Limit test duration" and run websites test again
  • After a while "Estimated time left" should be a few hours
  • Click the 'X' icon at top-right of screen to show confirmation to stop.
  • 'Cancel' should continue testing
  • 'OK' should show "Stopping test..." and waits for the ongoing experiment to end
  • Shows results
  • Go back to settings and enable 'Limit test duration'
  • Change duration to 180 (lowest allowed is 60, UI flash is known bug)
  • Run websites test again and confirm ETA matches duration
  • To check if autorun task is scheduled, run in terminal:
launchctl print gui/$(id -u)/org.ooni.probe-desktop
  • Shows screenful of information. Confirm:
    • arguments has /path/to/ooniprobe, run unattended, --software-name=ooniprobe-desktop-unattended
    • environment has OONI_HOME pointing to path ending _autorun
    • run interval is 3600
  • Disable 'Run tests automatically' and run the same command above to see Could not find service "org.ooni.probe-desktop" in domain for login:
  • Enable autorun again and immediately check if background task is running with the command launchctl list org.ooni.probe-desktop
  • The output should have PID=<ooniprobe process id>
  • To check if autorun is collecting measurements, run:
OONI_HOME=~/Library/Application\ Support/OONI\ Probe/ooni_home_autorun /Applications/OONI\ Probe.app/Contents/Resources/bin/ooniprobe list
  • It should show at least 8 results (4 for each time autorun was enabled)
  • Menubar -> OONI Probe -> About OONI Probe should open the about window with valid debugging information.
  • Close all windows. App icon should stay in dock with the dot. Clicking on icon should show the dashboard again.
  • Cmd-Q to quit

Reinstall (without cleanup)

  • Move app to Bin
  • Install again
  • Run app again to show dashboard, not onboarding
  • Settings shows autorun disabled
  • Check that past results are still available
  • Shows autorun prompt again

Reinstall (after cleanup)

  • Starts with onboarding
  • Select "Change defaults"
  • Goes to Settings with "Share app usage..." and "Send crash reports" disabled
  • Go to Results and wait for autorun prompt. Click 'No Thanks'.
  • Go to Dashboard and back to Results. There should be no autorun prompt until next install.
Clone this wiki locally