- Semantically Equivalent GUI Screen detection.
- input: an image pair consisting of an error screenshot and a runtime screenshot
- output: a boolean telling whether the two input images are semantically same or not. (whether they refer to the same error screen regardless of pixel and user data differences reside in the image pair.)
- widget detection: SecStec uses UIED, an object detection tool combined old-fationed and DL models for object detection, to detect GUI element (both type and position)
- semantic equivalence image checker: for an image pair containing dialogue windows,using OCR technique to detect text and perform string comparison. Otherwise, 1) consturct dummy trees; 2) consturct tree shape vector and comparing vectors using cosine similarity; 3) matching indivisule tree nodes; 4) calculate tree similarity score
This tool related to the IEEE-SEAI paper "Image-based Bug Oracle Automation for Bug Report Reproduction Using Widget Detection" Semantically Equivalent GUI Screen detection"