Test Protocol Studio

October 16, 2024 at 9:01 AM

Table of Contents

Test Protocol

  • [✔︎] Pass
  • [✘] Fail
  • [●] Fixed
  • [～] Should be improved

Studio

Content - Forms ～

  • [✔︎] Create
    • [✔︎] Tagging on/off
    • [✔︎] Filter on/off
  • [✔︎] Duplicate
  • [✔︎] Tagging on/off
  • [✔︎] Filter on/off
  • [✔︎] Delete
  • [✔︎] Mouser/keyboard
  • [✔︎] Tagging on/off
  • [✔︎] Filter on/off
  • [✔︎] Import
  • [✔︎] Content
  • [●] Tags updated
  • [✔︎] Tagging on/off
  • [✔︎] Filter on/off
  • [✔︎] Import eosce
  • [✔︎] Tagging on/off
  • [✔︎] Filter on/off
  • [✔︎] Export
  • [✔︎] Tags present
  • [✔︎] Tagging on/off
  • [✔︎] Filter on/off
  • [✔︎] Bulk approve
  • [✔︎] Add
  • [✔︎] Remove
  • [✔︎] Export Analyzer
  • [～] Export form Excel
  • [✔︎] Content correct
  • [～] File correct
    • ☞ Pain in leg (only) is faulty according to Excel Mac but the data is correct
    • ☞ Other apps don’t have a problem
  • [～] Picker correct (single/multiple)
    • ☞ single file should use file picker (not folder)
  • [～] Export form pdf
  • [✔︎] Content correct
  • [～] Picker correct (single/multiple) - ☞ single file should use file picker (not folder)
  • [✔︎] QR code
  • [✔︎] Valid
  • [✔︎] Pdf export single / multiple
  • [✔︎] Image export single / multiple
  • [✔︎] Picker correct (single/multiple)
  • [✔︎] Table functionality
  • [✔︎] Sort Order (incl. tags)
  • [✔︎] Statistics (incl. filtered)
  • [✔︎] Selection (single, multi, range)
  • [✔︎] Selection (keyboard only)
  • [✔︎] Content
  • [✔︎] Action overlay when no data
  • [✔︎] Action overlay when no filter results
  • [✔︎] Page functionality
  • [●] Busy cursor not reset when navigating back from form details
    • ☞ generally an issue with content pages
  • [✔︎] Tags
  • [✔︎] Assignemnt (single/multiple)
  • [✔︎] Removal (single multiple)
  • [✔︎] Rects to tag configuration changes
  • [✔︎] Filtering
  • [✔︎] Applied
  • [✔︎] Reset
  • [✔︎] Autoreset (new, duplicate, delete)
  • [✔︎] Auto deselect in table
  • [✔︎] Validation
  • [✔︎] Update
  • [✔︎] Visibility
  • [✔︎] Content
  • [～] UX - Validation message not taking filter into account

Content - Form - Document ✔︎

  • [✔︎] UI
  • [✔︎] Table of content
  • [✔︎] Zoom
  • [✔︎] Page navigation
  • [✔︎] Search
  • [✔︎] Print
  • [✔︎] Content
  • [✔︎] Candidate placeholder
  • [✔︎] Form structure (text, label, etc.)
  • [✔︎] Form questions (answer icons, comment, etc.)
  • [✔︎] Text (font, style, colors, etc.)
  • [✔︎] Layout Header
  • [✔︎] Empty, custom text, logo
  • [✔︎] Candidate info (not applicable)
  • [✔︎] Examiner info (not applicable)
  • [✔︎] Date, page number
  • [✔︎] Exam info
  • [✔︎] Form info
  • [✔︎] Layout Footer
  • [✔︎] Empty, custom text
  • [✔︎] Candidate info (not applicable)
  • [✔︎] Examiner info (not applicable)
  • [✔︎] Date, page number
  • [✔︎] Exam info
  • [✔︎] Form info

Content - Participants ✔︎

  • [✔︎] Create
  • [✔︎] Tagging on/off
  • [●] Filter on/off
    • ☞ Creating new item while filtered does not remove the filter (the user can’t see the new record)
  • [✔︎] Delete
  • [✔︎] Mouser/keyboard
  • [✔︎] Tagging on/off
  • [✔︎] Filter on/off
  • [✔︎] Import
  • [✔︎] Content
  • [✔︎] Tags updated
  • [✔︎] Tagging on/off
  • [✔︎] Filter on/off
  • [✔︎] Export
  • [✔︎] Tags present
  • [✔︎] Tagging on/off
  • [✔︎] Filter on/off
  • [✔︎] QR code
  • [✔︎] Valid
  • [✔︎] Pdf export single / multiple
  • [✔︎] Image export single / multiple
  • [✔︎] Picker correct (single/multiple)
  • [✔︎] Table functionality
  • [✔︎] Sort Order (incl. tags)
  • [✔︎] Statistics (incl. filtered)
  • [✔︎] Selection (single, multi, range)
  • [✔︎] Selection (keyboard only)
  • [✔︎] Action overlay when no data
  • [✔︎] Action overlay when no filter results
  • [✔︎] Content
  • [✔︎] Page functionality
  • [●] Busy cursor not reset when navigating back from form details
    • ☞ generally an issue with content pages
  • [✔︎] Filtering
  • [✔︎] Applied
  • [✔︎] Reset
  • [✔︎] Autoreset (new, duplicate, delete)
  • [✔︎] Auto deselect in table
  • [✔︎] Tags
  • [✔︎] Assignemnt (single/multiple)
  • [✔︎] Removal (single multiple)
  • [●] Reacts to tag configuration changes
    • ☞ Shows inexisting tags in table
  • [✔︎] Validation
  • [✔︎] Update
  • [✔︎] Visibility
  • [✔︎] Content
  • [～] UX - Validation message not taking filter into account

Content - Tagging - Assignment ✔︎

  • [✔︎] Assignment single record
  • [✔︎] Assignment multi record
  • [✔︎] No assignment when no record selected
  • [✔︎] Undo
  • [✔︎] Redo
  • [✔︎] Tag columns reacts
  • [✔︎] Column removed when tagging deactivated
  • [✔︎] Panel removed when tagging deactivated
  • [✔︎] Panel removed when no tags

Content - Tagging - Filtering ✔︎

  • [✔︎] Tag Filter interface
  • [✔︎] Tags selectable
  • [✔︎] Show items without tags
  • [✔︎] Match any / all
  • [✔︎] Apply, reset, candcel, refresh
  • [●] Match Statistics
    • ☞ Only “no match” message (sporadically)
  • [●] Tab activated correctly
    • ☞ When no tags but groups, group tab shows tag filter config
  • [✔︎] Group Filter interface
  • [✔︎] Group selectable
  • [✔︎] Match any / all
  • [✔︎] Apply, reset, candcel, refresh
  • [✔︎] Only valid groups available
  • [●] Tab activated correctly
    • ☞ When no tags but groups, group tab shows tag filter config
  • [✔︎] UI
  • [✔︎] Correct filter item list
  • [✔︎] Correct filter item connection
  • [✔︎] Filter active across all content
  • [●] Tag Filter removed on tagging deactivate
  • ☞ Filter and control still active after tagging deactivation
  • [●] Filter removed on license change
  • ☞ Filter and control still active after license removal
  • [●] Filter functionality unavalable when all tags/groups are deleted
  • ☞ group filter still active despite tag removal in content/group
  • [✔︎] Filter functionality unavalable without license (app restart)
  • [✔︎] Filter functionality unavalable when deactivated (app restart)
  • [✔︎] Filter functionality avalable after activation
  • [✔︎] Filter reset after tagconfig changes
  • [●] Filter reset after group config changes
    • ☞ group filter still active despite tag removal in content/group
  • [～] Misc
  • [～] Ordering ☞ Record sort order still not optimal as it is in reverse

Config - Project ✔︎

  • [✔︎] Save/Load
  • [✔︎] Exam Configuration
  • [✔︎] Distribution
  • [✔︎] Offline
  • [✔︎] Online
  • [✔︎] S3 config
  • [✔︎] Webdav config
  • [✔︎] NextCloud config
  • [✔︎] Connection testing
  • [✔︎] Qr code valid
  • [✔︎] Qr code encryption

Config - Tagging ✔︎

  • [✔︎] Save/load
  • [✔︎] Tags
  • [✔︎] Create
  • [✔︎] Modify
  • [●] Delete
    • ☞ Participants seem not affected (missing vial update)
  • [●] Delete All
    • ☞ Participants seem not affected (missing vial update)
  • [✔︎] Reorder
  • [✔︎] Record changes affect statistics
  • [✔︎] Affects groups
  • [✔︎] Record changes affects statistics
  • [✔︎] Groups
  • [✔︎] Create
  • [✔︎] Modify
  • [●] Delete
    • ☞ group item can not be deleted when no tags are present anymore
  • [✔︎] Delete All
  • [●] Select Tags
    • ☞ Select tags statistics initial no 0 values but after change filled with 0 (tags that are not used)
  • [✔︎] Record changes affects statistics
  • [✔︎] Validation
  • [✔︎] Correct validation calculation
  • [●] Correct message
    • ☞ Every group is initially marked invalid
  • [✔︎] Export
  • [✔︎] Content
  • [✔︎] Group names (without names)
  • [●] Order
    • ☞ Groups are not ordered correctly
  • [✔︎] Import
  • [✔︎] Content
  • [✔︎] Tags
  • [✔︎] Groups
  • [✔︎] Qr code
  • [✔︎] Valid
  • [✔︎] Export

Config - Devices ✔︎

  • [✔︎] Save/load
  • [✔︎] Permissions
  • [✔︎] Content
  • [✔︎] Touch

Config - Assessment ✔︎

  • [✔︎] Save/load
  • [✔︎] Comments
  • [✔︎] Finalization
  • [✔︎] Information
  • [✔︎] Touch

Config - Export ✔︎

  • [✔︎] Save/load
  • [✔︎] Filter
  • [✔︎] Format
  • [✔︎] PDF
  • [●] When a logo is added, the expander should open.

Distribution - Offline

  • [✔︎] Offline instruction
  • [✔︎] Offline assignment export
  • [✔︎] Offline assignment validity

Distribution - Online

  • [✔︎] Adding
  • [✔︎] Removing
  • [✔︎] Refresh
  • [✔︎] Auto Refresh
  • [✔︎] Credential QR
  • [✔︎] Table functionality
  • [●] State icons
    • ☞ Open/close state icon slightly missaligned
  • [✘] Battery icon
    • ☞ Battery info not available comming from iOS 18 => Check Touch Protocol

Observation ✔︎

  • [✔︎] Table functionality
  • [✔︎] Refresh
  • [✔︎] Auto Refresh
  • [●] State icons
    • ☞ Open/close state icon slightly missaligned
  • [✔︎] Content
  • [✔︎] Detail table funtionality
  • [✔︎] Group information (tagging on/off)
  • [✔︎] Comment
  • [✔︎] Content

Result - Download / Import ✘

  • [✔︎] Version listing
  • [✔︎] Download
  • [✔︎] Download All
  • [✔︎] Statistics
  • [✔︎] Infos
  • [✔︎] Table functionality
  • [✘] Import
    • ☞ Import only partially - form not visible in list (result visible in export but no data available)

Result - Export ✔︎

  • [✔︎] Adapts to License
  • [✔︎] Table
  • [✔︎] Action overlay when no result for current version
  • [✔︎] Sorting
  • [✔︎] Selection (moude/keyboard)
  • [✔︎] Version picker
  • [✔︎] Exam version picker show only current and versions without results
  • [✔︎] Changes content
  • [✔︎] Export config (sidepanel)
  • [✔︎] Correct config info
  • [✔︎] Correct config license dependent
  • [✔︎] Finalized setting effects export
  • [●] Finalized setting synced with config
    • ☞ Finalized setting is taken from config, but changing in panel does not change in config
  • [✔︎] PDF
  • [✔︎] Cover (overview, listing)
  • [✔︎] Form content (same as form document test)
  • [✔︎] Width Signature
  • [✔︎] Without Signature
  • [✔︎] Comments
  • [✔︎] Selections
  • [✔︎] Primary answers only
  • [✔︎] Omit signature
  • [●] Reduced content
    • ☞ No lines are rendered
  • [●] File
    • ☞ Overwriting existing pdfs make the pdf invalid (same session)
  • [✔︎] Header (same as form document test)
  • [✔︎] Header participants values
  • [✔︎] Footer (same as form document test)
  • [✔︎] Footer participants values
  • [✔︎] CSV
  • [✔︎] Content
  • [✔︎] Numeric values
  • [✔︎] With/without Signature
  • [✔︎] Results per form
  • [✔︎] Results per candidate
  • [✔︎] Results complete
  • [✔︎] Analyzer
  • [✔︎] File saving
  • [～] Analyzer import not tested
  • [✔︎] Filtering
  • [✔︎] Group
  • [✔︎] Tag
  • [✔︎] Statistics update

Not yet tested

  • [] Observation
  • [] Unchanged functionality