The ITS Team will be performing maintenance on Confluence beginning at 6:00 pm Tuesday, October 8. During this time the service may go offline. It should be available again by 8:00 pm. Please refrain from editing pages during this time to avoid losing your work.
This is an evolving document – feel free to add items as you see fit.
Basic Testing
Here are some annotated screencaps of Mandala – you can reference these if you aren't sure of the terms in the task lists below.
For all sites, you should check the following items. This is based off Than Grove's provisional list in this Google Doc:
As Anonymous User
Do the following tasks without being logged into the site, i.e. as an anonymous user:
Go to home page
Does it load and display properly?
Do links function?
Filter gallery or list of resources with whatever options appear above it
Sort gallery or list with options that appear
Go to a resource listed on home page
Open the search flyout
Click on node in tree
Search for resources
- Open search results
Check popovers in flyout and kmap tag icons
Are all resource types being listed where they are known to exist?
Resource types are related subjects, related places, AV, Photos, Texts, Sources, Visuals.
Here are some kmaps you can reference: China (Places), Lhasa (Places), Tibet & Himalayan (Subjects)
Are resource counts accurate?
Do resource counts match between navigator flyouts and kmap icon popovers?
If the site has collections:
Go to collections page (if the site has one)
View a collection
View a subcollection
View an item in a collection and subcollections
Open the Main Menu (use the “Hamburger” icon in upper right corner):
Check that all links go to where they should go. Do any links go to “Restricted Access” pages?
Open the Explore Menu next to the Main Menu:
Are all sites properly interlinked?
As Authenticated User
Do the following for each site:
Log in using Netbadge
Check Main Menu
Does it now have links for something like My Content and Collections?
Go to the pages in the Main Menu
Create a collection
Fill out all fields
Make the collection private.
Add the test user, 'Chelsea', as a collection member
Add a resource item to the collection
Fill out all fields
Create a subcollection
Fill out all fields
Make it private
Add a resource to a subcollection
Add 'vck6mg', as a subcollection member
Edit a resource
Does it update properly?
Make one resource public
Does it now show in for an anonymous/non-logged in user?
Add a kmap subject, places, and terms tag to the public resource.
Do the counts adjust in flyout tree?
Do counts adjust in kmaps popovers?
When done, remove the kmap tags and make the resource private again
- Add an asset from another tool in Mandala to any WYSIWYG fields. Generally, "description" and "annotation" fields are WYSIWYG editors.
- Can you find the asset you're looking for?
- Can you use usernames to filter assets?
- Does the asset appear in the description/image once you Save?
- Go to the http version of the site. It should redirect to the https version. (For example, http://sources.shanti.virginia.edu redirects to https://sources.shanti.virginia.edu)
Specific Testing Areas
Search Flyout
For every test
Evaluating search results
Ask yourself:
Are the results what a typical user would expect?
Would the results make sense to an easily-confused user?
Does the sorting of results make sense?
Can you navigate search results by scrolling, clicking Next, etc?
Can you click on search results?
Can you preview kmaps by hovering over a result?
Visual appearance of search
Make sure icons and texts don’t overlap and are aligned properly.
Make sure any animation is smooth, and doesn’t jump or jitter.
For specific tasks and cases
Query scope
Open the search flyout
Click Advanced beneath the search bar
Make some test searches, clicking the options under FILTER: Search Scope Settings
Make sure to evaluate search results using the guidelines above
Case sensitivity of queries
Open the search flyout
Enter several identical search queries with and without capitalization, then check results
Make sure to include:
Random capitalization in the middle of words
Multi-word queries with each word capitalized
Multi-word queries with mixed capitalization
Search filters
To test search filters:
Open the search flyout
Enter a search term, then click on Advanced and enter a Select Feature Type. Check results, then perform this step in reverse.
Enter a search term, then click on Advanced and enter a Selected Associated Subject. Check results, then perform this step in reverse.
Enter multiple filters, remove filters, and manipulate them in any way you see fit.
Queries with special characters
Test these special characters: " !"#$%&'()*+,-./:;<=>?@[\]^_`{|}~"
You should also test a few characters with diacritical marks
If you can find a subject that contains a special character in the page tree, try to get it as a result. Here are some examples, though this list is not exhaustive:
Subjects (id):
Biologies (Biological and Spiritual) (5813)
Time & Events (6415)
The Secondary Verbs ???? “To Have Time,” and ??? “To Be Time” (5101)
Table: The Comparative and Superlative Forms of Adjectives (5208)
Equipment, Furniture, & Miscellaneous Things (5645)
Audio-Video (6407)
Biographies/Catalogs (6421)
Places (id):
Iran, Islamic Republic of (5239)
“A” Stream (11393)
Lao People’s Democratic Republic (13519)
Timor-Leste (13716)
Ramoché (16409)
If you cannot find a subject that contains a special character in the page tree, enter the special character in the search bar to make sure the search doesn’t hang -- you want to get a “no results” message, not a “Searching…” message that won’t disappear.
Search persistence
Search persistence refers to the search flyout “remembering” a search you performed, even after you refresh the page. This helps users maintain their workflow. To trigger search persistence:
Enter a search query in the search flyout
Click on a result
Navigate to a different page
If search persistence is working, you should see the same search form from step 1 in the flyout
You should ask yourself:
Does the search form persists once you navigate to a different page?
Can you enter a new search, and does that new search override the old one? Does it persist when you refresh the page?
Can you easily clear the search form so it no longer persists?