This is an evolving document – feel free to add items as you see fit. 

Basic Testing

Here are some annotated screencaps of Mandala – you can reference these if you aren't sure of the terms in the task lists below.

 

For all sites, you should check the following items. This is based off Than Grove's provisional list in this Google Doc: 

As Anonymous User

Do the following tasks without being logged into the site, i.e. as an anonymous user:

  1. Go to home page 

    • Does it load and display properly?

    • Do links function?

  2. Filter gallery or list of resources with whatever options appear above it

  3. Sort gallery or list with options that appear

  4. Go to a resource listed on home page

  5. Open the search flyout

    • Click on node in tree

    • Search for resources

    • Open search results

  6. Check popovers in flyout and kmap tag icons

    • Are resource counts accurate? 

    • Do resource counts match between navigator flyouts and kmap icon popovers?

  7. If the site has collections:

    • Go to collections page (if the site has one)

    • View a collection

    • View a subcollection

    • View an item in a collection and subcollections

  8. Open the Main Menu (use the “Hamburger” icon in upper right corner): 

    • Check that all links go to where they should go. Do any links go to “Restricted Access” pages?

  9. Open the Explore Menu next to the Main Menu: 

    • Are all sites properly interlinked?

As Authenticated User

Do the following for each site:

  1. Log in using Netbadge

  2. Check Main Menu

    • Does it now have links for something like My Content and Collections? 

  3. Go to the pages in the Main Menu

  4. Create a collection

    1. Fill out all fields 

    2. Make the collection private.

  5. Add the test user, 'Chelsea', as a collection member 

  6. Add a resource item to the collection

    1. Fill out all fields

  7. Create a subcollection

    • Fill out all fields 

    • Make it private

  8. Add a resource to a subcollection

  9. Add 'vck6mg', as a subcollection member 

  10. Edit a resource

    • Does it update properly?

  11. Make one resource public

    • Does it now show in for an anonymous/non-logged in user?

  12. Add a kmap subject, places, and terms tag to the public resource.

    • Do the counts adjust in flyout tree? 

    • Do counts adjust in kmaps popovers? 

    • When done, remove the kmap tags and make the resource private again

  13. Add an asset from another tool in Mandala to any WYSIWYG fields. Generally, "description" and "annotation" fields are WYSIWYG editors. 
    • Can you find the asset you're looking for? 
    • Can you use usernames to filter assets?
    • Does the asset appear in the description/image once you Save? 
  14. Go to the http version of the site. It should redirect to the https version. (For example, http://sources.shanti.virginia.edu redirects to https://sources.shanti.virginia.edu)

Specific Testing Areas

Search Flyout

For every test

Evaluating search results

Ask yourself:

  • Are the results what a typical user would expect?

  • Would the results make sense to an easily-confused user?

  • Does the sorting of results make sense?

  • Can you navigate search results by scrolling, clicking Next, etc?

  • Can you click on search results?

  • Can you preview kmaps by hovering over a result?  

Visual appearance of search

  • Make sure icons and texts don’t overlap and are aligned properly.

  • Make sure any animation is smooth, and doesn’t jump or jitter.

For specific tasks and cases

Query scope

  1. Open the search flyout

  2. Click Advanced beneath the search bar

  3. Make some test searches, clicking the options under FILTER: Search Scope Settings

  4. Make sure to evaluate search results using the guidelines above

Case sensitivity of queries

  1. Open the search flyout

  2. Enter several identical search queries with and without capitalization, then check results

  • Make sure to include:

    • Random capitalization in the middle of words

    • Multi-word queries with each word capitalized

    • Multi-word queries with mixed capitalization

Search filters

To test search filters:

  1. Open the search flyout

  2. Enter a search term, then click on Advanced and enter a Select Feature Type. Check results, then perform this step in reverse.

  3. Enter a search term, then click on Advanced and enter a Selected Associated Subject. Check results, then perform this step in reverse.

  4. Enter multiple filters, remove filters, and manipulate them in any way you see fit.

Queries with special characters

  • Test these special characters: " !"#$%&'()*+,-./:;<=>?@[\]^_`{|}~"

  • You should also test a few characters with diacritical marks

  • If you can find a subject that contains a special character in the page tree, try to get it as a result. Here are some examples, though this list is not exhaustive:

    • Subjects (id):

      • Biologies (Biological and Spiritual) (5813)

      • Time & Events (6415)

      • The Secondary Verbs ???? “To Have Time,” and ??? “To Be Time” (5101)

      • Table: The Comparative and Superlative Forms of Adjectives (5208)

      • Equipment, Furniture, & Miscellaneous Things (5645)

      • Audio-Video (6407)

      • Biographies/Catalogs (6421)

    • Places (id):

      • Iran, Islamic Republic of (5239)

      • “A” Stream (11393)

      • Lao People’s Democratic Republic (13519)

      • Timor-Leste (13716)

      • Ramoché (16409)

  • If you cannot find a subject that contains a special character in the page tree, enter the special character in the search bar to make sure the search doesn’t hang -- you want to get a “no results” message, not a “Searching…” message that won’t disappear.

Search persistence

Search persistence refers to the search flyout “remembering” a search you performed, even after you refresh the page. This helps users maintain their workflow. To trigger search persistence:

  1. Enter a search query in the search flyout

  2. Click on a result

  3. Navigate to a different page

    • If search persistence is working, you should see the same search form from step 1 in the flyout

You should ask yourself:

  • Does the search form persists once you navigate to a different page?

  • Can you enter a new search, and does that new search override the old one? Does it persist when you refresh the page?

  • Can you easily clear the search form so it no longer persists?

  • No labels