[FOLIO-2569] Failing UI regression tests on platform-core#snapshot Created: 22/Apr/20  Updated: 03/Jun/20  Resolved: 04/May/20

Status: Closed
Project: FOLIO
Components: None
Affects versions: None
Fix versions: None

Type: Task Priority: P2
Reporter: Zak Burke Assignee: Zak Burke
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original estimate: Not Specified

Issue links:
Blocks
is blocked by STCLI-148 optional-dependency syntax in MDs is ... Closed
is blocked by FOLIO-2572 Update jenkins-slave-all Jenkins dock... Closed
Cloners
clones FOLIO-2532 Failing UI regression tests on Q1 202... Closed
Sprint: Core: F - Sprint 85, Core: F - Sprint 86, Core: F - Sprint 87
Story Points: 13
Development Team: Prokopovych

 Description   

Running UI regression tests against platform-core#snapshot results in several UI regression tests failures that should be squared. They've been failing for days. Results from 2020-04-21 below.

GitHub/Jira integration appears to work only on the initial PR so here's a link to related PRs.



 Comments   
Comment by Zak Burke [ 22/Apr/20 ]
$ stripes test nightmare stripes.config.js --run WD/checkout/users/inventory/requests/circulation/tenant-settings --uiTest.username diku_admin --uiTest.password admin --show --url https://folio-snapshot.aws.indexdata.com
Using URL https://folio-snapshot.aws.indexdata.com
Starting Nightmare tests...
Host:          https://folio-snapshot.aws.indexdata.com
Username:      diku_admin

[...]

  241 passing (29m)
  47 failing

  1) Exercise users, inventory, checkout, checkin, settings ("exercise")
       Login > Update settings > Find user > Create inventory record > Create holdings record > Create item record > Checkout item > Confirm checkout > Checkin > Confirm checkin > Logout

         it should restore settings
           remove Overdue Fine Policy
             should delete the overdue fine policy:
     Error: .wait() timed out after 30000msec
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  2) Exercise users, inventory, checkout, checkin, settings ("exercise")
       Login > Update settings > Find user > Create inventory record > Create holdings record > Create item record > Checkout item > Confirm checkout > Checkin > Confirm checkin > Logout

         it should restore settings
           remove Lost Item Fee Policy
             should delete the lost item policy:
     Error: .wait() timed out after 30000msec
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  3) Exercise users, inventory, checkout, checkin, settings ("exercise")
       Login > Update settings > Find user > Create inventory record > Create holdings record > Create item record > Checkout item > Confirm checkout > Checkin > Confirm checkin > Logout

         it should restore settings
           remove Notice Policy
             should delete the notice policy:
     Error: .wait() timed out after 30000msec
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  4) Checkout many items to a single user ("many-items")
       it should restore settings
         remove Overdue Fine Policy
           should delete the overdue fine policy:
     Error: .wait() timed out after 30000msec
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  5) Checkout many items to a single user ("many-items")
       it should restore settings
         remove Lost Item Fee Policy
           should delete the lost item policy:
     Error: .wait() timed out after 30000msec
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  6) Checkout many items to a single user ("many-items")
       it should restore settings
         remove Notice Policy
           should delete the notice policy:
     Error: .wait() timed out after 30000msec
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  7) Tests to validate the loan renewals ("loan-renewal")
       Renew failure
         edit loan policy to renew from system date:
     Error: Could not find the loan policy test-policy-1031 to edit
      at fn (:12:21)
      at javascript (:31:21)
      at :46:3
      at EventEmitter.electron.ipcRenderer.on (node_modules/electron/dist/resources/electron.asar/renderer/web-frame-init.js:36:30)

  8) Tests to validate the loan renewals ("loan-renewal")
       Renew failure
         should fail the renewal:
     Error: Expected "Item not renewed:renewal would not change the due date"; got "Item not renewed:loan at maximum renewal number"
      at fn (:11:25)
      at javascript (:27:21)
      at :42:3
      at EventEmitter.electron.ipcRenderer.on (node_modules/electron/dist/resources/electron.asar/renderer/web-frame-init.js:36:30)

  9) Tests to validate the loan renewals ("loan-renewal")
       Assign fixed due date schedule to loan policy
         assign the fixed due date schedule (test-schedule-8627) to the loan policy:
     Error: Could not find the loan policy test-policy-1031 to edit
      at fn (:12:21)
      at javascript (:31:21)
      at :46:3
      at EventEmitter.electron.ipcRenderer.on (node_modules/electron/dist/resources/electron.asar/renderer/web-frame-init.js:36:30)

  10) Tests to validate the loan renewals ("loan-renewal")
       Renew failure
         Renewal should fail as renewal date falls outside of the date ranges:
     Error: Expected Loan cannot be renewed because: renewal date falls outside of the date ranges in the loan policy error message
      at fn (:10:25)
      at javascript (:26:21)
      at :41:3
      at EventEmitter.electron.ipcRenderer.on (node_modules/electron/dist/resources/electron.asar/renderer/web-frame-init.js:36:30)

  11) Tests to validate the loan renewals ("loan-renewal")
       it should restore settings
         remove Overdue Fine Policy
           should delete the overdue fine policy:
     Error: .wait() timed out after 30000msec
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  12) Tests to validate the loan renewals ("loan-renewal")
       it should restore settings
         remove Lost Item Fee Policy
           should delete the lost item policy:
     Error: .wait() timed out after 30000msec
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  13) Tests to validate the loan renewals ("loan-renewal")
       it should restore settings
         remove Notice Policy
           should delete the notice policy:
     Error: .wait() timed out after 30000msec
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  14) Tests to validate the loan renewals ("loan-renewal")
       it should restore settings
         remove loan policy
           should delete the loan policy:
     Error: .wait() timed out after 30000msec
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  15) Tests to validate the loan renewals ("loan-renewal")
       it should restore settings
         remove request policy
           should delete the request policy:
     Error: .wait() timed out after 30000msec
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  16) Tests to validate the loan renewals ("loan-renewal")
       it should restore settings
         Delete fixed due date schedule
           should delete the fixed due date schedule:
     Error: .wait() timed out after 30000msec
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  17) New request ("new-request")
       Login > Open module "Requests" > Create new request > Logout
         restore settings
           remove Overdue Fine Policy
             should delete the overdue fine policy:
     Error: .wait() timed out after 30000msec
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  18) New request ("new-request")
       Login > Open module "Requests" > Create new request > Logout
         restore settings
           remove Lost Item Fee Policy
             should delete the lost item policy:
     Error: .wait() timed out after 30000msec
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  19) New request ("new-request")
       Login > Open module "Requests" > Create new request > Logout
         restore settings
           remove Notice Policy
             should delete the notice policy:
     Error: .wait() timed out after 30000msec
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  20) Module test: users:new-user
       Login > Create new user > Logout > Login as new user > Logout > Login > Edit new user and confirm changes
         should create a user: ejones1587527244410/ejones1587527244410:
     Error: .wait() for #clickable-toggle-password timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  21) Module test: users:new-user
       Login > Create new user > Logout > Login as new user > Logout > Login > Edit new user and confirm changes
         should login as ejones1587527244410/ejones1587527244410:
     Error: .wait() for #clickable-logout timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  22) Module test: users:new-user
       Login > Create new user > Logout > Login as new user > Logout > Login > Edit new user and confirm changes
         should logout:
     Error: .wait() for #clickable-logout timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  23) Module test: users:new-user
       Login > Create new user > Logout > Login as new user > Logout > Login > Edit new user and confirm changes
         should login as diku_admin/admin:
     Error: .wait() for #clickable-logout timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  24) Module test: users:new-user
       Login > Create new user > Logout > Login as new user > Logout > Login > Edit new user and confirm changes
         should navigate to users:
     Error: .wait() for #app-list-item-clickable-users-module timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  25) Module test: users:new-user
       Login > Create new user > Logout > Login as new user > Logout > Login > Edit new user and confirm changes
         should change username for ejones1587527244410:
     Error: .wait() for #input-user-search timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  26) Module test: users:new-user
       Login > Create new user > Logout > Login as new user > Logout > Login > Edit new user and confirm changes
         should logout:
     Error: .wait() for #clickable-logout timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  27) Module test: users:new-user
       Login > Create new user > Logout > Login as new user > Logout > Login > Edit new user and confirm changes
         Should login as ejones1587527244410x/ejones1587527244410:
     Error: .wait() for #clickable-logout timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  28) Module test: users:new-user
       "after all" hook:
     Error: Unable to find element by selector: #clickable-logout
      at fn (:9:15)
      at javascript (:34:21)
      at :49:3
      at EventEmitter.electron.ipcRenderer.on (node_modules/electron/dist/resources/electron.asar/renderer/web-frame-init.js:36:30)

  29) Module test: users:new-permission-set
       Login > Create new permission set > Confirm creation > Delete permission set > Confirm deletion > Logout

         should confirm creation of new permission set:
     Error: Could not find the permission set Circulation employee-9575
      at fn (:12:21)
      at javascript (:28:21)
      at :43:3
      at EventEmitter.electron.ipcRenderer.on (node_modules/electron/dist/resources/electron.asar/renderer/web-frame-init.js:36:30)

  30) Module test: users:new-permission-set
       Login > Create new permission set > Confirm creation > Delete permission set > Confirm deletion > Logout

         should delete new permission set:
     Error: Unable to find element by selector: #clickable-edit-item
      at fn (:9:15)
      at javascript (:34:21)
      at :49:3
      at EventEmitter.electron.ipcRenderer.on (node_modules/electron/dist/resources/electron.asar/renderer/web-frame-init.js:36:30)

  31) Module test: inventory:new-title
       Login > Open module "Inventory" > Create new instance > Sort list by title > Confirm creation of new title > Logout
         should create new instance :
     Error: .wait() for [data-test-inventory-instances] #paneHeaderpane-results [data-test-pane-header-actions-button] timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  32) Module test: inventory:new-title
       Login > Open module "Inventory" > Create new instance > Sort list by title > Confirm creation of new title > Logout
         should find new title in list :
     Error: .wait() for #list-inventory[data-total-count] timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  33) Module test: inventory:search
       Login > Click inventory > Create 2 instance records > Conduct multiple searches > Logout

         should create inventory record:
     Error: .wait() for [data-test-inventory-instances] #paneHeaderpane-results [data-test-pane-header-actions-button] timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  34) Module test: inventory:search
       Login > Click inventory > Create 2 instance records > Conduct multiple searches > Logout

         should create inventory record:
     Error: .wait() for [data-test-inventory-instances] #paneHeaderpane-results [data-test-pane-header-actions-button] timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  35) Module test: inventory:search
       Login > Click inventory > Create 2 instance records > Conduct multiple searches > Logout

         should search "All" for "supercalifragilisticexpialidocious" and find multiple records:
     Error: .wait() for #list-inventory[data-total-count] timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  36) Module test: inventory:search
       Login > Click inventory > Create 2 instance records > Conduct multiple searches > Logout

         should search "Title" for "supercalifragilisticexpialidocious":
     Error: .wait() for #list-inventory[data-total-count] timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  37) Module test: inventory:search
       Login > Click inventory > Create 2 instance records > Conduct multiple searches > Logout

         should search "Title" for "supercalifragilisticexpialidocious 3379757305699615":
     Error: .wait() for #list-inventory[data-total-count="1"] timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  38) Module test: inventory:search
       Login > Click inventory > Create 2 instance records > Conduct multiple searches > Logout

         should search "Contributor" for "supercalifragilisticexpialidocious":
     Error: .wait() for #list-inventory[data-total-count] timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  39) Module test: inventory:search
       Login > Click inventory > Create 2 instance records > Conduct multiple searches > Logout

         should search "Contributor" for "supercalifragilisticexpialidocious 1310185354526813":
     Error: .wait() for #list-inventory[data-total-count="1"] timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  40) Module test: tenant-settings:locations
       Login > Add new institution, campus, library, location > Try to delete institution > Delete location > Try to delete institution again > Logout

         should delete the location "Bowdoin College Test Location 9707":
     Error: .wait() for #clickable-edit-item timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  41) Module test: tenant-settings:locations
       Login > Add new institution, campus, library, location > Try to delete institution > Delete location > Try to delete institution again > Logout

         should confirm deletion:
     Error: .wait() for [class*=mclEmptyMessage] timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  42) Module test: tenant-settings:locations
       Login > Add new institution, campus, library, location > Try to delete institution > Delete location > Try to delete institution again > Logout

         should delete the library "Hawthorne-Longfellow 2472":
     Error: .wait() for #OverlayContainer button[icon="times"] timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  43) Module test: tenant-settings:locations
       Login > Add new institution, campus, library, location > Try to delete institution > Delete location > Try to delete institution again > Logout

         should confirm the library has been deleted:
     Error: .wait() timed out after 30000msec
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  44) Module test: tenant-settings:locations
       Login > Add new institution, campus, library, location > Try to delete institution > Delete location > Try to delete institution again > Logout

         should delete the campus "Brunswick 7254":
     Error: .wait() for #OverlayContainer button[icon="times"] timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  45) Module test: tenant-settings:locations
       Login > Add new institution, campus, library, location > Try to delete institution > Delete location > Try to delete institution again > Logout

         should confirm the campus has been deleted:
     Error: .wait() timed out after 30000msec
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  46) Module test: tenant-settings:locations
       Login > Add new institution, campus, library, location > Try to delete institution > Delete location > Try to delete institution again > Logout

         should delete the institution "Bowdoin College 1060":
     Error: .wait() for #OverlayContainer button[icon="times"] timed out after 30000msec
      at newDone (node_modules/nightmare/lib/actions.js:545:9)
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

  47) Module test: tenant-settings:locations
       Login > Add new institution, campus, library, location > Try to delete institution > Delete location > Try to delete institution again > Logout

         should confirm the institution has been deleted:
     Error: .wait() timed out after 30000msec
      at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
      at listOnTimeout (internal/timers.js:549:17)
      at processTimers (internal/timers.js:492:7)

Some tests failed or something went wrong while attempting to run the tests.
47
exiting process with failure(1)
error Command failed with exit code 1.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.
Comment by Zak Burke [ 23/Apr/20 ]

The only remaining failures are all in the tenant-settings/locations test, but that module can't be published ATM due to Okapi refusing to accept MDs with optional interfaces defined.

Comment by Zak Burke [ 24/Apr/20 ]

Thanks to David Crossley's quick work on FOLIO-2572 Closed yesterday, this is now unblocked and, fingers-crossed, we'll see passing tests tonight.

Comment by Cate Boerema (Inactive) [ 04/May/20 ]

Zak Burke this is In review. Is there something for manual testers to test? If not, let's close it.

Generated at Thu Feb 08 23:21:37 UTC 2024 using Jira 1001.0.0-SNAPSHOT#100246-sha1:7a5c50119eb0633d306e14180817ddef5e80c75d.