[FOLIO-2532] Failing UI regression tests on Q1 2020 release platform-core Created: 24/Mar/20 Updated: 03/Jun/20 Resolved: 23/Apr/20 |
|
| Status: | Closed |
| Project: | FOLIO |
| Components: | None |
| Affects versions: | None |
| Fix versions: | None |
| Type: | Task | Priority: | P2 |
| Reporter: | John Malconian | Assignee: | Zak Burke |
| Resolution: | Won't Do | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original estimate: | Not Specified | ||
| Issue links: |
|
||||||||
| Sprint: | Core: F - Sprint 85, Core: F - Sprint 86, Core: F - Sprint 87 | ||||||||
| Story Points: | 13 | ||||||||
| Development Team: | Prokopovych | ||||||||
| Description |
|
UI Regression tests have been disabled as part of the PR check for platform-core so that I could integrate all Q1 releases into a release branch. Running UI regression tests against Q1 2020 instances results in several UI regression tests failures that should be squared. Results of tests below. |
| Comments |
| Comment by John Malconian [ 24/Mar/20 ] |
|
First set of results against Q1 2020 release: jenkins@eedfe49a4a5f:~/platform-core$ xvfb-run '--server-args=-screen 0 1024x768x24' yarn test-regression --uiTest.username platform_core_552_6_admin --uiTest.password admin --show --url https://platform-core-552.s3.amazonaws.com/index.html
yarn run v1.16.0
$ stripes test nightmare stripes.config.js --run WD/checkout/users/inventory/requests/circulation/tenant-settings --uiTest.username platform_core_552_6_admin --uiTest.password admin --show --url https://platform-core-552.s3.amazonaws.com/index.html
Using URL https://platform-core-552.s3.amazonaws.com/index.html
Starting Nightmare tests...
Host: https://platform-core-552.s3.amazonaws.com/index.html
Username: platform_core_552_6_admin
Login Page ("auth-fail")
given bad data
✓ Should find a login error message (4202ms)
Codex ("codex-search")
Login > Codex Search > Filtering Results > Reset Search > Logout
✓ should login as platform_core_552_6_admin/admin (4816ms)
✓ should navigate to codex-search (422ms)
✓ should open codex search and execute search (3198ms)
✓ should filter results and find 0 results (351ms)
✓ should remove filter results and find results (315ms)
✓ should reset search (70ms)
✓ should logout (108ms)
Checking for dependency issues on FOLIO UI App /about ("dependencies")
Login > Click "About" link > Check for dependency errors > Logout
✓ should login (5008ms)
✓ should navigate to checkin (361ms)
✓ should load "about" page (688ms)
✓ should check for "red" errors
✓ should check for "orange" errors
✓ should logout (111ms)
Exercise users, inventory, checkout, checkin, settings ("exercise")
Login > Update settings > Find user > Create inventory record > Create holdings record > Create item record > Checkout item > Confirm checkout > Checkin > Confirm checkin > Logout
✓ should login as platform_core_552_6_admin/admin (4534ms)
✓ should configure checkout for barcode and username (1403ms)
✓ should navigate to settings (39ms)
✓ should configure circulation rules (849ms)
✓ should navigate to users (322ms)
✓ should find an active user (1110ms)
Found user 194710970216014
✓ should find current loans count (2759ms)
Open loans: 0
✓ should find closed loans count (226ms)
Closed loans: 0
✓ should create instance record (6724ms)
✓ should create holdings record (3392ms)
1) should create item record with barcode '1585067306093655658'
✓ should navigate to checkout (1267ms)
2) should check out 1585067306093655658
✓ should navigate to users (2315ms)
3) should change open-loan count
4) should find 1585067306093655658 in open loans
✓ should navigate to checkin (238ms)
5) should check in 1585067306093655658
✓ should navigate to users (2266ms)
6) should change closed-loan count
7) should confirm 1585067306093655658 in closed loans
✓ should navigate to settings (647ms)
✓ should restore the circulation rules (883ms)
✓ should logout (147ms)
Checkout many items to a single user ("many-items")
✓ should login as platform_core_552_6_admin/admin (4842ms)
create 21 item records
✓ should create instance record (4931ms)
✓ should create holdings record (3116ms)
8) should create item record with barcode '1585067306094570217'
9) should create item record with barcode '1585067306094846829'
10) should create item record with barcode '1585067306094776028'
11) should create item record with barcode '1585067306094397170'
12) should create item record with barcode '1585067306095554203'
13) should create item record with barcode '1585067306095293350'
14) should create item record with barcode '1585067306095875558'
✓ should create item record with barcode '158506730609569655' (7175ms)
✓ should create item record with barcode '1585067306095800800' (7457ms)
✓ should create item record with barcode '1585067306095620885' (6721ms)
✓ should create item record with barcode '1585067306095420731' (7157ms)
✓ should create item record with barcode '1585067306095562831' (6930ms)
✓ should create item record with barcode '1585067306095863068' (7192ms)
✓ should create item record with barcode '1585067306095268262' (6745ms)
✓ should create item record with barcode '1585067306095679972' (7147ms)
✓ should create item record with barcode '1585067306095412975' (6898ms)
✓ should create item record with barcode '1585067306095460259' (6907ms)
✓ should create item record with barcode '1585067306095108302' (7140ms)
✓ should create item record with barcode '1585067306095651059' (7088ms)
✓ should create item record with barcode '1585067306095653855' (6609ms)
✓ should create item record with barcode '158506730609571559' (7355ms)
retrieve an active user
✓ should navigate to users (233ms)
✓ should find an active user (1438ms)
Found user 997383903573496
checkout items
✓ should navigate to checkout (1200ms)
✓ should checkout 21 items (501ms)
logout
15) should logout
Tests to validate the loan renewals ("loan-renewal")
Validate renewal success/failure with a variety of loan policies, schedules, and circulation rules
Login
✓ should login as platform_core_552_6_admin/admin (8121ms)
Update settings
✓ should configure checkout for barcode and username (1648ms)
✓ should configure US English locale and timezone (5499ms)
Create loan policy
✓ should navigate to settings
✓ should reach "Create loan policy" page (307ms)
✓ should create a new loan policy (test-policy-8010) with renewalLimit of 1 (3093ms)
Create notice policy
✓ should navigate to settings (139ms)
✓ should reach "Create notice policy" page (290ms)
✓ should create a new notice policy (test-notice-policy-1277) (2945ms)
Create request policy
✓ should navigate to settings (124ms)
✓ should reach "Create request policy" page (185ms)
✓ should create a new request policy (test-request-policy-4465) (2980ms)
Apply circulation rule
✓ should navigate to settings (123ms)
✓ should reach "Circulation rules" page (277ms)
✓ Apply the loan policy created as a circulation rule to material-type book (919ms)
Find Active user
✓ should navigate to users (269ms)
✓ should find an active user (1533ms)
Found user 194710970216014
Create inventory > holdings > item records
✓ should create instance record (5688ms)
✓ should create holdings record (3464ms)
16) should create item record with barcode '1585067306107151565'
Checkout item
✓ should navigate to checkout (1297ms)
17) should check out 1585067306107151565 to user
Confirm checkout
✓ should navigate to users (386ms)
18) should find 1585067306107151565 in user's open loans
Renew success
19) should renew the loan and succeed
Renew failure
20) should renew the loan second time and hit the renewal limit
Renew failure
✓ should navigate to settings (708ms)
✓ should reach "loan policy settings" page (183ms)
✓ edit loan policy to renew from system date (4257ms)
✓ should navigate to users (1288ms)
21) should fail the renewal
Create fixed due date schedule
✓ should navigate to settings (327ms)
✓ should create a new fixed due date schedule (2974ms)
Assign fixed due date schedule to loan policy
✓ assign the fixed due date schedule (test-schedule-8279) to the loan policy (4779ms)
Renew failure
✓ should navigate to users (757ms)
22) Renewal should fail as renewal date falls outside of the date ranges
Check in
✓ should navigate to checkin (275ms)
23) should check in 1585067306107151565
Restore the circulation rules
✓ should navigate to settings (328ms)
✓ should restore the circulation rules (725ms)
Delete loan policy
✓ should delete the loan policy (2840ms)
Delete fixed due date schedule
✓ should delete the fixed due date schedule (8768ms)
Delete request policy
✓ should delete the request policy (7968ms)
Delete notice policy
✓ should delete the notice policy (7773ms)
logout
✓ should logout (133ms)
User proxies ("new-proxy")
Login > Find user two users > Add proxy to user 1 > Delete sponsor in user 2 > Logout
✓ should navigate to users (569ms)
✓ should find an active user (sponsor) (1660ms)
Found sponsor 194710970216014
✓ should add a proxy to sponsor (6594ms)
✓ should delete a sponsor of user 2 (5795ms)
New request ("new-request")
Login > Open module "Requests" > Create new request > Logout
✓ should navigate to settings (443ms)
✓ should configure default circulation rules (1092ms)
✓ should navigate to users (1331ms)
✓ should find an active user barcode for checkout (1473ms)
Found 236964750970123
✓ should find an active user barcode for request
Found 775671613439016
✓ should create instance record (6074ms)
✓ should create holdings record (3064ms)
24) should create item record with barcode '1585067306120658353'
✓ should navigate to checkout (1258ms)
25) should check out newly created item
✓ should navigate to requests (1770ms)
26) should add a new "Hold" request
27) should find new request in requests list
✓ should navigate to settings
28) should restore initial circulation rules
Module test: checkout ("error-messages").
Open app > Trigger error messages > Logout
Test suite @folio/checkout:3.0.0
Live module @folio/checkout:3.0.0 (https://platform-core-552.s3.amazonaws.com/index.html)
✓ should open app and find module version tag (453ms)
✓ should navigate to settings (331ms)
✓ should navigate to checkout (281ms)
✓ should show error when scanning item before patron card (106ms)
✓ should navigate to settings (48ms)
✓ should navigate to checkout (102ms)
✓ should show error when entering wrong patron ID (323ms)
✓ should configure checkout for barcode and username (944ms)
✓ should navigate to users (255ms)
✓ should find an active user barcode (1482ms)
✓ should navigate to checkout (130ms)
✓ should find existing patron (1019ms)
✓ should show error when entering wrong item ID (856ms)
Module test: users:patron-group
Login > Add new patron group > Assign to user > Try to delete patron group > Unassign from user > Try to delete again > Logout
✓ should navigate to settings (404ms)
✓ should create a patron group for "Alumni" (5802ms)
✓ should navigate to users (251ms)
✓ should find an active user to edit (820ms)
(found user ID 680311830975018)
✓ should find patron group ID for "alumni_5192" (5765ms)
(found patron group ID 6d51e9d9-593c-477a-8b9d-78437c074e1b)
✓ should edit user record using "alumni_5192" group (3223ms)
✓ should find patron group ID for "staff" (4102ms)
(found patron group ID 6d51e9d9-593c-477a-8b9d-78437c074e1b)
✓ should change patron group to "Staff" in user record (3639ms)
✓ should navigate to settings (1433ms)
✓ should delete "alumni_5192" patron group (1610ms)
✓ should confirm that "alumni_5192" patron group has been deleted (1118ms)
Module test: users:new-user
Login > Create new user > Logout > Login as new user > Logout > Login > Edit new user and confirm changes
✓ should load login page (5708ms)
✓ should login as platform_core_552_6_admin/admin (1917ms)
✓ should navigate to users (444ms)
✓ should extract a patron group value (976ms)
✓ should create a user: ajohnson1585067306131/ajohnson1585067306131 (4007ms)
✓ should logout (604ms)
✓ should login as ajohnson1585067306131/ajohnson1585067306131 (566ms)
✓ should logout (616ms)
✓ should login as platform_core_552_6_admin/admin (597ms)
✓ should navigate to users (263ms)
✓ should change username for ajohnson1585067306131 (8012ms)
✓ should logout (835ms)
✓ Should login as ajohnson1585067306131x/ajohnson1585067306131 (791ms)
Module test: users:new-permission-set
Login > Create new permission set > Confirm creation > Delete permission set > Confirm deletion > Logout
✓ should navigate to settings (493ms)
✓ should create a new permission set (2268ms)
✓ should navigate to settings (120ms)
✓ should confirm creation of new permission set (1056ms)
✓ should delete new permission set (1442ms)
ID of deleted permission set: fce96a71-85df-4639-8b57-68a2c4150d6d
✓ should confirm deletion (791ms)
Module test: inventory:new-title
Login > Open module "Inventory" > Create new instance > Sort list by title > Confirm creation of new title > Logout
✓ should navigate to inventory (796ms)
✓ should create new instance (6962ms)
✓ should create instance record (4533ms)
✓ should create holdings record (2955ms)
29) should create item record with barcode '1585067306137631353'
30) should find new title in list
Module test: inventory:filters
Login > Open module "Inventory" > Get hit counts > Click filters > Logout
Test suite @folio/inventory:2.0.0
Live module @folio/inventory:2.0.0 (https://platform-core-552.s3.amazonaws.com/index.html)
✓ should open module "Inventory" and find version tag (703ms)
Should test instance language filters
✓ should navigate to inventory's instance segment" (1649ms)
✓ should find no results
✓ should filter results by language (English) (1730ms)
✓ should filter results by language (Spanish) (1288ms)
Should test holdings permanent location filters
✓ should navigate to inventory's holdings segment" (355ms)
✓ should find no results
✓ should filter results by location (Annex) (1191ms)
✓ should filter results by location (Main Library) (1124ms)
Should test items item-status filters
✓ should navigate to inventory's items segment" (375ms)
✓ should find no results
✓ should filter results by location (itemStatus-available) (1104ms)
✓ should filter results by location (itemStatus-checked-out) (1068ms)
Module test: inventory:search
Login > Click inventory > Create 2 instance records > Conduct multiple searches > Logout
Test suite @folio/inventory:2.0.0
Live module @folio/inventory:2.0.0 (https://platform-core-552.s3.amazonaws.com/index.html)
✓ should open module "Inventory" and find version tag (680ms)
✓ should find "no results" message with no filters applied (982ms)
✓ should create inventory record (4687ms)
✓ should create inventory record (4729ms)
✓ should search "All" for "supercalifragilisticexpialidocious" and find multiple records (2618ms)
✓ should click "reset all" button (524ms)
✓ should search "Title" for "supercalifragilisticexpialidocious" (1084ms)
✓ should click "reset all" button (426ms)
✓ should search "Title" for "supercalifragilisticexpialidocious 888992695938143" (1452ms)
✓ should click "reset all" button (458ms)
✓ should search "Contributor" for "supercalifragilisticexpialidocious" (1576ms)
✓ should click "reset all" button (423ms)
✓ should search "Contributor" for "supercalifragilisticexpialidocious 6320561056435361" (1563ms)
Module test: requests:filters
Login > Open module "Requests" > Get hit counts > Click filters > Logout
Test suite @folio/requests:2.0.1
Live module @folio/requests:2.0.1 (https://platform-core-552.s3.amazonaws.com/index.html)
✓ should open module "Requests" and find version tag (679ms)
✓ should find "choose a filter" message
Module test: circulation:settings
Login > Open Circulation settings > Logout
✓ should open Circulation settings, Loan policies (2834ms)
Module test: tenant-settings:locations
Login > Add new institution, campus, library, location > Try to delete institution > Delete location > Try to delete institution again > Logout
✓ should create an institution "Bowdoin College 7326" (1850ms)
(found institution ID 8dfd4440-7dbe-408d-96f9-e3feb5285406 for Bowdoin College 7326
✓ should create a campus "Brunswick 9980" (1669ms)
(found campus ID 7cf30d35-b0fb-4d52-914f-db1aba2f7be0 for Brunswick 9980
✓ should create a library "Hawthorne-Longfellow 5398" (2418ms)
(found library ID 8c316a5e-bc6f-4455-907b-9eb317037b42 for Hawthorne-Longfellow 5398
✓ should create a location "Bowdoin College Test Location 8924" (5011ms)
(found location ID f324c7f3-6e36-4424-81f8-c65f511806b6 for Bowdoin College Test Location 8924
✓ should confirm creation of new location (1010ms)
✓ should fail to delete institution "Bowdoin College 7326" (6515ms)
✓ should fail to delete campus "Brunswick 9980" (3821ms)
✓ should fail to delete library "Hawthorne-Longfellow 5398" (3574ms)
✓ should delete the location "Bowdoin College Test Location 8924" (2725ms)
✓ should confirm deletion (3535ms)
✓ should delete the library "Hawthorne-Longfellow 5398" (4418ms)
✓ should confirm the library has been deleted (228ms)
✓ should delete the campus "Brunswick 9980" (5344ms)
✓ should confirm the campus has been deleted (233ms)
✓ should delete the institution "Bowdoin College 7326" (5471ms)
✓ should confirm the institution has been deleted (231ms)
195 passing (23m)
30 failing
1) Exercise users, inventory, checkout, checkin, settings ("exercise")
Login > Update settings > Find user > Create inventory record > Create holdings record > Create item record > Checkout item > Confirm checkout > Checkin > Confirm checkin > Logout
should create item record with barcode '1585067306093655658':
Error: .wait() for #clickable-new-item timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
2) Exercise users, inventory, checkout, checkin, settings ("exercise")
Login > Update settings > Find user > Create inventory record > Create holdings record > Create item record > Checkout item > Confirm checkout > Checkin > Confirm checkin > Logout
should check out 1585067306093655658:
Error: .wait() for #list-items-checked-out timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
3) Exercise users, inventory, checkout, checkin, settings ("exercise")
Login > Update settings > Find user > Create inventory record > Create holdings record > Create item record > Checkout item > Confirm checkout > Checkin > Confirm checkin > Logout
should change open-loan count:
Error: Open loan count did not change.
at nightmare.wait.insert.wait.click.wait.insert.wait.click.wait.wait.wait.click.wait.evaluate.then (test/ui-testing/exercise.js:119:21)
at process._tickCallback (internal/process/next_tick.js:68:7)
4) Exercise users, inventory, checkout, checkin, settings ("exercise")
Login > Update settings > Find user > Create inventory record > Create holdings record > Create item record > Checkout item > Confirm checkout > Checkin > Confirm checkin > Logout
should find 1585067306093655658 in open loans:
Error: .wait() timed out after 30000msec
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
5) Exercise users, inventory, checkout, checkin, settings ("exercise")
Login > Update settings > Find user > Create inventory record > Create holdings record > Create item record > Checkout item > Confirm checkout > Checkin > Confirm checkin > Logout
should check in 1585067306093655658:
Error: .wait() for #list-items-checked-in timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
6) Exercise users, inventory, checkout, checkin, settings ("exercise")
Login > Update settings > Find user > Create inventory record > Create holdings record > Create item record > Checkout item > Confirm checkout > Checkin > Confirm checkin > Logout
should change closed-loan count:
Error: .wait() for #pane-userdetails timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
7) Exercise users, inventory, checkout, checkin, settings ("exercise")
Login > Update settings > Find user > Create inventory record > Create holdings record > Create item record > Checkout item > Confirm checkout > Checkin > Confirm checkin > Logout
should confirm 1585067306093655658 in closed loans:
Error: .wait() for #clickable-viewclosedloans timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
8) Checkout many items to a single user ("many-items")
create 21 item records
should create item record with barcode '1585067306094570217':
Error: .wait() for #clickable-new-item timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
9) Checkout many items to a single user ("many-items")
create 21 item records
should create item record with barcode '1585067306094846829':
Error: .wait() for #clickable-new-item timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
10) Checkout many items to a single user ("many-items")
create 21 item records
should create item record with barcode '1585067306094776028':
Error: .wait() for #clickable-new-item timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
11) Checkout many items to a single user ("many-items")
create 21 item records
should create item record with barcode '1585067306094397170':
Error: .wait() for #clickable-new-item timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
12) Checkout many items to a single user ("many-items")
create 21 item records
should create item record with barcode '1585067306095554203':
Error: .wait() for #clickable-new-item timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
13) Checkout many items to a single user ("many-items")
create 21 item records
should create item record with barcode '1585067306095293350':
Error: .wait() for #clickable-new-item timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
14) Checkout many items to a single user ("many-items")
create 21 item records
should create item record with barcode '1585067306095875558':
Error: .wait() for #clickable-new-item timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
15) Checkout many items to a single user ("many-items")
logout
should logout:
Error: .wait() for #list-items-checked-out timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
16) Tests to validate the loan renewals ("loan-renewal")
Validate renewal success/failure with a variety of loan policies, schedules, and circulation rules
Create inventory > holdings > item records
should create item record with barcode '1585067306107151565':
Error: .wait() for #clickable-new-item timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
17) Tests to validate the loan renewals ("loan-renewal")
Validate renewal success/failure with a variety of loan policies, schedules, and circulation rules
Checkout item
should check out 1585067306107151565 to user:
Error: .wait() for #list-items-checked-out timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
18) Tests to validate the loan renewals ("loan-renewal")
Validate renewal success/failure with a variety of loan policies, schedules, and circulation rules
Confirm checkout
should find 1585067306107151565 in user's open loans:
Error: .wait() for #list-users[data-total-count="1"] a[role="row"] timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
19) Tests to validate the loan renewals ("loan-renewal")
Validate renewal success/failure with a variety of loan policies, schedules, and circulation rules
Renew success
should renew the loan and succeed:
Error: .wait() for #list-loanshistory timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
20) Tests to validate the loan renewals ("loan-renewal")
Validate renewal success/failure with a variety of loan policies, schedules, and circulation rules
Renew failure
should renew the loan second time and hit the renewal limit:
Error: .wait() for #list-loanshistory timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
21) Tests to validate the loan renewals ("loan-renewal")
Validate renewal success/failure with a variety of loan policies, schedules, and circulation rules
Renew failure
should fail the renewal:
Error: .wait() timed out after 30000msec
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
22) Tests to validate the loan renewals ("loan-renewal")
Validate renewal success/failure with a variety of loan policies, schedules, and circulation rules
Renew failure
Renewal should fail as renewal date falls outside of the date ranges:
Error: .wait() timed out after 30000msec
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:10)
23) Tests to validate the loan renewals ("loan-renewal")
Validate renewal success/failure with a variety of loan policies, schedules, and circulation rules
Check in
should check in 1585067306107151565:
Error: .wait() for #list-items-checked-in timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
24) New request ("new-request")
Login > Open module "Requests" > Create new request > Logout
should create item record with barcode '1585067306120658353':
Error: .wait() for #clickable-new-item timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
25) New request ("new-request")
Login > Open module "Requests" > Create new request > Logout
should check out newly created item:
Error: .wait() for #list-items-checked-out timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
26) New request ("new-request")
Login > Open module "Requests" > Create new request > Logout
should add a new "Hold" request:
Error: .wait() for #section-item-info a[href^="/inventory/view/"] timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
27) New request ("new-request")
Login > Open module "Requests" > Create new request > Logout
should find new request in requests list:
Error: .wait() for #list-requests[data-total-count="1"] timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
28) New request ("new-request")
Login > Open module "Requests" > Create new request > Logout
should restore initial circulation rules:
Error: .wait() for a[href="/settings/circulation"] timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
29) Module test: inventory:new-title
Login > Open module "Inventory" > Create new instance > Sort list by title > Confirm creation of new title > Logout
should create item record with barcode '1585067306137631353':
Error: .wait() for #clickable-new-item timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
30) Module test: inventory:new-title
Login > Open module "Inventory" > Create new instance > Sort list by title > Confirm creation of new title > Logout
should find new title in list :
Error: .wait() for #input-inventory-search timed out after 30000msec
at newDone (node_modules/nightmare/lib/actions.js:545:9)
at Timeout._onTimeout (node_modules/nightmare/lib/actions.js:578:5)
Some tests failed or something went wrong while attempting to run the tests.
30
exiting process with failure(1)
error Command failed with exit code 1.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.
|
| Comment by Zak Burke [ 22/Apr/20 ] |
|
Honestly, I gave up on integration tests for this release. I'm not sure what the right thing to do for this ticket is. Do we want to consider jumping in again to try to get them working for the patch release? I've made good progress getting things running against the snapshot branch in
|
| Comment by Cate Boerema (Inactive) [ 23/Apr/20 ] |
|
Thanks Zak Burke. We cut the Q1 release with the nightmare tests broken? I think this begs the question (again) as to whether these tests are really worth the effort to maintain them. It feels to me like you spend virtually all of your time maintaining these tests. If broken tests aren't going to hold up a release, why do we spend so much time maintaining them in the first place? |
| Comment by Zak Burke [ 23/Apr/20 ] |
|
I can't argue with any of that, Cate Boerema. Anton Emelianov, what do you think about this; with steadily increasing BigTest coverage, are the nightmare tests worth maintaining? Cate is right that it can take a lot of effort, though that goes in waves. I got pulled in many directions at managed my time poorly. Tests are passing again on snapshot with one exception due to
|
| Comment by Cate Boerema (Inactive) [ 23/Apr/20 ] |
|
Zak Burke it was agreed (Jakub Skoczen, Anton Emelianov etc) that it's not critical to get the regression tests running for the hotfix. Also, there will be a meeting scheduled to discuss the benefit and future of Nightmare tests. I'll close this as Won't do. Thanks! |