[FAT-967] Fix test result charts at folio api karate tests Jenkins page Created: 14/Sep/21  Updated: 08/Oct/21  Resolved: 08/Oct/21

Status: Closed
Project: Folio Automation Testing
Components: None
Affects versions: None
Fix versions: None

Type: Task Priority: P3
Reporter: Aliaksei Harbuz Assignee: Hleb Surnovich
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original estimate: Not Specified

Attachments: PNG File image-2021-09-14-11-15-54-682.png    
Issue links:
Relates
relates to FOLIO-3265 Update Jenkins pipeline of folio-api-... Closed
Sprint: DevOps Sprint 123, DevOps Sprint 124
Development Team: FOLIO DevOps

 Description   

After migration to Karate version of  v.1.0.1 the test result chart at folio api karate tests Jenkins page show incorrect data(not all amount of running tests):

According documentation artifacts are generated at target/karate-reports directory. Also it was found that reports also generated at directory with name likes target/karate-reports_1629314729093 so karate v.1.0.1 use timestamp to create report directory.

So the reason of issue may be the incorrect directory to pick up results for chart.

Please, update Jenkins job so reports for chart will be used correctly. 



 Comments   
Comment by Hleb Surnovich [ 07/Oct/21 ]

From now Karate collects its reports in folders with timestamp indeed. This feature in Karate 1.0 has already been discussed here:
https://stackoverflow.com/questions/66685697/karate-summary-reports-not-showing-all-tested-features-after-upgrade-to-1-0-0?noredirect=1&lq=1

where Peter Thompson, the Karate creator, describes the reason for Karate 1.0 and ephasizes, that this is not a bug. I also asked Anton Emelianov to check the summary amount of tests in Cucumber reports directly – summary information remains correct, so the problem is not with Karate, but it seems to be with widget (Test Result Trend). To confirm this theory I need some additional information:
Victoria_Smelova, Drif Abdenour said, that you could help me here. Could you ask our dev teams to check, if they can see all the results, they need, in Cucumber Reports, please? They can take each successful build they want, e.g. this one:

https://jenkins-aws.indexdata.com/job/FOLIO_Reference_Builds/job/folio-api-tests-karate/566/cucumber-html-reports/overview-features.html

Comment by Hleb Surnovich [ 08/Oct/21 ]

As it follows from troubleshooting, the amount of tests in cucumber reports remains correct, while an incorrect number is shown only in widget (Test Results Trend).
Possible missing tests issues along with widget troubleshooting will be resolved as a part of other tickets reported by teams.

Generated at Thu Feb 08 23:26:59 UTC 2024 using Jira 1001.0.0-SNAPSHOT#100246-sha1:7a5c50119eb0633d306e14180817ddef5e80c75d.