fulltext: word splitting and punctuation removal

Description

This CQL query

produces this SQL query:

Note that punctuation like Apostrophe and Right Single Quotation Mark (U+2019) are not removed. This cannot match because Postgres' to_tsvector removes them:

How to fix:
Change the word splitting and ftTerm to work in a similar way as to_tsvector:
https://github.com/folio-org/raml-module-builder/blob/v26.2.0/cql2pgjson/src/main/java/org/folio/cql2pgjson/CQL2PgJSON.java#L671

CSP Request Details

None

CSP Rejection Details

None

Potential Workaround

None

Checklist

hide

TestRail: Results

Activity

Show:

Julian Ladisch August 8, 2019 at 5:35 PM

Postponed to q3.2-2019 as requested by Jakub.

Cate Boerema July 30, 2019 at 9:05 AM

Thanks . Yes, it's important in that we are making a big push to get Inventory search fixed up this quarter () and this seems to be the solution to some known issues (see linked bugs here).

Jakub Skoczen July 29, 2019 at 11:38 AM

It depends on how many spillovers and Q3.1 bug reports we will have in sprint 69. Is this an important issue for you?

Cate Boerema July 29, 2019 at 8:22 AM

Hi is this planned for sprint 69?

Jakub Skoczen July 16, 2019 at 12:24 PM

Thanks, I will put this on P3 because the audit contraint violation and cross-table search is more important.

Done

Details

Assignee

Reporter

Priority

Story Points

Sprint

Development Team

Core: Platform

Fix versions

TestRail: Cases

Open TestRail: Cases

TestRail: Runs

Open TestRail: Runs
Created July 15, 2019 at 5:33 PM
Updated January 3, 2020 at 2:29 PM
Resolved August 12, 2019 at 12:08 PM
TestRail: Cases
TestRail: Runs