Exact phrase searching requirements

https://folio-org.atlassian.net/browse/UXPROD-4974

Purpose: In current implementation, exact phrase searching is not supported in basic search, and though it is a search modifier in both advanced search and query search, fuzzy logic/word-stemming is applied. We need to support the ability to perform a true exact search in all three query types.

Contents

Requirements

Requirement

Notes

Requirement

Notes

1

With exact phrase searching, word-stemming should not be applied in any language

confirmed

2

Support the ability to use double quotes in basic search of Inventory and MARC authority apps to represent an exact phrase search

confirmed

3

When users input terms within double quotes while conducting a search in Inventory or MARC authority app, match against titles using an exact match, in the exact order (match phrase query)

confirmed

4

Do not apply fuzzy logic or word stemming; "Global" should not match to "Globalization"

confirmed

5

No additional positions allowed between terms in the phrase for a match

confirmed

6

Terms outside of the quotes should all also be found in the title, but not necessarily in the same order and may have additional words in between

confirmed

7

Searches should NOT be case sensitive

confirmed

8

Full-text usage 

confirmed

9

For Keyword search, when query only contains terms within quotes, the exact phrase should be searched in all fields in the Keyword index

confirmed

10

For Keyword search, when query contains both terms within quotes and terms outside of the quotes:

  • The terms in the quotes need to be found as an exact phrase in at least one field

  • The terms outside of the quotes can be found in a separate field than the exact phrase

  • Fuzzy logic/word-stemming can be applied to the terms outside of quotes

Questions:

  • For this scenario, is it sufficient to just use advanced search?

    • What would this mean for scope of feature to support exact phrase searching?

    • In advanced search, is this supported if two criteria are used to search keyword?

under review

11

For exact phrase, the search should be agnostic to diacritics.

confirmed

Scenarios

Query (all case insensitive)

Returns instances

Does NOT return (examples)

Scenario

Query (all case insensitive)

Returns instances

Does NOT return (examples)

Scenario

1

Title (all): “Global Africa”

  • Global Africa :into the twenty-first century /edited by Dorothy L. Hodgson and Judith A. Byfield.

  • Email from Ngeti :an ethnography of sorcery, redemption, and friendship in global Africa /James H. Smith and Ngeti Mwadime.

  • Globalizing Africa / edited by Malinda S. Smith.

Exact phrase

2

Title (all): “Global africa” ethnography sorcery

  • Email from Ngeti :an ethnography of sorcery, redemption, and friendship in global Africa /James H. Smith and Ngeti Mwadime.

  • Global Africa :into the twenty-first century /edited by Dorothy L. Hodgson and Judith A. Byfield.

Exact phrase with additional terms

3

Title (all): “Global africa” Ngeti

  • Email from Ngeti :an ethnography of sorcery, redemption, and friendship in global Africa /James H. Smith and Ngeti Mwadime.

  • Global Africa :into the twenty-first century /edited by Dorothy L. Hodgson and Judith A. Byfield.

Exact phrase with additional terms

4

Title (all): “globalizing africa”

  • Globalizing Africa / edited by Malinda S. Smith.

  • Global Africa :into the twenty-first century /edited by Dorothy L. Hodgson and Judith A. Byfield.

  • Email from Ngeti :an ethnography of sorcery, redemption, and friendship in global Africa /James H. Smith and Ngeti Mwadime.

Exact phrase

5

Title (all): Global africa (no quotes)

  • Africa and global climate change /guest ed.: Paul Desanker.

  • The Global Horizon: Expectations of Migration in Africa and the Middle East

  • Neoliberal Africa :the impact of global social engineering /Graham Harrison.

  • Globalizing Africa / edited by Malinda S. Smith.

  • West Africa and the global financial crisis /edited by Diery Seck.

  • Global Africa :into the twenty-first century /edited by Dorothy L. Hodgson and Judith A. Byfield.

  • Email from Ngeti :an ethnography of sorcery, redemption, and friendship in global Africa /James H. Smith and Ngeti Mwadime.

  • Africa :up in smoke 2 /the second report on Africa and global warming from the Working Group on Climate Change and Development ; [written and compiled by John Magrath with the assistance of Andrew Simms].

  • The climate of Africa.

Basic search (contains all)

6

Title (all): “climate change” Africa

  • Africa and global climate change /guest ed.: Paul Desanker.

  • Africa :up in smoke 2 /the second report on Africa and global warming from the Working Group on Climate Change and Development ; [written and compiled by John Magrath with the assistance of Andrew Simms].

  • The climate of Africa.

  • Tunisia in a changing climate : assessment and actions for increased resilience and development / edited by Dorte Verner

Exact phrase with additional terms

7

under review

Keyword: “climate change” Africa

  • Economics of climate change in the Arab world : case studies from Syria, Tunisia and Yemen

    • Contributor: World Bank / Middle East and North Africa Region / Sustainable Development

  • Joint MDB Report to the G8 on the Implementation of the Clean Energy Investment Framework and Their Climate Change Agenda Going Forward

    • Contributor: African Development Bank

  • Africa and global climate change /guest ed.: Paul Desanker.

  • Africa :up in smoke 2 /the second report on Africa and global warming from the Working Group on Climate Change and Development ; [written and compiled by John Magrath with the assistance of Andrew Simms].

  • Tunisia in a changing climate : assessment and actions for increased resilience and development / edited by Dorte Verner

    • Contributor: World Bank / Middle East and North Africa Region / Sustainable Development:

Keyword with exact phrase and additional terms

8

Title (all): “Frank Forster” wuste

  • Der Abu Ballas-Weg :$beine pharaonische Karawanenroute durch die Libysche Wüste /$cFrank Förster

 

Exact phrase with diacratics

9

Title (all): “Frank Förster” wuste

  • Der Abu Ballas-Weg :$beine pharaonische Karawanenroute durch die Libysche Wüste /$cFrank Förster

 

Exact phrase with diacratics

10

Title (all): “Frank Förster” wüste

  • Der Abu Ballas-Weg :$beine pharaonische Karawanenroute durch die Libysche Wüste /$cFrank Förster

 

Exact phrase with diacratics

11

Contributor: “Salgado, Sebastião”

  • Africa /$cSebastião Salgado ; texts, Mia Couto ; concept and design, Lelia Wanick Salgado.

    • Contributor: Salgado, Sebastião

 

Exact phrase with diacratics

12

Contributor: “Salgado, Sebastiao”

  • Africa /$cSebastião Salgado ; texts, Mia Couto ; concept and design, Lelia Wanick Salgado.

    • Contributor: Salgado, Sebastião

 

Exact phrase with diacratics

13

Title (all): “Afrīqiyā” française

  • Afrique, nord-est, Arabie =$bAfrica, north east, Arabia = Afrīqiyā, al-shamāl al-sharqī wa-al-Jazīrah al-ʻArabīyah /$cdressée par la Manufacture française des pneumatiques Michelin.

 

Exact phrase with diacratics

14

Title (all): “Afriqiya” francaise

  • Afrique, nord-est, Arabie =$bAfrica, north east, Arabia = Afrīqiyā, al-shamāl al-sharqī wa-al-Jazīrah al-ʻArabīyah /$cdressée par la Manufacture française des pneumatiques Michelin.

 

Exact phrase with diacratics

Test files

Title

File

Title

File

1

Africa and global climate change /guest ed.: Paul Desanker.

 

2

The Global Horizon: Expectations of Migration in Africa and the Middle East

 

3

Globalizing Africa / edited by Malinda S. Smith.

 

4

Neoliberal Africa :the impact of global social engineering /Graham Harrison.

 

5

West Africa and the global financial crisis /edited by Diery Seck.

 

6

Global Africa :into the twenty-first century /edited by Dorothy L. Hodgson and Judith A. Byfield.

 

7

Email from Ngeti :an ethnography of sorcery, redemption, and friendship in global Africa /James H. Smith and Ngeti Mwadime.

 

8

Africa :up in smoke 2 /the second report on Africa and global warming from the Working Group on Climate Change and Development ; [written and compiled by John Magrath with the assistance of Andrew Simms].

 

9

The climate of Africa.

 

10
  • Economics of climate change in the Arab world : case studies from Syria, Tunisia and Yemen

  • Joint MDB Report to the G8 on the Implementation of the Clean Energy Investment Framework and Their Climate Change Agenda Going Forward

  • Tunisia in a changing climate : assessment and actions for increased resilience and development / edited by Dorte Verner

 

11

Afrique, nord-est, Arabie =$bAfrica, north east, Arabia = Afrīqiyā, al-shamāl al-sharqī wa-al-Jazīrah al-ʻArabīyah /$cdressée par la Manufacture française des pneumatiques Michelin.

 

 

12
  • Der Abu Ballas-Weg :$beine pharaonische Karawanenroute durch die Libysche Wüste /$cFrank Förster

  • Africa /$cSebastião Salgado ; texts, Mia Couto ; concept and design, Lelia Wanick Salgado.

  • Berlin 1885 :$bla ruée sur l'Afrique = the scramble for Africa /$cLes Films d'Ici ... [and others] pŕesentent ; un film de Joël Calmettes ; scénario et réalisation, Joël Calmettes.

  • Die französische Afrikapolitik :$bAuswahlbibliographie = La politique africaine de la France : bibliographie sélectionnée = French policy in Africa : a selected bibliography /$cStefan Brüne, Christine Weiss.

  • Geomorphologie--Südafrika (Moçambique, Swaziland, Republik Südafrika) :$b23⁰10-́26⁰52Ś, 29⁰50-́35⁰40É = Geomorphology--South Africa /$cKurt Kayser.

  • Djara, zur mittelholozänen Besiedlungsgeschichte zwischen Niltal und Oasen (Abu-Muharik-Plateau, Ägypten) /$cKarin Kindermann ; [Beiträge von Erich Classen ... et al.].