Open Questions
Consider mapping changes to save disk space (doc_values disabling on mapping can save disk space, norms disabling on mapping can save disk space, Index disabling on mapping can save disk space, Ignore_above in mapping)
Disable dynamic mapping?
Disable date detection?
Prefix query possible for a right wildcard (is it used currently in the mod-search? it could possibly improve performance for wildcard type search)
Why are we sending messages using prepareAndSendContributorEvents while indexing instance records ?
Is the Kafka consumer configured to auto commit ?
- What exactly is the list of searchable fields in the instance index in OS?
- Why are we caching index names? Avoid writing code that offers little value
Why are we getting distinct items in getInstanceResourceEvents?
How do we install the icu analyzer plugin? opensearch-plugin install analysis-icu
Sheer amount code to generate mapping is complex
- Is possible using terms lookup: Terms query | Elasticsearch Guide [8.6] | Elastic to fetch contributors from browse results
- Investigate possibility to populate subjects, contributors indexes while reindex with combination of Transform and Ingest APIs