Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

remove stopwords from anytext filter #881

Closed
wants to merge 1 commit into from

Conversation

pvgenuchten
Copy link
Contributor

@pvgenuchten pvgenuchten commented Aug 4, 2023

Overview

initial rough implementation to improve #879

q: seems only relevant to postgres, because fulltextsearch does not exist in plain sqlite.
q: it's probably better to retrieve stopwords from postgres, to prevent asynchronity, but also support stopwords for other languages ( i have not found how)

Related Issue / Discussion

#879

Additional Information

Contributions and Licensing

(as per https://github.com/geopython/pycsw/blob/master/CONTRIBUTING.rst#contributions-and-licensing)

  • I'd like to contribute [feature X|bugfix Y|docs|something else] to pycsw. I confirm that my contributions to pycsw will be compatible with the pycsw license guidelines at the time of contribution.
  • I have already previously agreed to the pycsw Contributions and Licensing Guidelines

@pvgenuchten
Copy link
Contributor Author

pvgenuchten commented Aug 4, 2023

problem seems caused by how full-text-search is implemented

where anytext_tsvector @@ to_tsquery('Aerial:*')
and anytext_tsvector @@ to_tsquery('of:*')

^^^ gives no results for titles like Photos of Aerial, below does give results:

where anytext_tsvector @@ to_tsquery('Aerial:* & of:*')

@pvgenuchten pvgenuchten closed this Aug 4, 2023
@pvgenuchten pvgenuchten mentioned this pull request Sep 21, 2023
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant