Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Solr updates an awful lot of bills when running update_index #140

Closed
reginafcompton opened this issue Apr 6, 2018 · 1 comment
Closed
Labels

Comments

@reginafcompton
Copy link
Contributor

reginafcompton commented Apr 6, 2018

The Solr log indicates that Solr updates thousands of Bills, even with an age argument. This is a problem, because it delays data imports (i.e., data imports do not execute every 15 minutes as desired, because Flock politely waits for Solr to finish indexing and for the RTF conversion script to run).

Command run in cron:
python manage.py update_index --batch-size=100 --age=1

Output in log (i.e., /var/log/councilmatic/nyc-updateindex.log):

Indexing 25967 nyc bills
INFO 2018-04-06 13:00:04,480 Starting new HTTP connection (1): 127.0.0.1
...

Does the age argument not work as we expect in Solr 7?

@reginafcompton
Copy link
Contributor Author

reginafcompton commented Jan 30, 2019

Closed via datamade/django-councilmatic#228

Explanation: #155 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant