You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I fixed this by moving the downsampling to an earlier place and changing all the later "pruned" to "clean", but some preprocessing results like vocab.pkl, corpus.pkl, and vectors are still not influenced by the downsampling and the further solution (if needed) seems not straightforward.
The text was updated successfully, but these errors were encountered:
Just found that in the twenty_newsgroups example, the downsampled word list is never used after calculation:
lda2vec/examples/twenty_newsgroups/data/preprocess.py
Line 46 in b7f4642
I fixed this by moving the downsampling to an earlier place and changing all the later "pruned" to "clean", but some preprocessing results like
vocab.pkl
,corpus.pkl
, andvectors
are still not influenced by the downsampling and the further solution (if needed) seems not straightforward.The text was updated successfully, but these errors were encountered: