Sentences being joined that shouldn't be

[kpu]

Faheem reports this was in se-en: [Name of person] Umu.se makes use of cookies to improve the user experience.By continuing to use the website you agree to the usage of cookies.
There's no space experience.By but a space appears in the source document, including the WARC we crawled from umu.se

[kpu]

Tagging @kirefu who isn't able to be assigned to do initial investigation.

[kirefu]

The problem lies with bleualign_cpp, although not sure where, as I don't speak C++. I'm trying to find the bug, but could be quicker if @lpla also took a look

To run an example of the problem on valhalla:

cd /fs/meili0/faheem/postprocess/sv-en
../../bitextor.malign/bleualign-cpp/bleualign_cpp --text1 mona_sv.xz --text2 mona_en.xz --text1translated mona_sv.trans.xz --matches mona.matches --doc-threshold 0.1 --bleu-threshold 0.2 --output-dir blue/

[kpu]

In ec8f4f7 I've updated bleualign to put a space between consecutive sentences found by the gap filler. However, we still have a policy question: should consecutive sentences found by the gap filler go on to one line‽