test all sources every night

[AstrakhantsevaAA]

Tell us what you do here

• implementing verified source (please link a relevant issue labelled as verified source)
• fixing a bug (please link a relevant bug report)
• improving, documenting, customizing existing source (please link an issue or describe below)
• anything else (please link an issue or describe below)

Relevant issue

issue #

More PR info

We need to check all our verified sources sometimes. We test them, but only when create or change them. They break silently all the time, and we find out about it from users or by accident.

Suggestion: we could have a nightly run, every night at 4am or so

[burnash]

Awesome work, @AstrakhantsevaAA

[rudolfix]

@AstrakhantsevaAA run this only on duckdb on linux.

[burnash]

@AstrakhantsevaAA one more thing: we need to exclude some tests from nightly tests. We can do that using custom pytest markers: https://docs.pytest.org/en/7.1.x/example/markers.html

[VioletM]

@AstrakhantsevaAA maybe it makes sense to merge this even before all tests are up and running? This way we would see the stats on failing tests

[AstrakhantsevaAA]

@burnash I skip tests without stable test account here
@VioletM now we're waiting for only Kafka test, so I think now it makes sense to merge it.
@rudolfix OK