Update mirrors DB

[rgaudin]

We need to initialize our DB (#6) with mirrors information and we'll also need to update them periodically.
For this, we should rely on the online list of mirrors that we have.

https://download.kiwix.org/mirrors.html

It's in HTML format but all information can be extracted easily.

Let's use the URL's hostname as ID for now and also assume that any DB mirror not found in the page should be marked disabled

[elfkuzco]

What do you think about providing a command line interface for this?

backend update-mirrors 

This way, it can be run externally by an admin or scheduled to be run periodically via cron

[rgaudin]

Sure! As long as we also have the ability to run it via code (still not clear how this will be trigered in prod)

[elfkuzco]

Perhaps, in the code, it can check if there are any rows in the table. If there are none, it will involve the function behind the CLI. Subsequent updates would be done externally or via a scheduler

[rgaudin]

👍

[rgaudin]

We will need to exclude the israeli mirror (it doesn't have the speedtest file)