v1.7.4 - DFM17 Mis-identification fixes (for real this time!)

This release brings the following updates and changes:

• Actually fix the DFM17/DFM09 mis-identification issue! (Thanks to @rs1729 for the help debugging this, and to WJ2B and KC7RW for sending through samples to test with).
• Fix handling of Graw PS-15 pilot-sondes.

Also please refer to the changes in v1.7.3 here: https://github.com/projecthorus/radiosonde_auto_rx/releases/tag/v1.7.3

Ongoing Known Issues:

• iMet-1 serial number generation still has issues, and will result in iMet-1 sondes being assigned 3-4 different serial numbers throughout the flight. This is due to the iMet-1 telemetry repeating data across multiple frames, and there's no easy fix (Thanks InterMet...). iMet-4 sondes should not be affected.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

While this does not cause issues and auto_rx will continue to function, this can be resolved by installing the simple-websocket Python package. If you are using Docker, this will be included from the v1.6.2 release. Otherwise, you may need to run:

sudo pip3 install simple-websocket

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository. We also now have a Discord server: https://sondehub.org/go/discord

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

v1.7.3 - Many small updates, DFM fix still to come.

Unfortunately this update doesn't quite fix the DFM mis-identification issue, I missed another place this identification occurs within the auto_rx code. I'll get a new version with a fix released in the next few days - apologies!

This release brings the following updates and changes:

• Build system: Various fixes, including removal of deprecated decoders (Thanks @pinkavaj !)
• Log Files: A log message will now be emitted if a shutdown timeout is set (Thanks @argilo !)
• Log Files: All log and temporary data files (e.g. scan, iq, raw data) should now be written to the log directory.
• Historical Data: Add a 'Generate KML' button, allowing downloading of historical sonde data as KML (Thanks @argilo !)
• Historical Data: Units should display as Imperial correctly (if selected)
• Web Interface: In the control section, add the ability to temporarily lock out a frequency.
• Graw DFM Sondes: Improve identification of newer DFM17 sondes, which were being mis-identified as DFM09s. (Thanks @rs1729 !)
• Meteomodem M20 sondes: Improve handling of M20 sondes with aux data (Thanks @rs1729 !)
• Meteo-Radiy MRZ sondes: Add support for a newer variant of these sondes, using a different GNSS receiver (Thanks @rs1729 !)
• Weathex WxR-301D sondes: Add support for a variant of these sondes which has been observed in Europe. (Thanks @rs1729 !)
• Meisei iMS-100 sondes: Handling of GPS week number rollover issues. (Thanks @rs1729 !)
• Scanning: Improvements to dft_detect to better handle wide-band radiosondes (Thanks @rs1729 !)
• Other: Various changes to support newer Python versions (Thanks @argilo !)

Note that this build also includes some very preliminary support for the ka9q-radio server, however this is still not complete and does not support scanning.
Properly finishing support for ka9q-radio is what has held up this release, but due to the Graw DFM problems I decided it was better to get the latest changes released ASAP.

Other Known Issues:

• iMet-1 serial number generation still has issues, and will result in iMet-1 sondes being assigned 3-4 different serial numbers throughout the flight. This is due to the iMet-1 telemetry repeating data across multiple frames, and there's no easy fix (Thanks InterMet...). iMet-4 sondes should not be affected.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

While this does not cause issues and auto_rx will continue to function, this can be resolved by installing the simple-websocket Python package. If you are using Docker, this will be included from the v1.6.2 release. Otherwise, you may need to run:

sudo pip3 install simple-websocket

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository. We also now have a Discord server: https://sondehub.org/go/discord

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

v1.7.2 - Meisei iMS100 Decoding Bugfix

A bugfix release to fix incorrect handling of dates for Meisei iMS-100 radiosondes.
If you don't receive these radiosonde there should be no need to update.

Warning: Users running 'native' installs may need to upgrade their version of the flask library and dependencies, otherwise you will see an error along the lines of ModuleNotFoundError: No module named 'werkzeug.middleware'. If you installed python3-flask via your system package manager, you will need to run:

$ sudo apt-get remove python3-flask
$ sudo pip3 install -U flask flask-socketio

Users of the Docker image will not have this issue, as all the appropriate package versions are included in the image.

Other Known Issues:

• iMet-1 serial number generation still has issues, and will result in iMet-1 sondes being assigned 3-4 different serial numbers throughout the flight. This is due to the iMet-1 telemetry repeating data across multiple frames, and there's no easy fix (Thanks InterMet...). iMet-4 sondes should not be affected.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

While this does not cause issues and auto_rx will continue to function, this can be resolved by installing the simple-websocket Python package. If you are using Docker, this will be included from the v1.6.2 release. Otherwise, you may need to run:

sudo pip3 install simple-websocket

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

v1.7.1 - Bugfixes for iMet sondes, Record RS41 mainboard type and cal data

This is mainly a bug-fix release to resolve the iMet decoding issues from v1.7.0, though I have taken the opportunity to add some functionality to log and upload additional information for Vaisala RS41's.

Recently updated PCBs have been spotted in RS41s launched from Vaisala HQ in Helsinki, Finland. These new PCBs seem to have a mainboard version number of RSM424 (compared to RSM412 for the older models), and have a newer STM32 microcontroller and uBlox-10 GPS receiver. auto_rx will now upload the mainboard version information to SondeHub, where it will be visible on the tracker and help identify newer RS41 versions as they are rolled out!

This release brings the following updates:

• RS41 Decoding: Extract the RS41 Mainboard model number and firmware version, and upload these to SondeHub. This will allow us to keep track of the rollout of the new RSM42x 'refreshed' RS41 mainboards. If the mainboard version is not RSM412 (the 'standard' RS41 mainboard), then it will also be shown in the 'other' column on the web interface.
• RS41 Decoding: Upload complete subframe (calibration) data to SondeHub, and optionally save it to disk.
• iMet Decoding: Fix issue where iMets were detected as iMet-1 sondes when wideband_sondes was enabled.
• iMet Decoding: Fix bug where iMet telemetry with XDATA included was not being uploaded to SondeHub.
• Web Interface: If a sonde has XDATA, the type is now displayed as -XDATA instead of -Ozone.
• Log files & general: Log files will now have -XDATA appended to the sonde type instead of -Ozone if XDATA is present.

Configuration File Changes this release:

• Added save_cal_data option, which saves Vaisala RS41 raw calibration data to disk. Refer here for details.

Warning: Users running 'native' installs may need to upgrade their version of the flask library and dependencies, otherwise you will see an error along the lines of ModuleNotFoundError: No module named 'werkzeug.middleware'. If you installed python3-flask via your system package manager, you will need to run:

$ sudo apt-get remove python3-flask
$ sudo pip3 install -U flask flask-socketio

Users of the Docker image will not have this issue, as all the appropriate package versions are included in the image.

Other Known Issues:

• iMet-1 serial number generation still has issues, and will result in iMet-1 sondes being assigned 3-4 different serial numbers throughout the flight. This is due to the iMet-1 telemetry repeating data across multiple frames, and there's no easy fix (Thanks InterMet...). iMet-4 sondes should not be affected.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

While this does not cause issues and auto_rx will continue to function, this can be resolved by installing the simple-websocket Python package. If you are using Docker, this will be included from the v1.6.2 release. Otherwise, you may need to run:

sudo pip3 install simple-websocket

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

v1.7.0 - Weathex WxR-301D support, Some Wideband iMet support, other fixes

This release brings the following updates:

• Weathex WxR-301D decoding & detection support. Thanks to @rs1729 for writing the decoder, and the Malaysian sonde hunters for sending me a sample radiosonde to test with! Reception of these sondes has a few important caveats, please refer here for more information.
• Support for a generic 'wideband' detection mode, which may improve detection and decoding of wideband iMet-1/4 radiosondes. Please take note of the caveats when using this mode, mentioned here.
• Better handling of missing rtl-sdr utilities (an error message will now be emitted)
• auto_rx should now shut down cleanly in the case of an SDR failure, allowing a restart by docker or systemd.
• Fix rotator pointing threshold calculations when near 0 degrees azimuth.
• Move detection and decode IQ recordings to the log directory, to enable them to be more easily accessed if running auto_rx in a docker container.
• Fixes to Skew-T calculations in the web interface.

Configuration File Changes this release:

• Added wideband_sondes setting. Refer here.

Warning: Users running 'native' installs may need to upgrade their version of the flask library and dependencies, otherwise you will see an error along the lines of ModuleNotFoundError: No module named 'werkzeug.middleware'. If you installed python3-flask via your system package manager, you will need to run:

$ sudo apt-get remove python3-flask
$ sudo pip3 install -U flask flask-socketio

Users of the Docker image will not have this issue, as all the appropriate package versions are included in the image.

Other Known Issues:

• iMet-1 serial number generation still has issues, and will result in iMet-1 sondes being assigned 3-4 different serial numbers throughout the flight. This is due to the iMet-1 telemetry repeating data across multiple frames, and there's no easy fix (Thanks InterMet...). iMet-4 sondes should not be affected.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

While this does not cause issues and auto_rx will continue to function, this can be resolved by installing the simple-websocket Python package. If you are using Docker, this will be included from the v1.6.2 release. Otherwise, you may need to run:

sudo pip3 install simple-websocket

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

v1.6.2 - Scan Loop Fixes, Encrypted Sonde Notifications, Other Tweaks

This release brings the following updates:

• Scan Loop: Break out of scan loop faster when a sonde is detected. (Thanks @pasky!)
• Email: Landing notifications are now only sent if the radiosonde has risen above the landing_altitude_threshold setting during its flight, avoiding spurious notifications for sondes detected prior to launch.
• Email: Add option to send email when an encrypted RS41-SGM is detected. (Refer here)
• APRS: Added localhost and wettersonde.net to the allowed APRS-IS servers.
• Web Interface: Changes to make the web interface work via a reverse proxy. (Thanks @drid !) Note that this will require a recent version of flask to be installed. See below.
• KML Output: Fixes to ascent rate display. (Thanks @argilo!)
• Docker: Added simple-websocket to the Python dependency list, providing 'real' websockets!

Warning: Users running 'native' installs may need to upgrade their version of the flask library and dependencies, otherwise you will see an error along the lines of ModuleNotFoundError: No module named 'werkzeug.middleware'. If you installed python3-flask via your system package manager, you will need to run:

$ sudo apt-get remove python3-flask
$ sudo pip3 install -U flask flask-socketio

Users of the Docker image will not have this issue, as all the appropriate package versions are included in the image.

Other Known Issues:

• iMet-1 serial number generation still has issues, and will result in iMet-1 sondes being assigned 3-4 different serial numbers throughout the flight. This is due to the iMet-1 telemetry repeating data across multiple frames, and there's no easy fix (Thanks InterMet...). iMet-4 sondes should not be affected.

Configuration File Changes this release:

• Added encrypted_sonde_notifications setting. Refer here.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

While this does not cause issues and auto_rx will continue to function, this can be resolved by installing the simple-websocket Python package. If you are using Docker, this will be included from the v1.6.2 release. Otherwise, you may need to run:

sudo pip3 install simple-websocket

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

v1.6.1 - iMet-50/54 & M10 decoder fixes, Web Interface Updates

This release brings the following updates:

• Decoders: Fix a bug in the handling of iMet-50/54 data.
• Decoders: Fix a bug that occurred when decoding M10 radiosondes with the 'save raw data' setting was enabled. (Thanks @rs1729 !)
• Decoders: Rebase M20 decoder, to better handle improbable PTU values. Note that the M20 decoder also decodes the new PS-20 pilot-sonde, though it is still reported as a M20 as the telemetry formats are the same. (Thanks @rs1729 !)
• Web Interface: Add customisable fields to the Historical View table. (Thanks @AstroTaka !)
• Web Interface: Possible stability improvements for the main Web Interface page, should result in the page hanging less often.

Other Known Issues:

• iMet-1 serial number generation still has issues, and will result in iMet-1 sondes being assigned 3-4 different serial numbers throughout the flight. This is due to the iMet-1 telemetry repeating data across multiple frames, and there's no easy fix (Thanks InterMet...). iMet-4 sondes should not be affected.

There are no configuration file changes in this release.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

This can be safely ignored. The web interface should still continue to work as usual. Eventually we will figure out how to suppress it...

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

v1.6.0 - Major Decoder Restructure, SpyServer Support

This version of auto_rx has been a long time coming, and I apologise for how long it's taken! Thanks to all that have been running the testing branch and sending me all those bug reports :-)

There are many changes in this release, including many bug fixes and support for new radiosonde types, but the big new feature is the ability for auto_rx to connect to a AirSpy SpyServer instance. This allows auto_rx to decode any radiosonde signals within the passband of that SpyServer. For example with an Airspy Mini you can cover 4.8 MHz of spectrum simultaneously, and with an Airspy R2 you can cover 8 MHz! Details of this functionality (and the caveats involved) are available here.

An abridged list of changes is as follows:

• General: Build script now uses Makefiles

• General: Added ability to use a SpyServer for reception. Please refer to this page for details on how this is configured.

• Config: Various updates made (all backwards compatible). Refer Config File Changelog for details.

• Decoders: All demodulators re-based to latest from upstream repository.

• Decoders: iMet-1/4 decoder now uses IQ Input instead of FM

• Decoders: MRZ-H1 Decoder now uses IQ input instead of FM

• Decoders: All decode chains now use the abstracted IQ source functions, with a 'centred' signal.

• Decoders: Meteosis MTS01 decoder added. Basic temperature support.

• Decoders: PTU support for Meisei iMS-100 and RS-11G radiosondes.

• Decoders: Improvements to DFM telemetry handling.

• Decoders: Various issues fixed with handling of adjacent signals.

• Logging: Configuration file now includes options to enable system-level logging and debug logging, intended for use in getting detailed logs out of Docker Containers.

• Web Interface: Fixes to Historical Display

• Web Interface: When not using UTC time, times are now displayed use system locale settings.

• Web Interface: Line-of-sight lines now disappear after a timeout period.

I'd like to thank the following contributors to this release:

• @rs1729 - Providing all the amazing radiosonde telemetry decoders.
• @pinkavaj - Many small fixes throughout the codebase.
• @AstroTaka - Finding heaps of bugs I'd missed for so long, and providing IQ data for Meisei sonde support improvements.
• @icalik - Testing of Meteosis MTS01 support

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

This can be safely ignored. The web interface should still continue to work as usual. Eventually we will figure out how to suppress it...

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

DFM Decoder Updates, APRS output restricted to radiosondy.info

As of auto_rx version 1.5.10, we are limiting APRS output to only radiosondy.info, and only on the non-forwarding port.
This decision was not made lightly, and is a result of the considerable amount of non-amateur traffic that radiosonde flights are causing within the APRS-IS network.
Until some form of common format can be agreed to amongst the developers of all radiosonde tracking software to enable radiosonde telemetry to be de-duped, I have decided to help reduce the impact on the wider APRS-IS network by restricting the allowed servers and ports. Michal SQ6KXY has also configured radiosondy.info to stop forwarding radiosonde traffic onto APRS-IS.

If you are using another APRS-IS server that does not forward to the wider APRS-IS network and want it allowed, then please raise an issue at https://github.com/projecthorus/radiosonde_auto_rx/issues

You are of course free to fork and modify this codebase as you wish, but please be aware that this goes against the wishes of the radiosonde_auto_rx developers to not be part of the bigger problem of APRS-IS congestion.
As of 2022-03-01, radiosonde traffic has been filtered from aprs.fi, so even if you do modify the code, you still won't see sondes on that map.

APRS-IS is a shared resource, intended for the use of all amateur radio operators, and for many years we have been treating it as a playground to dump large amounts of non-amateur traffic into, so we can see weather balloons on a map.
Instead of congesting this shared resource with non-amateur traffic, we should instead be moving to using databases and sites specialised for this purpose, such as sondehub.org

This release brings the following updates:

• Decoders: DFM decoder should now be somewhat more robust to multiple DFMs appearing on the same frequency. This is not that well tested, so reports on how it performs when multiple sondes are present would be appreciated. - Thanks @rs1729 !
• SondeHub: Inhibit errors relating to Z-Match filtering.
• APRS: Removed the synchronous upload feature, which will help reduce instantaneous load on APRS-IS servers.
• APRS: Restricted the APRS server to radiosondy.info, and the APRS port to the radiosondy.info non-forwarding port.

Other Known Issues:

• iMet-1 serial number generation still has issues, and will result in iMet-1 sondes being assigned 3-4 different serial numbers throughout the flight. This is due to the iMet-1 telemetry repeating data across multiple frames. iMet-4 sondes should not be affected.

There are no configuration file changes in this release, though a note has been added regarding the APRS changes.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

This can be safely ignored. The web interface should still continue to work as usual. Eventually we will figure out how to suppress it...

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI

iMet XDATA Support, iMet-1/4 Detection

This release brings the following updates:

• Decoders: iMet-1 & 4 XDATA extraction support - Thanks @rs1729 !
• Decoders: Detection of iMet-1 vs iMet-4 sondes, based on frame rate vs time increment.

IMPORTANT NOTE: Due to issues with auto_Rx versions <=1.5.8 poorly handling iMet-1 sonde telemetry, it is extremely important that stations within range of iMet-1/4 sondes update ASAP. Uploading of iMet telemetry from any version of auto_rx below 1.5.9 into SondeHub will be blocked shortly.

There are no configuration file changes in this release.

Note: We are aware that new installations may display the following message on startup:

The WebSocket transport is not available, you must install a WebSocket server that is compatible with your async mode to enable it. See the documentation for details. (further occurrences of this error will be logged with level INFO)

This can be safely ignored. The web interface should still continue to work as usual. Eventually we will figure out how to suppress it...

The pre-built Docker Image is now the recommended way to setup radiosonde_auto_rx on a new station. Using Docker avoids issues with updates to dependencies, and allows for fixes relating to system packages to be easily pushed out to users.

Please report any problems encountered either on the mailing list, or by raising an issue on this repository.

PLEASE DO NOT USE THE GITHUB GENERATED RELEASE ZIP FILES - USE THE INSTALLATION/UPDATE STEPS DESCRIBED IN THE WIKI