prune PRs from 0.4 changelog entry that appeared for 0.3.1

As title

CHANGE_LOG

@@ -4,13 +4,6 @@ Version 0.4
 Pull-Requests:
 
 * PR `#62 <https://github.com/numba/numba-scipy/pull/62>`_: open changelog for 0.4 (`esc <https://github.com/esc>`_)
-* PR `#67 <https://github.com/numba/numba-scipy/pull/67>`_: update max SciPy to 1.7.0 (`esc <https://github.com/esc>`_)
-* PR `#70 <https://github.com/numba/numba-scipy/pull/70>`_: docs upgrade (`esc <https://github.com/esc>`_)
-* PR `#71 <https://github.com/numba/numba-scipy/pull/71>`_: update scipy dep from 1.7.0 to 1.7.1 (`esc <https://github.com/esc>`_)
-* PR `#78 <https://github.com/numba/numba-scipy/pull/78>`_: Continue PR #76: Upgrade scipy to 1.7.3 (`sklam <https://github.com/sklam>`_ `heroxbd <https://github.com/heroxbd>`_)
-* PR `#79 <https://github.com/numba/numba-scipy/pull/79>`_: Update vmImage for Azure CI (`sklam <https://github.com/sklam>`_)
-* PR `#81 <https://github.com/numba/numba-scipy/pull/81>`_: Update Azure CI to windows-2019 following Numba's config (`sklam <https://github.com/sklam>`_)
-* PR `#84 <https://github.com/numba/numba-scipy/pull/84>`_: Update changelog 0.3.1 (`sklam <https://github.com/sklam>`_)
 * PR `#86 <https://github.com/numba/numba-scipy/pull/86>`_: fix the label for uploading tags (`esc <https://github.com/esc>`_)
 * PR `#87 <https://github.com/numba/numba-scipy/pull/87>`_: documentation and CI changes for moving from master to main (`esc <https://github.com/esc>`_)
 * PR `#90 <https://github.com/numba/numba-scipy/pull/90>`_: Bump scipy version to <1.11.0 (`je-cook <https://github.com/je-cook>`_ `esc <https://github.com/esc>`_)
@@ -22,9 +15,7 @@ Authors:
 
 * `brandonwillard <https://github.com/brandonwillard>`_
 * `esc <https://github.com/esc>`_
-* `heroxbd <https://github.com/heroxbd>`_
 * `je-cook <https://github.com/je-cook>`_
-* `sklam <https://github.com/sklam>`_
 
 Total authors: 5