v23.3.3

[piyushredpanda]

Features

• spillover manifests are enabled by default for clusters that did not explicit set a value or null by @andijcr in #16174

Bug Fixes

• PR #16178 [v23.3.x] c/log_eviction_stm: do not request snapshot if already progressed by @mmaslankaprv
• Fix internal RPC client connection stall after more than 2^32 requests are sent. by @ztlpn in #16176
• Fix large allocation in partition manifest. by @dotnwat in #16188
• Fix tiered-storage housekeeping problem that may cause replaced segments to pile up if the spillover is enabled. by @Lazin in #16167
• Fix tiered-storage housekeeping problem that may cause replaced segments to pile up if the spillover is enabled. by @Lazin in #16170
• Protect against a very rare scenario where after node restart, some of the partition replicas hosted on that node could not take part in leader elections. by @ztlpn in #16080
• #15811 Several additional metrics will have their "partition" label aggregated away (i.e., into a single series per remaining label set with no partition label, whose value is the sum of all input series with the same label set and different partition labels). This is already the default behavior for most metrics, but this change extends it to almost all remaining metrics. by @travisdowns in #16094
• #16093 Several additional metrics will have their "partition" label aggregated away (i.e., into a single series per remaining label set with no partition label, whose value is the sum of all input series with the same label set and different partition labels). This is already the default behavior for most metrics, but this change extends it to almost all remaining metrics. by @travisdowns in #16100
• fixed incorrect fetch offset validation by @mmaslankaprv in #16169

Improvements

• Add a dedicated CPU scheduling policy for Data Transforms by @rockwotj in #16139
• Reduces the number of allocations performed by the auditing subsystem by @graphcareful in #16147
• rpk transform deploy --file now supports https:// URLs by @rockwotj in #16063
• PR #16111 [v23.3.x] archival: Start housekeeping jobs after STM sync by @Lazin
• PR #16103 [v23.3.x] Add at: in Top-N alloc site output by @travisdowns

Full Changelog: v23.3.2...v23.3.3

---

This discussion was created from the release v23.3.3.

[intfish123]

@piyushredpanda How to build manually?
I run these commands, but it build failed.

cd redpanda
docker run \
  --rm -ti --privileged \
  --name redpanda-dev \
  --ipc=host \
  -v $PWD:$PWD:Z \
  -w $PWD fedora:38 /bin/bash

In container(redpanda-dev):

sudo ./install-dependencies.sh
cmake --preset debug

The error:

Cloning into 'ada-src'...
remote: Enumerating objects: 1837, done.
remote: Counting objects: 100% (1837/1837), done.
remote: Compressing objects: 100% (1205/1205), done.
remote: Total 1837 (delta 1196), reused 1023 (delta 602), pack-reused 0
Receiving objects: 100% (1837/1837), 1.52 MiB | 410.00 KiB/s, done.
Resolving deltas: 100% (1196/1196), done.
HEAD is now at 160eb29 chore: release v2.7.3
[2/9] Performing update step for 'ada-populate'
[3/9] No patch step for 'ada-populate'
[5/9] No configure step for 'ada-populate'
[6/9] No build step for 'ada-populate'
[7/9] No install step for 'ada-populate'
[8/9] No test step for 'ada-populate'
[9/9] Completed 'ada-populate'
-- Code formatting is not enabled.
-- Ccache found using it as compiler launcher.
-- Compiler ID : Clang
-- CMAKE_BUILD_TYPE : Debug
-- Assuming GCC-like compiler.
-- Python found, we are going to amalgamate.py.
-- RP_ENABLE_FIXTURE_TESTS=ON
-- RP_ENABLE_UNIT_TESTS=ON
-- RP_ENABLE_BENCHMARK_TESTS=ON
-- Found GnuTLS: /usr/lib64/libgnutls.so (found version "3.8.2")
-- Found Boost: /usr/lib64/cmake/Boost-1.78.0/BoostConfig.cmake (found version "1.78.0") found components: iostreams unit_test_framework
-- Using Python interpeter: /usr/bin/python3.11
-- Found xxHash: /usr/include (found version "")
-- Found Zstd: /usr/lib64/libzstd.so (found version "1.5.5")
-- Found Protobuf: /usr/lib64/libprotobuf.so (found version "3.19.6")
-- Found LibXml2: /usr/lib64/libxml2.so (found version "2.10.4")
-- Configuring done (240.2s)
CMake Error at build/debug/_deps/seastar-src/CMakeLists.txt:784 (target_link_libraries):
  Target "seastar" links to:

    lz4::lz4

  but the target was not found.  Possible reasons include:

    * There is a typo in the target name.
    * A find_package call is missing for an IMPORTED target.
    * An ALIAS target is missing.



-- Generating done (107.1s)
CMake Generate step failed.  Build files cannot be regenerated correctly.

[ivotron]

hello! I'm unable to reproduce. Could you please post more details about your environment? We test the build on linux amd64 machines

[ivotron]

BTW, this is how we build/test on fedora:38 and ubuntu:mantic https://github.com/redpanda-data/redpanda/blob/dev/.github/workflows/build-redpanda.yml

[intfish123]

hello! I'm unable to reproduce. Could you please post more details about your environment? We test the build on linux amd64 machines

I run the commond lines on MacOS Sonoma 14.2.1