Tsurugi 1.0.0-BETA5 - Changelog

[akirakw]

1.0.0-BETA5 Changelog

Features

• change '--encoding' default to UTF-8 (6375890)
• compiler: add option for compatibility. (eb19868)
• compiler: better syntax error messages. (719c029)
• compiler: deny ORDER BY column positions. (21677cf)
• compiler: handle sign of numeric literals. (4375c4d)
• compiler: improve syntax compatibility. (522277d)
• compiler: preview of new SQL compiler. (87e7928)
• compiler: support SELECT relation.*. (c8f3ee5)
• jogasaki,tateyama,tateyama-bootstrap: use new sql compiler by default (46f6677)
• jogasaki: improvements for event logging related with statements and transactions (8e1674b)
• jogasaki: support canceling sql requests (655ecb2)
• jogasaki: support new sql compiler (393c2ca)
• limestone: add subcommand 'compaction' to tglogutil (dfc0700)
• mizugaki: support remainder (%) operator syntax. (a28a3b3)
• tatemaya, tateyama-bootstrap: add a metrics subsystem (ca95d8c)
• tateyama-bootstrap: add config. params. for new compiler support (3bd04ce)
• tateyama-bootstrap: follow altimeter specification changes (728c0e8)
• tateyama-bootstrap: implement stmt_duration_threshold handling (96a2897)
• tateyama-bootstrap: log out altimeter config parameters at startup (9c3004c)
• tateyama, tateyama-bootstrap, tsubakuro, and jogasaki: implement CLI to control sessions (31df1b4)
• tateyama, tateyama-bootstrap: 'tgctl shutdown' can now choose graceful or forceful (7ac3107)
• tateyama, tateyama-bootstrap: add a setting to the configuration settings file to disable the use of the TCP endpoint (9136954)
• tateyama: Add duration time to various Altimeter logs (683521a)
• tateyama: do not return accept if shared memory creation fails (6910d1e)
• tateyama: follow altimeter specification changes (d0be53c)
• tgsql, tgdump: set applicationName to SessionBuilder (0cfe318)
• tgsql: Addd client variable 'display.implicit' (b2d5abd)
• tgsql: variable prompt (0e60fd0)

Bug Fixes

• cmake VERSION (3353f25)
• compiler: allow NUL in delimited tokens. (1735df0)
• compiler: avoid crash on "default values". (d337733)
• compiler: avoid crash on symbol analysis. (de4ed63)
• compiler: avoid dangling ptr of scalar exprs. (f8c5259)
• compiler: avoid loop in analyzing subqueries. (e36b10d)
• compiler: avoid loop in anayzing subqueries. (66e0338)
• compiler: better handling non-reserved keywords as IDs. (de2e21d)
• compiler: correct decimal literal precision. (e332f22)
• compiler: correct parsing large decimals. (fa2d95f)
• compiler: correct scale of DECIMAL(*,n). (be2e8d8)
• compiler: deny table without columns. (8d6947d)
• compiler: enable multi-byte chars in comment. (f3b3b0e)
• compiler: fix IR manipulation APIs. (577115b)
• compiler: fix regression of scalar exprs. (79d8898)
• compiler: force reduce duplicated group keys. (c332a5e)
• compiler: handle duplicated group by columns. (405cd9e)
• compiler: remove invalid assertion. (9a2e1d9)
• compiler: rename type BYTE => BINARY. (92dcb10)
• compiler: revise lexical error messages. (c6f4d5d)
• compiler: show codepoint for NPC on error. (8a6c033)
• compiler: update yugawara for new compiler. (70daed1)
• jogasaki,tateyama,tateyama-bootstrap: change config. param. name for lowercase_regular_identifiers (c7d22b6)
• jogasaki: adapt to new analyzer error codes (8946e73)
• jogasaki: add a missing log message when processing tx durability (4263abd)
• jogasaki: add a new property for event log message (2289038)
• jogasaki: add log messages for new config. params. (87d0cc1)
• jogasaki: clean-up and stop passing host variables as part of schema (f5764d4)
• jogasaki: comparison logic used by MIN/MAX functions (3f2abd9)
• jogasaki: correct order of releasing modules on db shutdown (22746e5)
• jogasaki: describe to return correct time zone types (5b6a085)
• jogasaki: error code mapping with new compiler (6c6c583)
• jogasaki: exception safety on protobuf api calls (1fcd6b4)
• jogasaki: handle zero in decimal(x,x) correctly (4cd9b74)
• jogasaki: improve error messages with unsupported type conversion (bacc1e6)
• jogasaki: keep storage namespace consistent with existing database (27c72ac)
• jogasaki: output records were incorrectly merged (4334aa0)
• jogasaki: raise error when index name is omitted for CREATE INDEX (d1dd2ee)
• mizugaki,jogasaki: better error handling with invalid decimal length (6648aa8)
• ogawayama: make test compilation pass for Ubuntu-24.04 (9eeead9)
• shirakami: expand Record tid_word to avoid field overflow (f4c39f1)
• shirakami: race condition problem at start of OCC operation (e77dd0a)
• shirakami: set durable epoch correctly after recovery (5191aa9)
• shirakami: some fixes around rtx and strand (c7ba81e)
• shirakami: tracking newly created Record on previously read yakushima node (45cb85a)
• tateyama and tsubakuro: ensure that no more than one response message is returned for a single slot (4e5fdca)
• tateyama and tsubakuro: make session smoke test pass (cfebe95)
• tateyama and tsubakuro: make session smoke test pass (Session.shutdown) (0691732)
• tateyama-bootstrap: conformed to cli specifications for tgctl session (e48b22e)
• tateyama-bootstrap: set session_id field in proto::framework::request::Header (7c28336)
• tateyama, ogawayama: Protocol Buffers set_allocated_xxx() methods are no longer used (0e68a88)
• tateyama, tateyama-bootstrap, and ogawayama: revise connection_queue algorithm (bf7f40c)
• tateyama, tateyama-bootstrap, ogawayama, and tsubakuro: add a mechanism to handle IPC communication channel creation failure (2e9bf12)
• tateyama, tateyama-bootstrap: change tgctl session kill to shutdown (68e67fc)
• tateyama, tsubakuro: fix end of record detection logic when sending ResultSet by multiple writers (c4479bd)
• tateyama, tsubakuro: make session smoke test pass (Session.close) (75afa50)
• tateyama: add pid to altimeter event log at db_start and db_end (78a1f1b)
• tateyama: add shortcut for shutdown request sent via ipc connection (2994b83)
• tateyama: avoid rase in ResultSet close (d1e00d9)
• tateyama: delay notification of shutdown completion until after server resources are released (a1a1321)
• tateyama: eliminate uncertainties in behavior of large resultSet transfer via ipc connection (1aa5e6f)
• tateyama: ensure that the shutdown flag is set after a shutdown response is returned (f83b503)
• tateyama: fix handling of various errors in tgctl session command (7e357ce)
• tateyama: fix slot management mechanism used in IPC conection and update wire.h used in tsubakuro, tateyama-bootstrap, and ogawayama (6720dbf)
• tateyama: fix the condition to destruct stream_worker (c5d76ff)
• tateyama: revise conditions for notifying clients of end of records (e31e11d)
• tateyama: revise ipc_listener.h to reject connection on shm creation error (52ebba9)
• tateyama: wait for disconnection of communication channel in case of shutdown request from client (f3ca61a)
• tateyama: writer_count is taken from sql.default_partitions (3b1dacc)
• tsubakuro, tateyama, tateyama-bootstrap, and ogawayama: eliminate the race that occurs between writing data to wire and setting the close flag (638c065)
• tsubakuro: allowed Future[Ipc|Stream]WireImpl.get() to be called more than once (67e20e8)
• tsubakuro: allows IPC sessions can be continuously created from the same process (9902bda)
• tsubakuro: allows IPC sessions can be continuously created from the same process (revise) (c44d398)
• tsubakuro: fix a dead lock problem when a cancel request is sent after session close (de2837b)
• tsubakuro: fix problem of using incorrect slot number (a4ea47d)
• tsubakuro: fix stall problem in ChannelResponse.responseArrive() (3650603)
• tsubakuro: implement processing when a connection request is rejected due to an error other than the maximum number of connections (bf693c6)
• tsubakuro: revise messages when the connection with the database is lost (838b121)
• yugawara,jogasaki: declare restricted features for better error handling (920fd11)

Performance Improvements

• tateyama: add shortcut for shutdown request sent via stream connection (c58c60a)

Documentation

• tgsql: Added client-variable_ja.md (42311ca)

Distribution

• Add stream_endpoint.enabled to template config file (d08edf8)
• add apt-install-nativelib.sh for setup ipc-client runtime env (d74d92d)
• add installer experimental option: --skip=[server|nativelib] (246bff6)
• add template config ipc_endpoint.admin_sessions (82e7289)
• bump apache arrow version to 16.0.0 (8db95d8)
• bump apache arrow version to 16.1.0 (04c4d5e)
• ignore failure to install libmpdec-dev (4dafd08)

Styles

• shirakami,yakushima: extend max length for lines in source code (7a609ab)
• shirakami,yakushima: fix indentation and line separators (14087a9)
• shirakami,yakushima: update code style related with trailing blanks and final new line (80202b4)
• yakushima: corrected line separators in source code files (f65ff03)
• yakushima: fix code style with gc loop (c57492e)
• yakushima: update code style related with doc comments with multiple lines (b9b7263)

Miscellaneous Chores

• jogasaki: update setting sample file and tests (c70eba3)
• tateyama-bootstrap: remove unnecessary code (deaed61)
• tateyama: use std::chrono::steady_clock and revise critical section in ipc_listener (839cdb6)

Code Refactoring

• tateyama-bootstrap: fix clang-tidy warnings (c2c447d)

Tests

• compiler: add tests for semantic analyzer. (a747c0d)
• jogasaki: add testcases related with time zone (f185433)
• jogasaki: correct testcase to adapt to takatori fix (9598ee2)
• jogasaki: recover testcases for sql compiler (dd69e18)
• sharksfin: avoid intermittent test failure (37981f5)
• sharksfin: fix a timing-dependent testcase (6783ee3)
• tateyama-bootstrap: fix intermittent session_test failures (1c7628e)
• tateyama: in case boost managed shared memory creation fails, 1) do not stall, and 2) output detailed information (596072d)

Build System

• changes for Ubuntu 24.04 LTS and gcc-13 (d9186de)
• jogasaki: avoid false warnings with newer gcc versions (8dbb056)
• jogasaki: fix build related errors with newer gcc version (7cee8b2)
• jogasaki: prepare for upgrading sql compiler (3e5f46d)
• sharksfin: fix build related errors with newer gcc version (c172cd5)
• takatori: fix for extra nodiscard on gcc-13. (886e035)
• takatori: fix include for newer gcc. (3309fc9)
• yugawara: avoid misdetected warn (gcc-13). (c2a8ff0)

Continuous Integration

• add CI on Ubuntu 24.04 (9f978a1)
• add CI on Ubuntu 24.04 - follow up (f7e13f8)
• temporarily set ipc_session_limit_test of tateyama to DISABLED to pass CI on ubuntu-24.04 (f500a1c)
• tuning test parallel tasks on CI workflows (40daf3a)