risingwave 2.0.0

[BugenZhao]

Created with brew bump-formula-pr.

Close #43
Resolve #20

• resource blocks have been checked for updates.

release notes

For installation and running instructions, see [Get started](https://docs.risingwave.com/docs/current/get-started/).
Main changes
SQL features

Query syntax:

Public preview: Supports AS CHANGELOG to convert any stream into an append-only changelog. feat(steam): support stream change log  risingwave#17132
Supports time travel query to access historical data at a specific point in time. feat(batch): support as of now() - interval for time travel risingwave#17665,  feat(storage): support hummock time travel risingwave#17621.
Supports CORRESPONDING specification in set operations. feat: support CORRESPONDING specification in set operations risingwave#17891


SQL commands:

Breaking change: DECLARE cursor_name SUBSCRIPTION CURSOR is the same as DECLARE cursor_name SUBSCRIPTION CURSOR since now(), which will be consumed from the current time. DECLARE cursor_name SUBSCRIPTION CURSOR FULL will start consuming data from stock. The type of operation has changed to varchar. It is one of Insert, Delete, UpdateInset, or UpdateDelete. feat(suscription): Improving usability of subscription risingwave#18217
Public preview: Supports managing database credentials securely. feat(secret): introduce secret management risingwave#17456
SHOW CURSORS will return all query cursors in the current session. SHOW SUBSCRIPTION CURSORS will return all subscription cursorS and subscriptions in the current session. feat(suscription): Improving usability of subscription risingwave#18217
Allows ALTER TABLE on tables with generated columns. feat(ddl): allow alter table with generated columns  risingwave#17652
Allows dropping generated columns from tables created with a schema registry. feat(ddl): allow drop generated column in table with schema registry  risingwave#17689
Supports using scalar functions with list inputs as aggregate functions. feat(expr): support using scalar functions as aggregates in batch query risingwave#17622
Supports altering the backfill rate limit for materialized views.  feat(streaming): support alter mv backfill rate limit risingwave#17911


SQL functions & operators:

Public preview: Supports approx_percentile(). feat(expr): support shuffle approx_percentile risingwave#17814, feat(stream): add two-phase stateless simple approx percentile risingwave#17873.
Public preview: Supports native map type and related functions for map, and ingesting AVRO MAP type into RisingWave map type. feat: support map_access risingwave#17986
Public preview: Supports scanning a directory of parquet files. feat(batch): support file scan a directory of parquet files risingwave#17811
Supports pg_index_column_has_property() to query index column properties. feat(expr): add function pg_index_column_has_property risingwave#17275
Supports continuous timestamp generation in streaming mode. feat(expr): streaming generate_series ends with now() risingwave#17371
Supports acosd(). feat(frontend): Acosd function risingwave#9876
Supports function rw_recovery_status() and pg_is_in_recovery() to retrieve the meta node status. feat(frontend): support async function for captured context and impl pg_is_in_recovery(), rw_recovery_status() risingwave#17641


System catalog:

Adds append_only column in RisingWave catalogs rw_tables and rw_materialized_views. chore: expose append only info in rw_tables and rw_materialized_views risingwave#17598
Adds RisingWave catalog rw_catalog.rw_secrets. feat(secret): add rw_catalog.rw_secrets table risingwave#17726



Connectors

Public preview: Supports ingesting Avro map type for source connectors. ****feat(source): support ingesting Avro map type to RisingWave map type risingwave#17980
Public preview: Supports encoding parquet for file source. feat(connector): introduce parquet file source risingwave#17201
Public preview: Supports batch reading S3 Parquet files. feat(batch): support batch s3 parquet frontend part risingwave#17625, feat(batch): support batch read s3 parquet file risingwave#17673.
Supports AWS Glue schema registry with aws.glue.schema_arn parameter. feat(source): Avro with AWS Glue Schema Registry risingwave#17605
Supports creating tables and sources with format upsert encode protobuf. fix: enable upsert protobuf combination risingwave#17624
Supports ingesting Avro Union type for source connectors. feat(source): support Avro Union type risingwave#17485
Supports reading files compressed in gzip format. feat(connector): support gzip compression for file source risingwave#16538
Adds the option to use a semicolon as the delimiter for CSV encode. feat(source): Add semicolon delimiter for CSV risingwave#17356
Uses OpenDAL to connect to S3 object store state backend. feat: use opendal as the s3 sdk by default risingwave#18011
Public preview: Supports replicating DDL for MySQL CDC source. feat(cdc): auto schema change for mysql cdc risingwave#17876
Supports parameter refresh.interval.sec option for S3, GCS, and POSIX sources. feat: allow config the interval of list files  risingwave#18184
Supports parameter group.id.prefix for Kafka sources. feat: support custom kafka group id prefix risingwave#18115
Validates slot name of PostgreSQL CDC sources. fix(pg-cdc): add validation for slot name of pg cdc source risingwave#17949
Supports altering backfill_rate_limit of CDC tables. feat(cdc): rate limit for cdc backfill risingwave#17989
Public preview: Supports sinking data to file systems in parquet format. feat(sink): introduce file sink in PARQUET format  risingwave#17311
Supports upsert Protobuf type sinks, which requires KEY ENCODE TEXT. feat(sink): allow upsert protobuf with text key risingwave#18024
Adds option jsonb.handling.mode under WITH options for sinks in JSON format. feat(sink): support encode jsonb data as dynamic json type in sink risingwave#17693
Public preview: Supports Azure Blob sinks. feat(connector): introduce azblob sink risingwave#18244
Public preview: Supports MongoDB sinks. feat(sink): Support Mongodb sink risingwave#17102
Supports Azure Blob file sources. feat(connector): support azblob file source risingwave#18295
Supports glue catalog for iceberg sink and source. feat(iceberg): support glue catalog risingwave#17477
Adds jdbc.query.timeout for JDBC sinks to set the timeout for queries. fix(sink): set query timeout for jdbc sink to avoid stuck risingwave#18430
Changes default Kafka sink message timeout from five seconds to five minutes. feat(sink): use official default message_timeout_ms risingwave#18304
Adds new parameters retry_on_conflict, batch_size_kb, batch_num_messages, and concurrent_requests for ElasticSearch sink.feat(sink): add es retry_on_conflict and max_task_num risingwave#17867
Supports parameter bigquery.retry_times for BigQuery sink. fix(sink): add bigquery append_rows retry times risingwave#17237
Supports parameter bigquery.auto_create_table for BigQuery sink. feat(sink): add config auto_create for BigQuery risingwave#17393
Supports parameter doris.partial_columns for Doris sink.  feat(sink): support columns subset for cassandra and doris sink risingwave#16821
Supports ClickHouse sink checkpoint decouple. feat(sink): support clickhouse sink checkpoint decouple risingwave#17491
Sets sink decouple as default for all sinks. feat(sink): set default_sink_decouple = true for all sink risingwave#18182
Uses S3's SQS notification to complete the import of data from Snowflake instead of the Snowflake HTTP client. refactor(sink): remove snowflake sink http client risingwave#17627
Ensures at-least-once delivery semantic and eventual consistency for Kinesis sink. fix(sink): handle Kinesis PutRecords partial success and throttle risingwave#17983
Supports backfilling by consuming a fixed snapshot of upstream table and then the upstream data epoch by epoch. feat: support partial checkpoint based backfill (a.k.a snapshot backfill) risingwave#17735

Installation and deployment

Supports configuring the SQL metastore using username, password, and database separately. feat: support config sql metastore using username and password by env risingwave#17530
Supports more seamless scaling-in in Kubernetes deployments. feat: also gracefully shutdown on SIGTERM risingwave#17802

Cluster configuration changes

Breaking change: Refactors streaming_rate_limit into source_rate_limit and backfill_rate_limit. refactor(frontend): rename streaming_rate_limit to backfill_rate_limit for mv backfilling and source_rate_limit for source updates risingwave#17796
Breaking change: Adds a default soft and hard limit on actor count per worker parallelism. When the hard limit is reached, streaming workloads will fail. feat: introduce cluster limit risingwave#18383
Introduces batch.developer.exchange_connection_pool_size and streaming.developer.exchange_connection_pool_size to configure streaming and batch remote exchange between two nodes refactor: use separate configuration for exchange connection pool for batch and streaming risingwave#17768
Introduces system parameter license_key used to enable enterprise features. feat: introduce license manager and feature tiers risingwave#17396

Fixes

Deletes related cursors when deleting a subscription. fix(subscription): fix drop subscription not clear cursor risingwave#17232

Full Changelog: risingwavelabs/risingwave@v1.10.1...v2.0.0

[xxchan]

Don't maintain old version any more?

[BugenZhao]

Argument list too long

All sorts of bizarre things...