Skip to content

Commit

Permalink
#143: Fix performance regression tests (#148)
Browse files Browse the repository at this point in the history
  • Loading branch information
kaklakariada authored Jan 24, 2024
1 parent 2653c43 commit febc256
Show file tree
Hide file tree
Showing 15 changed files with 560 additions and 392 deletions.
10 changes: 6 additions & 4 deletions .github/workflows/manual_run_regression_tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -16,14 +16,16 @@ jobs:
uses: actions/checkout@v4
with:
fetch-depth: 0
- name: Set up JDK 11
uses: actions/setup-java@v3
- name: Set up JDKs
uses: actions/setup-java@v4
with:
distribution: "temurin"
java-version: 11
java-version: |
11
17
cache: "maven"
- name: Install terraform
uses: hashicorp/setup-terraform@v2
uses: hashicorp/setup-terraform@v3
with:
terraform_version: 1.5.1
- name: Run local smoketests
Expand Down
2 changes: 1 addition & 1 deletion dependencies.md

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

1 change: 1 addition & 0 deletions doc/changes/changelog.md

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

41 changes: 41 additions & 0 deletions doc/changes/changes_3.0.2.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,41 @@
# S3 Document Files Virtual Schema 3.0.2, released 2024-01-24

Code name: Fix performance regression tests

## Summary

This release fixes running the performance regression tests.

## Bugfixes

* #143: Fixed running performance regression tests

## Dependency Updates

### Virtual Schema for Document Data in Files on AWS S3

#### Compile Dependency Updates

* Updated `software.amazon.awssdk:s3:2.23.4` to `2.23.9`

#### Test Dependency Updates

* Updated `com.amazonaws:aws-java-sdk-s3:1.12.638` to `1.12.643`
* Updated `com.exasol:small-json-files-test-fixture:0.1.8` to `0.1.9`

### Extension

#### Compile Dependency Updates

* Updated `@exasol/extension-manager-interface:0.4.0` to `0.4.1`

#### Development Dependency Updates

* Updated `eslint:^8.53.0` to `^8.56.0`
* Updated `@typescript-eslint/parser:^6.9.1` to `^6.19.1`
* Updated `ts-jest:^29.1.1` to `^29.1.2`
* Updated `@types/jest:^29.5.7` to `^29.5.11`
* Updated `typescript:^5.2.2` to `^5.3.3`
* Updated `@typescript-eslint/eslint-plugin:^6.9.1` to `^6.19.1`
* Updated `ts-node:^10.9.1` to `^10.9.2`
* Updated `esbuild:^0.19.5` to `^0.19.12`
6 changes: 3 additions & 3 deletions doc/hands_on/hands_on.md
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@ For the document Virtual Schemas, and by that also the S3 Virtual Schema, this i
To install the Virtual Schema adapter, download its latest jar from the [releases](https://github.com/exasol/s3-document-files-virtual-schema/releases) and upload to BucketFS:

``` shell script
curl -I -X PUT -T document-files-virtual-schema-dist-8.0.0-s3-3.0.1.jar http://w:writepw@<YOUR_DB_IP>:2580/default/
curl -I -X PUT -T document-files-virtual-schema-dist-8.0.0-s3-3.0.2.jar http://w:writepw@<YOUR_DB_IP>:2580/default/
```

(If you have never used BucketFS, you can check out [its documentation](https://docs.exasol.com/database_concepts/bucketfs/bucketfs.htm))
Expand All @@ -75,7 +75,7 @@ CREATE SCHEMA ADAPTER;
--/
CREATE OR REPLACE JAVA ADAPTER SCRIPT ADAPTER.S3_FILES_ADAPTER AS
%scriptclass com.exasol.adapter.RequestDispatcher;
%jar /buckets/bfsdefault/default/document-files-virtual-schema-dist-8.0.0-s3-3.0.1.jar;
%jar /buckets/bfsdefault/default/document-files-virtual-schema-dist-8.0.0-s3-3.0.2.jar;
/

--/
Expand All @@ -85,7 +85,7 @@ CREATE OR REPLACE JAVA SET SCRIPT ADAPTER.IMPORT_FROM_S3_DOCUMENT_FILES(
CONNECTION_NAME VARCHAR(500))
EMITS(...) AS
%scriptclass com.exasol.adapter.document.UdfEntryPoint;
%jar /buckets/bfsdefault/default/document-files-virtual-schema-dist-8.0.0-s3-3.0.1.jar;
%jar /buckets/bfsdefault/default/document-files-virtual-schema-dist-8.0.0-s3-3.0.2.jar;
/
```

Expand Down
6 changes: 3 additions & 3 deletions doc/hands_on/hands_on_parquet.md
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@ For the document Virtual Schemas, and by that also the S3 Virtual Schema, this i
To install the Virtual Schema adapter, download its latest jar from the [releases](https://github.com/exasol/s3-document-files-virtual-schema/releases) and upload to BucketFS:

``` shell script
curl -I -X PUT -T document-files-virtual-schema-dist-8.0.0-s3-3.0.1.jar http://w:writepw@<YOUR_DB_IP>:2580/default/
curl -I -X PUT -T document-files-virtual-schema-dist-8.0.0-s3-3.0.2.jar http://w:writepw@<YOUR_DB_IP>:2580/default/
```

(If you have never used BucketFS, you can check out [its documentation](https://docs.exasol.com/database_concepts/bucketfs/bucketfs.htm))
Expand All @@ -59,7 +59,7 @@ CREATE SCHEMA ADAPTER;

CREATE OR REPLACE JAVA ADAPTER SCRIPT ADAPTER.S3_FILES_ADAPTER AS
%scriptclass com.exasol.adapter.RequestDispatcher;
%jar /buckets/bfsdefault/default/document-files-virtual-schema-dist-8.0.0-s3-3.0.1.jar;
%jar /buckets/bfsdefault/default/document-files-virtual-schema-dist-8.0.0-s3-3.0.2.jar;
/

CREATE OR REPLACE JAVA SET SCRIPT ADAPTER.IMPORT_FROM_S3_DOCUMENT_FILES(
Expand All @@ -68,7 +68,7 @@ CREATE OR REPLACE JAVA SET SCRIPT ADAPTER.IMPORT_FROM_S3_DOCUMENT_FILES(
CONNECTION_NAME VARCHAR(500))
EMITS(...) AS
%scriptclass com.exasol.adapter.document.UdfEntryPoint;
%jar /buckets/bfsdefault/default/document-files-virtual-schema-dist-8.0.0-s3-3.0.1.jar;
%jar /buckets/bfsdefault/default/document-files-virtual-schema-dist-8.0.0-s3-3.0.2.jar;
/
```

Expand Down
6 changes: 3 additions & 3 deletions doc/user_guide/user_guide.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ Next create the Adapter Script:
```sql
CREATE OR REPLACE JAVA ADAPTER SCRIPT ADAPTER.S3_FILES_ADAPTER AS
%scriptclass com.exasol.adapter.RequestDispatcher;
%jar /buckets/bfsdefault/default/document-files-virtual-schema-dist-8.0.0-s3-3.0.1.jar;
%jar /buckets/bfsdefault/default/document-files-virtual-schema-dist-8.0.0-s3-3.0.2.jar;
/
```

Expand All @@ -30,7 +30,7 @@ CREATE OR REPLACE JAVA SET SCRIPT ADAPTER.IMPORT_FROM_S3_DOCUMENT_FILES(
CONNECTION_NAME VARCHAR(500))
EMITS(...) AS
%scriptclass com.exasol.adapter.document.UdfEntryPoint;
%jar /buckets/bfsdefault/default/document-files-virtual-schema-dist-8.0.0-s3-3.0.1.jar;
%jar /buckets/bfsdefault/default/document-files-virtual-schema-dist-8.0.0-s3-3.0.2.jar;
/
```

Expand Down Expand Up @@ -126,7 +126,7 @@ In DbVisualizer use exactly this command:
--/
CREATE OR REPLACE JAVA ADAPTER SCRIPT ADAPTER.S3_FILES_ADAPTER AS
%scriptclass com.exasol.adapter.RequestDispatcher;
%jar /buckets/bfsdefault/default/vs/document-files-virtual-schema-dist-8.0.0-s3-3.0.1.jar;
%jar /buckets/bfsdefault/default/vs/document-files-virtual-schema-dist-8.0.0-s3-3.0.2.jar;
/
```

Expand Down
Loading

0 comments on commit febc256

Please sign in to comment.