Skip to content

Commit

Permalink
Merge pull request #487 from exasol/develop
Browse files Browse the repository at this point in the history
Merge Develop into master
Changelog:
#472: fixed GitHub upload script (#473) 
#474: Fix Python3.6 installation script (#475) 
#476: Resolve datascience security issues (#477) 
#478 update standard container packages (#479) 
#480: Fix R security scan script (#481) 
#484: Update exaslct to 0.9.0 (#486) 
#482: Increase version to 4.0.0 (#483)
  • Loading branch information
tomuben authored Feb 2, 2022
2 parents f80f7f6 + 32b26b3 commit 6d490d4
Show file tree
Hide file tree
Showing 145 changed files with 2,127 additions and 11 deletions.
2 changes: 1 addition & 1 deletion .current_gitmodules
Original file line number Diff line number Diff line change
@@ -1 +1 @@
160000 cff9c5e480dc362faebd701af5f853c919567faf 0 script-languages
160000 2d7671a0819e2d3435bfb4590fab561b897e4a4f 0 script-languages
1 change: 1 addition & 0 deletions doc/changes/changelog.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
# Changes

* [4.0.0](changes-4.0.0.md)
* [3.2.0](changes-3.2.0.md)
* [3.1.0](changes-3.1.0.md)
* [3.0.0](changes-3.0.0.md)
Expand Down
38 changes: 38 additions & 0 deletions doc/changes/changes-4.0.0.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
# script-languages-release 4.0.0, released 2022-02-02

Code name: Pandas upgrade to 1.1.5

## Summary

This release contains a breaking change in the standard containers, because due to a security fix Pandas Python3 package was updated to version 1.1.5 (from 0.22.0). Please note that this version might break existing UDF's using Pandas (Read [Pandas Release notes](https://pandas.pydata.org/pandas-docs/stable/whatsnew/v1.0.0.html#) for more information).
Also, this release contains minor bug fixes and other security fixes.

## [Package Version Comparison between Release 3.2.0 and 4.0.0](package_diffs/4.0.0/README.md)

## Script-Language-Container-Tool (Exaslct)

This release uses version 0.9.0 of the container tool.

## Bug Fixes

- #472: Fix github upload script
- #474: Fix Python3.6 installation script
- #480: Fix R security scan script
- #484: Update exaslct to 0.9.0

## Features / Enhancements

n/a

## Documentation

n/a

## Refactoring

- #482: Increase version to 4.0

## Security

- #476: Resolve datascience security issues
- #478: Update standard-container packages
14 changes: 14 additions & 0 deletions doc/changes/package_diffs/4.0.0/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
# Package Version Comparison between 4.0.0 and 3.2.0

- [Comparison of flavor Standard-exasol-7.1.0-without-python2.7](standard-EXASOL-7.1.0-without-python2.7/README.md)
- [Comparison of flavor Standard-exasol-7.1.0](standard-EXASOL-7.1.0/README.md)
- [Comparison of flavor Python-3.6-data-science-exasol-6.2.0](python-3.6-data-science-EXASOL-6.2.0/README.md)
- [Comparison of flavor Standard-exasol-8.0.0](standard-EXASOL-8.0.0/README.md)
- [Comparison of flavor Python-3.6-minimal-exasol-6.2.0](python-3.6-minimal-EXASOL-6.2.0/README.md)
- [Comparison of flavor Python-3.8-minimal-exasol-6.2.0](python-3.8-minimal-EXASOL-6.2.0/README.md)
- [Comparison of flavor R-4-minimal-exasol-6.2.0](r-4-minimal-EXASOL-6.2.0/README.md)
- [Comparison of flavor Python-3.7-minimal-exasol-6.2.0](python-3.7-minimal-EXASOL-6.2.0/README.md)
- [Comparison of flavor Standard-exasol-7.0.0](standard-EXASOL-7.0.0/README.md)
- [Comparison of flavor Python-3.6-data-science-cuda-exasol-6.2.0](python-3.6-data-science-cuda-EXASOL-6.2.0/README.md)
- [Comparison of flavor Standard-exasol-6.2.0](standard-EXASOL-6.2.0/README.md)
- [Comparison of flavor R-3.5-data-science-exasol-6.2.0](r-3.5-data-science-EXASOL-6.2.0/README.md)
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
# Package Version Comparison between Python-3.6-data-science-exasol-6.2.0 flavor in 4.0.0 and Python-3.6-data-science-exasol-6.2.0 flavor in 3.2.0

- Comparison of build step Udfclient_deps
- [Comparison of package list Apt Get Packages](udfclient_deps/apt_get_packages_diff.md)
- Comparison of build step Security_scan
- [Comparison of package list Apt Get Packages](security_scan/apt_get_packages_diff.md)
- [Comparison of package list Apt Get Packages Trivy Deps](security_scan/apt_get_packages_trivy_deps_diff.md)
- Comparison of build step Language_deps
- [Comparison of package list Apt Get Packages](language_deps/apt_get_packages_diff.md)
- [Comparison of package list Python3 Pip Packages](language_deps/python3_pip_packages_diff.md)
- Comparison of build step Flavor_base_deps
- [Comparison of package list Apt Get Packages](flavor_base_deps/apt_get_packages_diff.md)
- [Comparison of package list Python3 Pip Packages](flavor_base_deps/python3_pip_packages_diff.md)
- Comparison of build step Build_deps
- [Comparison of package list Apt Get Packages](build_deps/apt_get_packages_diff.md)
- Comparison of build step Base_test_deps
- [Comparison of package list Apt Get Packages](base_test_deps/apt_get_packages_diff.md)
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
<!-- markdown-link-check-disable -->

| | Package | Version in 3.2.0 | Version in 4.0.0 | Status |
|---:|:----------------|:-----------------------|:-----------------------|:---------|
| 0 | python-protobuf | 3.0.0-9.1ubuntu1 | 3.0.0-9.1ubuntu1 | |
| 1 | python-zmq | 16.0.2-2build2 | 16.0.2-2build2 | |
| 2 | gdb | 8.1.1-0ubuntu1 | 8.1.1-0ubuntu1 | |
| 3 | valgrind | 1:3.13.0-2ubuntu2.3 | 1:3.13.0-2ubuntu2.3 | |
| 4 | gdbserver | 8.1.1-0ubuntu1 | 8.1.1-0ubuntu1 | |
| 5 | binutils | 2.30-21ubuntu1~18.04.7 | 2.30-21ubuntu1~18.04.7 | |
| 6 | patchelf | 0.9-1 | 0.9-1 | |
| 7 | chrpath | 0.16-2 | 0.16-2 | |
| 8 | strace | 4.21-1ubuntu1 | 4.21-1ubuntu1 | |
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
<!-- markdown-link-check-disable -->

| | Package | Version in 3.2.0 | Version in 4.0.0 | Status |
|---:|:------------------|:-------------------------|:-------------------------|:---------|
| 0 | coreutils | 8.28-1ubuntu1 | 8.28-1ubuntu1 | |
| 1 | locales | 2.27-3ubuntu1.4 | 2.27-3ubuntu1.4 | |
| 2 | locales | 2.27-3ubuntu1.4 | 2.27-3ubuntu1.4 | |
| 3 | locales | 2.27-3ubuntu1.4 | 2.27-3ubuntu1.4 | |
| 4 | locales | 2.27-3ubuntu1.4 | 2.27-3ubuntu1.4 | |
| 5 | tar | 1.29b-2ubuntu0.2 | 1.29b-2ubuntu0.2 | |
| 6 | curl | 7.58.0-2ubuntu3.16 | 7.58.0-2ubuntu3.16 | |
| 7 | openjdk-11-jdk | 11.0.11+9-0ubuntu2~18.04 | 11.0.11+9-0ubuntu2~18.04 | |
| 8 | build-essential | 12.4ubuntu1 | 12.4ubuntu1 | |
| 9 | libpcre3-dev | 2:8.39-9 | 2:8.39-9 | |
| 10 | protobuf-compiler | 3.0.0-9.1ubuntu1 | 3.0.0-9.1ubuntu1 | |
| 11 | chrpath | 0.16-2 | 0.16-2 | |
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
<!-- markdown-link-check-disable -->

| | Package | Version in 3.2.0 | Version in 4.0.0 | Status |
|---:|:---------------------|:--------------------------|:--------------------------|:---------|
| 0 | coreutils | 8.28-1ubuntu1 | 8.28-1ubuntu1 | |
| 1 | locales | 2.27-3ubuntu1.4 | 2.27-3ubuntu1.4 | |
| 2 | unzip | 6.0-21ubuntu1.1 | 6.0-21ubuntu1.1 | |
| 3 | wget | 1.19.4-1ubuntu2.2 | 1.19.4-1ubuntu2.2 | |
| 4 | git | 1:2.17.1-1ubuntu0.9 | 1:2.17.1-1ubuntu0.9 | |
| 5 | python3-tk | 3.6.9-1~18.04 | 3.6.9-1~18.04 | |
| 6 | libcurl4-openssl-dev | 7.58.0-2ubuntu3.16 | 7.58.0-2ubuntu3.16 | |
| 7 | libssl-dev | 1.1.1-1ubuntu2.1~18.04.14 | 1.1.1-1ubuntu2.1~18.04.14 | |
| 8 | build-essential | 12.4ubuntu1 | 12.4ubuntu1 | |
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
<!-- markdown-link-check-disable -->

| | Package | Version in 3.2.0 | Version in 4.0.0 | Status |
|---:|:-----------------|:---------------------|:---------------------|:---------|
| 0 | pyexasol | No version specified | No version specified | |
| 1 | gensim | No version specified | No version specified | |
| 2 | statsmodels | No version specified | No version specified | |
| 3 | pycurl | No version specified | No version specified | |
| 4 | scikit-learn | No version specified | No version specified | |
| 5 | scipy | 1.2.1 | 1.2.1 | |
| 6 | numpy | No version specified | No version specified | |
| 7 | ujson | No version specified | No version specified | |
| 8 | lxml | No version specified | No version specified | |
| 9 | nltk | No version specified | No version specified | |
| 10 | keras | 2.3.1 | 2.3.1 | |
| 11 | lifelines | No version specified | No version specified | |
| 12 | imbalanced-learn | No version specified | No version specified | |
| 13 | matplotlib | No version specified | No version specified | |
| 14 | seaborn | No version specified | No version specified | |
| 15 | kmodes | No version specified | No version specified | |
| 16 | tensorflow-hub | 0.4.0 | 0.4.0 | |
| 17 | tensorflow | 1.13.1 | 1.13.1 | |
| 18 | PyYAML | No version specified | No version specified | |
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
<!-- markdown-link-check-disable -->

| | Package | Version in 3.2.0 | Version in 4.0.0 | Status |
|---:|:------------------|:-----------------------|:-----------------------|:---------|
| 0 | ca-certificates | 20210119~18.04.2 | 20210119~18.04.2 | |
| 1 | python3-distutils | 3.6.9-1~18.04 | 3.6.9-1~18.04 | |
| 2 | python3.6 | 3.6.9-1~18.04ubuntu1.6 | 3.6.9-1~18.04ubuntu1.6 | |
| 3 | python3.6-dev | 3.6.9-1~18.04ubuntu1.6 | 3.6.9-1~18.04ubuntu1.6 | |
| 4 | curl | 7.58.0-2ubuntu3.16 | 7.58.0-2ubuntu3.16 | |
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
<!-- markdown-link-check-disable -->

| | Package | Version in 3.2.0 | Version in 4.0.0 | Status |
|---:|:----------|:---------------------|:---------------------|:---------|
| 0 | pandas | No version specified | No version specified | |
| 1 | numpy | No version specified | No version specified | |
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
<!-- markdown-link-check-disable -->

| | Package | Version in 3.2.0 | Version in 4.0.0 | Status |
|---:|:----------|:---------------------|:---------------------|:---------|
| 0 | trivy | No version specified | No version specified | |
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
<!-- markdown-link-check-disable -->

| | Package | Version in 3.2.0 | Version in 4.0.0 | Status |
|---:|:--------------------|:---------------------|:---------------------|:---------|
| 0 | apt-transport-https | No version specified | No version specified | |
| 1 | gnupg | No version specified | No version specified | |
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
<!-- markdown-link-check-disable -->

| | Package | Version in 3.2.0 | Version in 4.0.0 | Status |
|---:|:----------------|:--------------------------|:--------------------------|:---------|
| 0 | coreutils | 8.28-1ubuntu1 | 8.28-1ubuntu1 | |
| 1 | locales | 2.27-3ubuntu1.4 | 2.27-3ubuntu1.4 | |
| 2 | libnss-db | 2.2.3pre1-6build2 | 2.2.3pre1-6build2 | |
| 3 | libzmq3-dev | 4.2.5-1ubuntu0.2 | 4.2.5-1ubuntu0.2 | |
| 4 | libprotobuf-dev | 3.0.0-9.1ubuntu1 | 3.0.0-9.1ubuntu1 | |
| 5 | libssl-dev | 1.1.1-1ubuntu2.1~18.04.14 | 1.1.1-1ubuntu2.1~18.04.14 | |
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
# Package Version Comparison between Python-3.6-data-science-cuda-exasol-6.2.0 flavor in 4.0.0 and Python-3.6-data-science-cuda-exasol-6.2.0 flavor in 3.2.0

- Comparison of build step Udfclient_deps
- [Comparison of package list Apt Get Packages](udfclient_deps/apt_get_packages_diff.md)
- Comparison of build step Security_scan
- [Comparison of package list Apt Get Packages](security_scan/apt_get_packages_diff.md)
- [Comparison of package list Apt Get Packages Trivy Deps](security_scan/apt_get_packages_trivy_deps_diff.md)
- Comparison of build step Language_deps
- [Comparison of package list Apt Get Packages](language_deps/apt_get_packages_diff.md)
- [Comparison of package list Python3 Pip Packages](language_deps/python3_pip_packages_diff.md)
- Comparison of build step Flavor_base_deps
- [Comparison of package list Apt Get Packages](flavor_base_deps/apt_get_packages_diff.md)
- [Comparison of package list Python3 Pip Packages](flavor_base_deps/python3_pip_packages_diff.md)
- Comparison of build step Build_deps
- [Comparison of package list Apt Get Packages](build_deps/apt_get_packages_diff.md)
- Comparison of build step Base_test_deps
- [Comparison of package list Apt Get Packages](base_test_deps/apt_get_packages_diff.md)
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
<!-- markdown-link-check-disable -->

| | Package | Version in 3.2.0 | Version in 4.0.0 | Status |
|---:|:----------------|:-----------------------|:-----------------------|:---------|
| 0 | python-protobuf | 3.0.0-9.1ubuntu1 | 3.0.0-9.1ubuntu1 | |
| 1 | python-zmq | 16.0.2-2build2 | 16.0.2-2build2 | |
| 2 | gdb | 8.1.1-0ubuntu1 | 8.1.1-0ubuntu1 | |
| 3 | valgrind | 1:3.13.0-2ubuntu2.3 | 1:3.13.0-2ubuntu2.3 | |
| 4 | gdbserver | 8.1.1-0ubuntu1 | 8.1.1-0ubuntu1 | |
| 5 | binutils | 2.30-21ubuntu1~18.04.7 | 2.30-21ubuntu1~18.04.7 | |
| 6 | patchelf | 0.9-1 | 0.9-1 | |
| 7 | chrpath | 0.16-2 | 0.16-2 | |
| 8 | strace | 4.21-1ubuntu1 | 4.21-1ubuntu1 | |
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
<!-- markdown-link-check-disable -->

| | Package | Version in 3.2.0 | Version in 4.0.0 | Status |
|---:|:------------------|:-------------------------|:-------------------------|:---------|
| 0 | coreutils | 8.28-1ubuntu1 | 8.28-1ubuntu1 | |
| 1 | locales | 2.27-3ubuntu1.4 | 2.27-3ubuntu1.4 | |
| 2 | locales | 2.27-3ubuntu1.4 | 2.27-3ubuntu1.4 | |
| 3 | locales | 2.27-3ubuntu1.4 | 2.27-3ubuntu1.4 | |
| 4 | locales | 2.27-3ubuntu1.4 | 2.27-3ubuntu1.4 | |
| 5 | tar | 1.29b-2ubuntu0.2 | 1.29b-2ubuntu0.2 | |
| 6 | curl | 7.58.0-2ubuntu3.16 | 7.58.0-2ubuntu3.16 | |
| 7 | openjdk-11-jdk | 11.0.11+9-0ubuntu2~18.04 | 11.0.11+9-0ubuntu2~18.04 | |
| 8 | build-essential | 12.4ubuntu1 | 12.4ubuntu1 | |
| 9 | libpcre3-dev | 2:8.39-9 | 2:8.39-9 | |
| 10 | protobuf-compiler | 3.0.0-9.1ubuntu1 | 3.0.0-9.1ubuntu1 | |
| 11 | chrpath | 0.16-2 | 0.16-2 | |
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
<!-- markdown-link-check-disable -->

| | Package | Version in 3.2.0 | Version in 4.0.0 | Status |
|---:|:---------------------|:--------------------------|:--------------------------|:---------|
| 0 | coreutils | 8.28-1ubuntu1 | 8.28-1ubuntu1 | |
| 1 | locales | 2.27-3ubuntu1.4 | 2.27-3ubuntu1.4 | |
| 2 | unzip | 6.0-21ubuntu1.1 | 6.0-21ubuntu1.1 | |
| 3 | wget | 1.19.4-1ubuntu2.2 | 1.19.4-1ubuntu2.2 | |
| 4 | git | 1:2.17.1-1ubuntu0.9 | 1:2.17.1-1ubuntu0.9 | |
| 5 | python3-tk | 3.6.9-1~18.04 | 3.6.9-1~18.04 | |
| 6 | libcurl4-openssl-dev | 7.58.0-2ubuntu3.16 | 7.58.0-2ubuntu3.16 | |
| 7 | libssl-dev | 1.1.1-1ubuntu2.1~18.04.14 | 1.1.1-1ubuntu2.1~18.04.14 | |
| 8 | build-essential | 12.4ubuntu1 | 12.4ubuntu1 | |
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
<!-- markdown-link-check-disable -->

| | Package | Version in 3.2.0 | Version in 4.0.0 | Status |
|---:|:-----------------|:---------------------|:---------------------|:---------|
| 0 | pyexasol | No version specified | No version specified | |
| 1 | gensim | No version specified | No version specified | |
| 2 | statsmodels | No version specified | No version specified | |
| 3 | pycurl | No version specified | No version specified | |
| 4 | scikit-learn | No version specified | No version specified | |
| 5 | scipy | 1.2.1 | 1.2.1 | |
| 6 | numpy | No version specified | No version specified | |
| 7 | ujson | No version specified | No version specified | |
| 8 | lxml | No version specified | No version specified | |
| 9 | nltk | No version specified | No version specified | |
| 10 | keras | 2.3.1 | 2.3.1 | |
| 11 | lifelines | No version specified | No version specified | |
| 12 | imbalanced-learn | No version specified | No version specified | |
| 13 | matplotlib | No version specified | No version specified | |
| 14 | seaborn | No version specified | No version specified | |
| 15 | kmodes | No version specified | No version specified | |
| 16 | tensorflow-hub | 0.4.0 | 0.4.0 | |
| 17 | tensorflow-gpu | 1.13.1 | 1.13.1 | |
| 18 | PyYAML | No version specified | No version specified | |
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
<!-- markdown-link-check-disable -->

| | Package | Version in 3.2.0 | Version in 4.0.0 | Status |
|---:|:------------------|:-----------------------|:-----------------------|:---------|
| 0 | python3.6 | 3.6.9-1~18.04ubuntu1.6 | 3.6.9-1~18.04ubuntu1.6 | |
| 1 | python3.6-dev | 3.6.9-1~18.04ubuntu1.6 | 3.6.9-1~18.04ubuntu1.6 | |
| 2 | python3-distutils | 3.6.9-1~18.04 | 3.6.9-1~18.04 | |
| 3 | curl | 7.58.0-2ubuntu3.16 | 7.58.0-2ubuntu3.16 | |
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
<!-- markdown-link-check-disable -->

| | Package | Version in 3.2.0 | Version in 4.0.0 | Status |
|---:|:----------|:---------------------|:---------------------|:---------|
| 0 | pandas | No version specified | No version specified | |
| 1 | numpy | No version specified | No version specified | |
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
<!-- markdown-link-check-disable -->

| | Package | Version in 3.2.0 | Version in 4.0.0 | Status |
|---:|:----------|:---------------------|:---------------------|:---------|
| 0 | trivy | No version specified | No version specified | |
Loading

0 comments on commit 6d490d4

Please sign in to comment.