Skip to content

Commit

Permalink
[FSTORE-1088] Bump recommended Databricks runtime version to 12.2
Browse files Browse the repository at this point in the history
  • Loading branch information
SirOibaf committed Nov 22, 2023
1 parent 0a94528 commit edc29bd
Show file tree
Hide file tree
Showing 2 changed files with 9 additions and 1 deletion.
5 changes: 4 additions & 1 deletion docs/user_guides/integrations/databricks/configuration.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,6 @@
---
description: Documentation on how to configure a Databricks cluster to read and write features from the Hopsworks Feature Store
---
# Databricks Integration

Users can configure their Databricks clusters to write the results of feature engineering pipelines in the Hopsworks Feature Store using HSFS.
Expand Down Expand Up @@ -56,7 +59,7 @@ A cluster needs to exist before users can configure it using the Hopsworks UI. T

!!! warning "Runtime limitation"

Currently Runtime 9.1 LTS is suggested to be able to use the full suite of Hopsworks Feature Store capabilities.
Currently Runtime 12.2 LTS is suggested to be able to use the full suite of Hopsworks Feature Store capabilities.

## Configure a cluster

Expand Down
5 changes: 5 additions & 0 deletions docs/user_guides/integrations/spark.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,11 @@ The three files (`keyStore.jks`, `trustStore.jks` and `material_passwd`) should

## Configure your Spark cluster

!!! warning "Spark version limitation"

Currently Spark version 3.3.0 is suggested to be able to use the full suite of Hopsworks Feature Store capabilities.


Add the following configuration to the Spark application:

```
Expand Down

0 comments on commit edc29bd

Please sign in to comment.