From edc29bd6dda9a64fc55b965f97a183a17e864e73 Mon Sep 17 00:00:00 2001 From: Fabio Buso Date: Wed, 22 Nov 2023 11:40:17 +0100 Subject: [PATCH] [FSTORE-1088] Bump recommended Databricks runtime version to 12.2 --- docs/user_guides/integrations/databricks/configuration.md | 5 ++++- docs/user_guides/integrations/spark.md | 5 +++++ 2 files changed, 9 insertions(+), 1 deletion(-) diff --git a/docs/user_guides/integrations/databricks/configuration.md b/docs/user_guides/integrations/databricks/configuration.md index 85c552868..592c96387 100644 --- a/docs/user_guides/integrations/databricks/configuration.md +++ b/docs/user_guides/integrations/databricks/configuration.md @@ -1,3 +1,6 @@ +--- +description: Documentation on how to configure a Databricks cluster to read and write features from the Hopsworks Feature Store +--- # Databricks Integration Users can configure their Databricks clusters to write the results of feature engineering pipelines in the Hopsworks Feature Store using HSFS. @@ -56,7 +59,7 @@ A cluster needs to exist before users can configure it using the Hopsworks UI. T !!! warning "Runtime limitation" - Currently Runtime 9.1 LTS is suggested to be able to use the full suite of Hopsworks Feature Store capabilities. + Currently Runtime 12.2 LTS is suggested to be able to use the full suite of Hopsworks Feature Store capabilities. ## Configure a cluster diff --git a/docs/user_guides/integrations/spark.md b/docs/user_guides/integrations/spark.md index fea2cd0b1..eb877c5e6 100644 --- a/docs/user_guides/integrations/spark.md +++ b/docs/user_guides/integrations/spark.md @@ -28,6 +28,11 @@ The three files (`keyStore.jks`, `trustStore.jks` and `material_passwd`) should ## Configure your Spark cluster +!!! warning "Spark version limitation" + + Currently Spark version 3.3.0 is suggested to be able to use the full suite of Hopsworks Feature Store capabilities. + + Add the following configuration to the Spark application: ```