Release 0.3

Author: vikrantcue

cuelake.yaml

@@ -8,19 +8,14 @@ data:
   # POSTGRES_DB_USERNAME: postgres
   # POSTGRES_DB_PASSWORD: postgres
   # POSTGRES_DB_SCHEMA: cuelake
-  # POSTGRES_DB_PORT: 5432
-  
-  ## S3 Settings
-  # export S3_BUCKET_NAME="YourBucketName"
-  # export S3_FILES_PREFIX="files/"
-  # export HADOOP_S3_PREFIX="cuelake/"
+  # POSTGRES_DB_PORT: '5432'
 
   ## Change below properties to point to your metastore database
-  # METASTORE_POSTGRES_HOST="localhost"
-  # METASORE_POSTGRES_PORT=5432
-  # METASORE_POSTGRES_USERNAME="postgres"
-  # METASORE_POSTGRES_PASSWORD="postgres"
-  # METASORE_POSTGRES_DATABASE="cuelake_metastore"
+  # METASTORE_POSTGRES_HOST: localhost
+  # METASORE_POSTGRES_PORT: '5432'
+  # METASORE_POSTGRES_USERNAME: postgres
+  # METASORE_POSTGRES_PASSWORD: postgres
+  # METASORE_POSTGRES_DATABASE: cuelake_metastore
 ---
 apiVersion: v1
 kind: ConfigMap
@@ -129,7 +124,7 @@ spec:
             path: nginx.conf
       containers:
       - name: zeppelin-server
-        image: cuebook/zeppelin-server-lite:0.2
+        image: cuebook/zeppelin-server-lite:0.3
         command: ["sh", "-c"]
         args:
           - curl https://raw.githubusercontent.com/cuebook/cuelake/main/zeppelinConf/zeppelin-env.sh -o $(ZEPPELIN_HOME)/conf/zeppelin-env.sh && curl https://raw.githubusercontent.com/cuebook/cuelake/main/zeppelinConf/zeppelin-site.xml -o $(ZEPPELIN_HOME)/conf/zeppelin-site.xml && $(ZEPPELIN_HOME)/bin/zeppelin.sh
@@ -290,7 +285,7 @@ spec:
           claimName: lakehouse-db-volume-pvc
       containers:
       - name: lakehouse
-        image: cuebook/lakehouse:0.2
+        image: cuebook/lakehouse:0.3
         resources:
           requests:
             memory: "2560Mi"

docs/getting-started.md

@@ -27,7 +27,7 @@ You should see 3 pods in running status, something like below:
 NAME                               READY   STATUS    RESTARTS   AGE
 lakehouse-74cd5d759b-8pj5c         1/1     Running   0          1m
 redis-69cc674bf8-rsd74             1/1     Running   0          1m
-zeppelin-server-865974dc55-rt9vg   3/3     Running   0          1m
+zeppelin-server-main-865974dc55-rt9vg   3/3     Running   0          1m
 ```
 
 Now visit [http://localhost:8080](http://localhost:8080) in your browser.

docs/index.md

@@ -65,8 +65,6 @@ A lakehouse is a new, open architecture that combines the best elements of data
 
 ### Current Limitations
 * Supports AWS S3 as a destination. Support for ADLS and GCS is in the roadmap.
-* Uses Apache Iceberg as an open table format. Delta support is in the roadmap.
-* Uses Celery for scheduling jobs. Support for Airflow is in the roadmap.
 
 
 # Support

docs/installation.md

@@ -81,26 +81,6 @@ POSTGRES_DB_SCHEMA="cuelake_db"
 POSTGRES_DB_PORT=5432
 ```
 
-### S3 Settings
-Name of the S3 bucket being used as your data warehouse location. This will be also used for uploading files via CueLake.
-
-```yaml
-S3_BUCKET_NAME="YourBucketName"
-```
-
-Default directory for uplaoding files is s3://<YourBucketName>/files. If you wish to change it you can do so by setting S3_FILES_PREFIX property.
-
-```yaml
-S3_FILES_PREFIX="files/"
-```
-
-Default directory for iceberg tables (hadoop catalog) is s3://<YourBucketName>/cuelake. If you wish to change it you can do so by setting HADOOP_S3_PREFIX property.
-
-```yaml
-HADOOP_S3_PREFIX="cuelake/"
-```
-
-If you change HADOOP_S3_PREFIX, please change the spark interpreter setting `spark.sql.catalog.cuelake.warehouse` accordingly. 
 
 ### Metastore DB Settings
 We currently support Postgres as spark metastore database. Information related to saved spark tables and views get stored here. If not set the tables and views will be destroyed on every interpreter restart.