Spark Connect in Spark SQL

japila-books · Dec 21, 2024 · 7e27557 · 7e27557
1 parent 938b357
commit 7e27557
Show file tree

Hide file tree

Showing 5 changed files with 11 additions and 4 deletions.
diff --git a/docs/sql/.pages b/docs/sql/.pages
@@ -0,0 +1,4 @@
+title: Spark SQL
+nav:
+    - index.md
+    - ...
diff --git a/docs/SQLExecution.md → docs/sql/SQLExecution.md b/docs/SQLExecution.md → docs/sql/SQLExecution.md
diff --git a/docs/SparkSession.md → docs/sql/SparkSession.md b/docs/SparkSession.md → docs/sql/SparkSession.md
@@ -12,10 +12,10 @@ sessionUUID: String
 
 `sessionUUID` is used when:
 
-* `SparkConnectPlanner` is requested to [transformCachedLocalRelation](./server/SparkConnectPlanner.md#transformCachedLocalRelation)
+* `SparkConnectPlanner` is requested to [transformCachedLocalRelation](../server/SparkConnectPlanner.md#transformCachedLocalRelation)
 * `SessionHolder` is requested to `serverSessionId`
 * `SparkConnectArtifactStatusesHandler` is requested to `cacheExists`
-* `SparkConnectSessionManager` is requested to [getIsolatedSession](./server/SparkConnectSessionManager.md#getIsolatedSession), [getOrCreateIsolatedSession](./server/SparkConnectSessionManager.md#getOrCreateIsolatedSession)
+* `SparkConnectSessionManager` is requested to [getIsolatedSession](../server/SparkConnectSessionManager.md#getIsolatedSession), [getOrCreateIsolatedSession](../server/SparkConnectSessionManager.md#getOrCreateIsolatedSession)
 * `SparkSession` is requested to [addTag](#addTag), [sessionJobTag](#sessionJobTag)
 * `ArtifactManager` is requested to _many things_
 * `ExecutionListenerBus` is created (one per `SparkSession`) and requested to `doPostEvent`

diff --git a/docs/sql/index.md b/docs/sql/index.md
@@ -0,0 +1,4 @@
+# Spark SQL
+
+!!! note
+    Learn more in [The Internals of Spark SQL]({{ book.spark_sql }}).
diff --git a/mkdocs.yml b/mkdocs.yml
@@ -124,7 +124,6 @@ nav:
   - Internals:
     - overview.md
     - logging.md
-    - SparkSession.md
-    - SQLExecution.md
   - ... | server/**.md
   - ... | client/**.md
+  - ... | sql/**.md