Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
Spark: The ApacheSpark.Tables function returns a table listing the tables on the Spark cluster host using protocol. Valid protocols are: SparkProtocol.Standard, SparkProtocol.HTTP.
Azure HDInsight Spark: List the tables in an Azure Spark instance.
Summary
| Property | Value |
|---|---|
| Connector | SparkAzure HDInsight Spark |
| Products | Power BI (semantic models) Power Query Online |
| Release state | General availability |
| Category | Azure and Other |
| Authentication kinds | Username / Password Windows |
| Data source kind | Spark |
| Function Reference Documentation | ApacheSpark.TablesAzureSpark.TablesSpark.Tables |
Supported capabilities
Spark
Entry point: ApacheSpark.Tables
- DirectQuery
Azure HDInsight Spark
Entry point: AzureSpark.Tables
- DirectQuery
Parameters
Spark
Entry point: ApacheSpark.Tables
Required parameter count: 2
Returns a table listing the tables on the specified Spark cluster.
Returns a table listing the tables on the Spark cluster host using protocol. Valid protocols are:
SparkProtocol.Standard, SparkProtocol.HTTP
| Parameter | Display name | Required | Type | Group | Description | Allowed values | Sample values | Nullable | Additional metadata | Allowed value metadata | Declared allowed values |
|---|---|---|---|---|---|---|---|---|---|---|---|
| server | Server | Yes | text | Spark Server | "http://example.com:10000/cliservice" | false | |||||
| protocol | Protocol | Yes | number | The protocol to use when connecting to an instance of Spark. | 0 (Standard); 2 (HTTP) | false | {"Documentation.Name": "SparkProtocol.Type"} | [{"Metadata": {"Documentation.Caption": "Standard", "Documentation.Name": "SparkProtocol.Standard"}, "Value": 0}, {"Metadata": {"Documentation.Caption": "HTTP", "Documentation.Name": "SparkProtocol.HTTP"}, "Value": 2}] | [0, 2] | ||
| options | Advanced Options | No | nullable record | Advanced Options | true |
Fields in options
| Field | Display name | Required | Type | Group | Sample values | Nullable | Optional |
|---|---|---|---|---|---|---|---|
| options.BatchSize | Batch Size | No | number | Advanced Options | 10000 | false | true |
| options.HierarchicalNavigation | Create hierarchical navigation view | No | nullable logical | Advanced Options | true | true | |
| options.Implementation | Use new implementation | No | text | Advanced Options | "1.0"; "2.0" | false | true |
Note
The ADBC-based implementation (Implementation = "2.0") is available only when Protocol is set to HTTP (SparkProtocol.HTTP). It isn't supported with the Standard protocol. To use it, select HTTP and enter 2.0 in Use new implementation under Advanced Options.
Azure HDInsight Spark
Entry point: AzureSpark.Tables
Required parameter count: 1
List the tables in an Azure Spark instance.
| Parameter | Display name | Required | Type | Group | Description | Sample values | Nullable |
|---|---|---|---|---|---|---|---|
| server | Server | Yes | text | Spark Server | "contoso.azurehdinsight.net" | false | |
| options | Advanced Options | No | nullable record | Advanced Options | true |
Fields in options
| Field | Display name | Required | Type | Group | Sample values | Nullable | Optional |
|---|---|---|---|---|---|---|---|
| options.BatchSize | Batch Size | No | number | Advanced Options | 10000 | false | true |
| options.HierarchicalNavigation | Create hierarchical navigation view | No | nullable logical | Advanced Options | true | true | |
| options.Implementation | Use new implementation | No | text | Advanced Options | "1.0"; "2.0" | false | true |
Spark