Developing and Submitting a Spark SQL Job Using the TPC-H Sample Template¶
DLI allows you to customize query templates or save frequently used SQL statements as templates to facilitate SQL operations. After templates are saved, you do not need to write SQL statements. You can directly perform the SQL operations using the templates.
The current system provides various standard TPC-H query statement templates. You can select a template as needed. This example shows how to use a TPC-H template to develop and submit a Spark SQL job.
For details about the templates, see SQL Template Management.
Procedure¶
Log in to the DLI management console.
On the DLI management console, choose Job Templates > SQL Templates, and click the Sample Templates tab. Locate the Q1_Price_summary_report_query template under tpchQuery, and click Execute in the Operation column. The SQL Editor page is displayed.
In the upper part of the editing window, set Engine to spark, Queues to default, and Databases to default, and click Execute.
View the query result in the View Result tab in the lower part of the SQL Editor page.
This example uses the default queue and database preset in the system as an example. You can also run query statements on a self-created queue and database.
For details about how to create a queue, see "Creating a Queue" in Data Lake Insight User Guide. For details about how to create a database, see Creating a Database.