Using the Metadata Browser on the Hue Web UI¶

Scenario¶

Users can use the Hue web UI to manage Hive metadata in an MRS cluster.

For versions earlier than MRS 1.9.2, MRS clusters with Kerberos authentication enabled support this function.

Using Metastore Manager¶

Access the Hue web UI. For details, see Accessing the Hue Web UI.

Choose Data Browsers > Metastore Tables, and access Metastore Manager.

Viewing metadata of Hive tables
In the left navigation pane, move the cursor to a table and click on the right. The metadata of the Hive table is displayed.
Managing metadata of Hive tables
On the metadata page of a Hive table, you can click in the upper right corner to import data, click to browse data, and click to view the location of the table file.
Caution
The Hue page is used to view and analyze data such as files and tables. Do not perform high-risk management operations such as deleting objects on the page. If an operation is required, you are advised to perform the operation on each component after confirming that the operation has no impact on services. For example, you can use the HDFS client to perform operations on HDFS files and use the Hive client to perform operations on Hive tables.
Managing Hive metadata tables
Click in the upper right corner to create a table in the database based on the uploaded files. Or click in the upper right corner to manually create a table.

Accessing Metastore Manager¶

Access the Hue web UI. For details, see Accessing the Hue Web UI.
Choose Data Browsers > Metastore Tables, and access Metastore Manager.
Metastore Manager supports the following functions:
- Creating a Hive table from a file
- Manually creating a Hive table
- Viewing Hive table metadata

Creating a Hive table from a File¶

Access Metastore Manager and select a database in Databases.
The default database is default.
Click . The Create a new table from a file page is displayed.
Select a file.
1. In Table Name, enter a Hive table name.
  A Hive table name contains no more than 128 characters, including letters, numbers, or underscores (_), and must start with a letter or number.
2. In Description, enter description about the Hive table as required.
3. In Input File or Location, click and select a Hive table file from HDFS. The file is used to store new data of the Hive table.
  If the file is not stored in HDFS, click Upload a file to upload the file from the local directory to HDFS. Multiple files can be simultaneously uploaded. The files cannot be empty.
4. If you need to import the data in the file to the Hive table, select Import data as Load method. By default, Import data is selected.
  If you select Create External Table, a Hive external table is created.
  Note
  If you select Create External Table, set Input File or Location to a path.
  If you select Leave Empty, an empty Hive table is created.
5. Click Next.
Set a delimiter.
1. In Delimiter, select one.
  If your desired delimiter is not in the list, select Other.. and enter a delimiter.
2. Click Preview to preview data processing.
3. Click Next.
Define a column.
1. If you click on the right side of Use first row as column names, the first row of data in the file is used as a column name. If you do not click it, the first row of data is not used as the column name.
2. In Column name, set a name for each column.
  A Hive table name contains no more than 128 characters, including letters, numbers, or underscores (_), and must start with a letter or number.
  Note
  You can rename columns in batches by clicking on the right side of Bulk edit column names. Enter all column names and separate them by commas (,).
3. In Column Type, select a type for each column.
Click Create Table to create the table. Wait for Hue to display information about the Hive table.

Manually Creating a Hive Table¶

Access Metastore Manager and select a database in Databases.
The default database is default.
Click . The Create a new table manually page is displayed.
Set a table name.
1. In Table Name, enter a Hive table name.
  A Hive table name contains no more than 128 characters, including letters, numbers, or underscores (_), and must start with a letter or number.
2. In Description, enter description about the Hive table as required.
3. Click Next.
Select a data storage format.
- If data needs to be separated by delimiters, select Delimited and perform 5.
- If data needs to be stored in serialization format, select SerDe and perform 6.
Set a delimiter.
1. In Field terminator, set a column delimiter.
  If your desired delimiter is not in the list, select Other.. and enter a delimiter.
2. In Collection terminator, set a delimiter to separate the data set of columns of the array type in Hive. For example, the type of a column is array. A value needs to store employee and manager. The user specifies a colon (:) as the delimiter. Therefore, the final value is employee:manager.
3. In Map key terminator, set a delimiter to separate the data set of columns of the map type in Hive. For example, the type of a column is map. A value needs to store home of aaa and company of bbb. The user defines | as the delimiter. Therefore, the final value is home|aaa:company|bbb.
4. Click Next and perform 7.
Set serialization properties.
1. In SerDe Name, enter the class name of the serialization format: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
  Users can expand Hive to support more customized serialization classes.
2. In Serde properties, enter the value of the serialization format: "field.delim"="," "colelction.delim"=":" "mapkey.delim"="|"
3. Click Next and perform 7.
Select a data table format and click Next.
- TextFile: indicates that data is stored in text files.
- SequenceFile: indicates that data is stored in binary files.
- InputFormat: indicates that data in files is used in the customized input and output formats.
  Users can expand Hive to support more customized formatting classes.
  1. In InputFormat Class, enter the class used by input data: org.apache.hadoop.hive.ql.io.RCFileInputFormat
  2. In OutputFormat Class, enter the class used by output data: org.apache.hadoop.hive.ql.io.RCFileOutputFormat
Select a file storage location and click Next.
Use default location is selected by default. If you want to customize a storage location, deselect the default value and specify a file storage location in External location by clicking .
Set columns of the Hive table.
1. In Column name, set a column name.
  A Hive table name contains no more than 128 characters, including letters, numbers, or underscores (_), and must start with a letter or number.
2. In Column type, select a type for each column.
  Click Add a column to add a new column.
3. Click Add a partition to add a new partition for the Hive table to improve the query efficiency.
Click Create Table to create a new table. Wait for Hue to display information about the Hive table.

Managing the Hive Table¶

Access Metastore Manager and select a database in Databases. All tables in the database are displayed on the page.
The default database is default.
Click a table name in the database to view table details.
The following operations are supported: importing data, browsing data,, or viewing file storage location. When viewing all tables in the database, you can select tables and perform the following operations such as viewing tables and browsing data.
Caution
The Hue page is used to view and analyze data such as files and tables. Do not perform high-risk management operations such as deleting objects on the page. If an operation is required, you are advised to perform the operation on each component after confirming that the operation has no impact on services. For example, you can use the HDFS client to perform operations on HDFS files and use the Hive client to perform operations on Hive tables.

last updated: 2024-05-11 01:37