Hive Data Source

Overview

After Hive data sources are configured, you can use Data Fusion > Task Management function to import its data into the divine data table or entity, easy to use in the report, analysis model, intelligent operations and other modules.

Before configuring the Hive data source, check whether your Hive data source meets the requirements by referring to the following:

Add Hive Data Source

1. Select Data Fusion > Universal Data Access > Data Source Management.
2. Click All Data Source Tab page.
3. Click Hive Data Source.
4. Click on the top right corner Create Button.
5. Fill in Hive connection information.
   1. Data source connection name : It is customized by you and is the unique identification of the data source connection in the platform.
   2. Server : IP address to which the data source is connected.
   3. Port : indicates the port number to which the data source is connected.
   4. Database name : Optional. You can specify a specific database. If you do not specify a specific database, all databases under the connection will be obtained.
   5. Login mode:support Anonymous login and User name Password Indicates the login.
   6. Authentication mode:
      1. Authentication-free mode : indicates the configuration item in the hive configuration file hive-site.xmlhive.server2.authentication is NONE.In non-authentication mode, anonymous users access Hive in JDBC mode. Hive must have read permission for any user.
      2. KERBEROS：
         1. Client Principal: indicates the name of the client that has registered with the KDC.
         2. Krb5 Configuration File: Only supportkrb5.conf File upload with name and suffix.
         3. Keytab Secret key: Only support .keytab Format file.
   7. Data Connection URL: Automatically generated based on the above information.
6. Click Test Connection button.
7. Click Submit button.

Manage Hive Data Source

1. Select Data Fusion > Universal Data Access > Data Source Management.
2. Click Added data source Tab page.
3. Click Hive data source.
   1. Edit: Supports modifying all configuration parameters of data connection.
   2. Delete: Delete the current connection.

If the current data connection is used by the task, modifying the parameters or deleting the connection will cause the task to fail.

Table field type mapping rules

Import data from the Hive data source to the Sensor Data table. Incorrect field type mapping may result in content conversion errors or task execution failures. Configure the field mapping according to the following rules to ensure data conversion is safe:

Description

• The above mentioned types are the currently supported Hive field types.
• The configuration of unsupported type fields after task import will cause task execution to fail.