Cross-Source Analysis Development Methods

Cross-Source Analysis

If DLI needs to access external data sources, you need to establish enhanced datasource connections to enable the network between DLI and the data sources, and then develop different types of jobs to access the data sources. This is the process of DLI cross-source analysis.

This section describes how to develop data sources supported by DLI for cross-source analysis.

Notes

  • Flink jobs can directly access DIS, OBS, and SMN data sources without using datasource connections.

  • You are advised to use enhanced datasource connections to connect DLI to data sources.

DLI Supported Data Sources

Table 1 lists the data sources supported by DLI. For details about how to use the data sources, see Data Lake Insight SQL Syntax Reference.

Table 1 Supported data sources

Service

Spark SQL Job

Spark Jar Job

Flink SQL Job

Flink Jar Job

APIG

x

x

Y

x

CSS

Y

Y

Y

Y

DCS Redis

Y

Y

Y

Y

DDS

Y

Y

Y

Y

DMS Kafka

x

x

Y

Y

GaussDB(DWS)

Y

Y

Y

Y

MRS HBase

Y

Y

Y

Y

MRS Kafka

x

x

Y

Y

MRS OpenTSDB

Y

Y

x

Y

RDS for MySQL

Y

Y

Y

Y

RDS PostGre

Y

Y

Y

Y

last updated: 2024-11-20 15:34 UTC - commit: c856450509a511f9057fb9577287974ed6fce406