Skip to main content

How to Enable HDP

  1. Create a new MySQL database: MDHDP

    1. Enter the container:

      docker exec -it $(docker ps | grep -E 'mingdaoyun-community|mingdaoyun-hap' | awk '{print $1}') bash

    2. Log in to MySQL:

      mysql -h sc -P 3306 -uroot -p123456

    3. Create the database:

      CREATE DATABASE IF NOT EXISTS MDHDP DEFAULT CHARACTER SET utf8mb4 DEFAULT COLLATE utf8mb4_general_ci;

  2. If MongoDB is enabled with authentication, you will need to manually create the mdhdp database. Refer to How to Create a MongoDB Database.

  3. Deploy the Flink service by referring to: How to Deploy Flink Service

    • HDP requires the Flink service. Before enabling HDP, ensure that the Flink service has been successfully deployed.

    • If Flink was previously deployed for data integration or aggregation table functionality, you need to upgrade Flink to 1.19.720.

      Upgrade Notice

      After upgrading Flink, pre-existing data integration synchronization tasks and aggregation tables must be manually restarted to resume operation.

  4. Download the HDP image (Offline Package Downloads):

    docker pull registry.cn-hangzhou.aliyuncs.com/mdpublic/mingdaoyun-hdp:1.1.0

  5. Modify the docker-compose.yaml file (default path: /data/mingdao/script/docker-compose.yaml).

    1. Add the HDP service:

        hdp:
          image: registry.cn-hangzhou.aliyuncs.com/mdpublic/mingdaoyun-hdp:1.1.0
          environment:
            <<: *app-environment

    2. Add the ENV_HDP_ENABLE environment variable to the app service:

      app:
        environment:
          ENV_HDP_ENABLE: "true"
      Click to View the Complete Changes Example
      version: '3'

      services:
        app:
          image: registry.cn-hangzhou.aliyuncs.com/mdpublic/mingdaoyun-hap:7.3.4
          environment: &app-environment
            ENV_ADDRESS_MAIN: "https://hap.domain.com"
            ENV_APP_VERSION: "7.3.4"
            ENV_API_TOKEN: "******"
            ENV_FLINK_URL: "http://flink:8081"
            ENV_HDP_ENABLE: "true"  # Added: Enable HDP
          ports:
            - 8880:8880
          volumes:
            - ./volume/data/:/data/
            - ../data:/data/mingdao/data

        sc:
          image: registry.cn-hangzhou.aliyuncs.com/mdpublic/mingdaoyun-sc:3.2.0
          environment:
            <<: *app-environment
          volumes:
            - ./volume/data/:/data/

        command:
          image: registry.cn-hangzhou.aliyuncs.com/mdpublic/mingdaoyun-command:node1018-python36

        doc:
          image: registry.cn-hangzhou.aliyuncs.com/mdpublic/mingdaoyun-doc:2.0.0

        flink:
          image: registry.cn-hangzhou.aliyuncs.com/mdpublic/mingdaoyun-flink:1.19.720
          entrypoint: ["/bin/bash"]
          command: ["/run.sh"]
          environment: 
            ENV_FLINK_S3_ENDPOINT: "sc:9010"
          volumes:
            - ./volume/data/:/data/

        # --- Newly Added Service ---
        hdp:
          image: registry.cn-hangzhou.aliyuncs.com/mdpublic/mingdaoyun-hdp:1.1.0
          environment:
            <<: *app-environment

  6. Restart services by running the following command in the decompressed installation manager directory:

    bash service.sh restartall