aliyunpan

You can run the sync service using Docker or Docker Compose.

Required Environment Variables for Docker Run:

• ALIYUNPAN_PAN_DIR: Target cloud directory.
• ALIYUNPAN_SYNC_MODE: upload or download.
• ALIYUNPAN_SYNC_POLICY: exclusive or increment.
• ALIYUNPAN_SYNC_DRIVE: backup or resource.
• ALIYUNPAN_SYNC_LOG: true or false.

Docker Compose Configuration: Use the following environment variables in your docker-compose.yml:

• ALIYUNPAN_DOWNLOAD_PARALLEL: Download concurrency.
• ALIYUNPAN_UPLOAD_PARALLEL: Upload concurrency.
• ALIYUNPAN_DOWNLOAD_BLOCK_SIZE: Download block size (KB).
• ALIYUNPAN_UPLOAD_BLOCK_SIZE: Upload block size (KB).
• ALIYUNPAN_SYNC_CYCLE: infinity (loop) or onetime.
• ALIYUNPAN_LOCAL_DELAY_TIME: Delay in seconds to detect local file changes (useful for files being actively written).

version: '3'
services:
  sync:
    image: tickstep/aliyunpan-sync:<tag>
    container_name: aliyunpan-sync
    restart: always
    volumes:
      - ./data:/home/app/data:rw
      - /your/file/path/for/aliyunpan_config.json:/home/app/config/aliyunpan_config.json
    environment:
      - TZ=Asia/Shanghai
      - ALIYUNPAN_DOWNLOAD_PARALLEL=2
      - ALIYUNPAN_UPLOAD_PARALLEL=2
      - ALIYUNPAN_DOWNLOAD_BLOCK_SIZE=1024
      - ALIYUNPAN_UPLOAD_BLOCK_SIZE=10240
      - ALIYUNPAN_PAN_DIR=/my_sync_dir
      - ALIYUNPAN_SYNC_MODE=upload
      - ALIYUNPAN_SYNC_POLICY=increment
      - ALIYUNPAN_SYNC_CYCLE=infinity
      - ALIYUNPAN_SYNC_DRIVE=backup
      - ALIYUNPAN_SYNC_LOG=true
      - ALIYUNPAN_LOCAL_DELAY_TIME=3

You can control the number of files downloaded during a single download command execution by implementing the downloadFilePrepareCallback and downloadFileFinishCallback functions.

To achieve this, use PluginUtil.KV to track the count of files processed within a specific downloadActionId and use PluginUtil.HashTool.md5Hex on the driveFilePath to track the status of individual files.

Logic flow:

1. In downloadFilePrepareCallback, check if the current count for the downloadActionId has reached your desired limit. If so, set downloadApproved to "no".
2. If the limit is not reached, mark the file as "downloading" in the KV store.
3. In downloadFileFinishCallback, mark the file as "finish" in the KV store to prevent re-downloading in future runs.

function downloadFilePrepareCallback(context, params) {
    var result = {
        "downloadApproved": "yes",
        "localFilePath": ""
    };

    // Limit for this download action
    const maxCountOfDownloadAction = 3;

    // Only process files
    if (params["driveFileType"] != "file") {
        return
    }

    // Get current count for this download action
    var keyOfThisDownloadAction = "download:" + params["downloadActionId"];
    var valueOfThisDownloadAction = PluginUtil.KV.getString(keyOfThisDownloadAction);
    if (valueOfThisDownloadAction == "") {
        valueOfThisDownloadAction = "0";
    }
    var countOfThisDownloadAction = parseInt(valueOfThisDownloadAction);
    if (countOfThisDownloadAction >= maxCountOfDownloadAction) {
        // Limit reached, skip remaining files
        result["downloadApproved"] = "no";
        return result;
    }

    // Track individual file status
    var keyOfThisDownloadFile = "file:" + PluginUtil.HashTool.md5Hex(params["driveFilePath"]);
    var valueOfThisDownloadFile = PluginUtil.KV.getString(keyOfThisDownloadFile);
    if (valueOfThisDownloadFile == "finish") {
        // Already finished, skip
        return result;
    }
    PluginUtil.KV.putString(keyOfThisDownloadFile, "downloading");

    // Increment and save count
    countOfThisDownloadAction += 1;
    PluginUtil.KV.putString(keyOfThisDownloadAction, String(countOfThisDownloadAction));

    return result;
}

function downloadFileFinishCallback(context, params) {
  var keyOfThisDownloadFile = "file:" + PluginUtil.HashTool.md5Hex(params["driveFilePath"]);
  console.log(keyOfThisDownloadFile)
  PluginUtil.KV.putString(keyOfThisDownloadFile, "finish");
}