--- name: dingtalk_channel_connect description: "Use a headed browser to automatically complete DingTalk channel integration for QwenPaw. Applicable when the user mentions DingTalk, developer console, Client ID, Client Secret, bot, Stream mode, binding or configuring a channel. Supports pausing when a login page is detected and resuming after the user logs in." metadata: builtin_skill_version: "1.3" qwenpaw: emoji: "🤖" requires: {} --- # DingTalk Channel Auto-Connect (Headed Browser) This skill automates the creation of a DingTalk application and the binding of a QwenPaw channel using a headed browser. ## Mandatory Rules 1. Must launch in headed browser mode: ```json {"action": "start", "headed": true} ``` 2. Must pause when a login gate is encountered: - If the page displays a login screen (e.g., login prompt, QR code login, phone/password login), stop automated operations immediately. - Clearly prompt the user to log in manually first, then wait for the user to reply with "logged in / continue". - Do not proceed with subsequent steps until the user confirms. 3. Any application configuration change only takes effect after creating a new version and publishing: - After configuring bot-related information, **you must publish the bot**. - Whether creating a new application or modifying application information (name, description, icon, bot configuration, etc.), you **must perform "create new version + publish"** at the end. - Do not claim the configuration is active if publishing has not been completed. ## Pre-Execution Confirmation (Must Do First) Before starting automated clicks, initiate a "configuration confirmation" with the user, clearly informing them of customizable fields, image specifications, and default values. Use the following structured confirmation: 1. Allow the user to customize the following fields: - Application name - Application description - Bot icon image URL or local path - Bot message preview image URL or local path 2. Clearly state the image specifications (prominently): - Bot icon: JPG/PNG only, `240*240px` or larger, `1:1` ratio, under `2MB`, no rounded corners. - Bot message preview image: format `png/jpeg/jpg`, no more than `2MB`. 3. Clearly state the default values (used automatically if the user does not specify): - Application name: `QwenPaw` - Application description: `Your personal assistant` - Bot icon: `https://img.alicdn.com/imgextra/i4/O1CN01M0iyHF1FVNzM9qjC0_!!6000000000492-2-tps-254-254.png` - Bot message preview image: `https://img.alicdn.com/imgextra/i4/O1CN01M0iyHF1FVNzM9qjC0_!!6000000000492-2-tps-254-254.png` 4. If the user provides no custom values, you must first explicitly reply: - "All default settings will be used (QwenPaw / Your personal assistant / default images). Proceeding now." ## Image Upload Strategy (Both link and path are supported) 1. If the user provides a local path, use it directly for upload. 2. If the user provides an image link, download it to a local temporary file first, then upload. 3. The upload action sequence must be: - First click the page upload entry (to trigger the chooser) - Then call `file_upload` with the local path array (`paths_json`) 4. If the upload fails due to image specification mismatch (dimensions, ratio, size, format): - Immediately pause automation - Clearly ask the user to manually upload a compliant image - After the user confirms "uploaded / continue", resume from the current step ### Practical Upload Tips 1. The `paths_json` of `file_upload` must be a "JSON string array" -- note the escaping: ```json { "action": "file_upload", "paths_json": "[\"xxx.png\"]", "frame_selector": "iframe[src*=\"/fe/app?isHideOuterFrame=true\"]" } ``` 2. If the page is within an iframe, prefer including `frame_selector`; otherwise the upload control may not be found or the chooser may not trigger. 3. You must click the upload entry before calling `file_upload`; calling it directly will result in: - `No chooser. Click upload then file_upload.` 4. Common structural features of the bot icon area that can be used for locating elements (examples; these may appear as Chinese UI labels in the DingTalk console): - `text: "* 机器人图标"` (Bot Icon) - `button: "使用应用图标"` (Use App Icon) - `button: "avatar"` (usually contains `img "avatar"` inside) 5. When the snapshot shows both "使用应用图标" ("Use App Icon") and "avatar", prefer clicking the `avatar` button to trigger the upload, then call `file_upload`. ## Automation Flow ### Step 1: Open the DingTalk Developer Console 1. Launch the browser in headed mode (`headed: true`) 2. Navigate to `https://open-dev.dingtalk.com/` 3. Call `snapshot` to check if login is required If login is required, pause with the following message: > Login to the DingTalk Developer Console is required. I have paused automated operations. Please complete the login in the opened browser. Reply "continue" when done, and I will resume from the current page. ### Step 2: Create an Internal Enterprise Application After the user confirms login, continue: 1. Navigate to the creation path: - Application Development -> Internal Enterprise Applications -> DingTalk Applications -> Create Application 2. Fill in the application information (prefer user-customized values, otherwise use defaults): - Application name: default `QwenPaw` - Application description: default `Your personal assistant` 3. Save and create the application If the page text or structure does not match expectations, re-run `snapshot` and relocate elements based on visible text semantics. ### Step 3: Add Bot Capability and Publish 1. Click **Add Application Capability** under **Application Capabilities**, find **Bot** and add it 2. Toggle the switch button on the right side of **Bot Configuration** to enabled 3. Fill in **Bot Name**, **Bot Brief**, and **Bot Description** 4. Upload the **Bot Icon** (user-customized or default image): - Click the image below the bot icon label - Default image URL: `https://img.alicdn.com/imgextra/i4/O1CN01M0iyHF1FVNzM9qjC0_!!6000000000492-2-tps-254-254.png` - If it is a link, download to local first, then upload - If the image does not meet specifications, pause and ask the user to manually upload a compliant image before continuing 5. Upload the **Bot Message Preview Image** (user-customized or default image): - Click the image below the bot message preview image label - Default image URL: `https://img.alicdn.com/imgextra/i4/O1CN01M0iyHF1FVNzM9qjC0_!!6000000000492-2-tps-254-254.png` - If it is a link, download to local first, then upload - If the image does not meet specifications, pause and ask the user to manually upload a compliant image before continuing 6. Confirm that the message receiving mode is set to `Stream Mode` (the Chinese UI may display `Stream 模式`) 7. Select **Publish**; a further confirmation dialog will appear -- select publish. Note: **you must publish the bot** before proceeding to the next step ### Step 4: Create Version and Publish 1. Navigate to `Application Release -> Version Management & Release` 2. Create a new version (required after every configuration change) 3. Fill in the version description; set the application visibility scope to all employees 4. Follow the page prompts to complete publishing; a new dialog will appear -- select confirm publish 5. Only after seeing the successful publication status may you proceed with subsequent steps or tell the user "the configuration is now active" ### Step 5: Obtain Credentials 1. Navigate to `Basic Information -> Credentials & Basic Info` 2. Inform the user that the `Client ID` (AppKey) and `Client Secret` (AppSecret) are on this page. Do not make changes proactively; guide the user to bind them on their own ## QwenPaw Binding Methods After obtaining the credentials, guide the user to choose one of the following methods: 1. Console frontend configuration: - In the QwenPaw console, go to `Control -> Channels -> DingTalk` - Enter the `Client ID` and `Client Secret` 2. Configuration file method: ```json "dingtalk": { "enabled": true, "bot_prefix": "[BOT]", "client_id": "Your Client ID", "client_secret": "Your Client Secret" } ``` Path: `~/.qwenpaw/config.json`, under `channels.dingtalk`. ### Credential Delivery Requirements (Mandatory) 1. The agent is only responsible for guiding the user to the credentials page, obtaining and displaying the `Client ID` and the actual `Client Secret`. 2. The agent must not proactively modify the `console` configuration or `~/.qwenpaw/config.json`. 3. You must instruct the user to fill in the credentials manually using one of the following two methods: - Console frontend: `Control -> Channels -> DingTalk` - Configuration file: edit the `channels.dingtalk` field in `~/.qwenpaw/config.json` ## Browser Tool Usage Pattern Execute in the following order by default: 1. `start` with `headed: true` 2. `open` 3. `snapshot` 4. `click` / `type` / `select_option` / `press_key` as needed 5. frequent `snapshot` after page transitions 6. `stop` when done ## Stability and Recovery Strategy - Prefer using the `ref` from the latest `snapshot`; only use `selector` when necessary. - After each critical click or navigation, use a short wait (`wait_for`) and immediately re-run `snapshot`. - If the session expires or re-login is required mid-flow, pause again and wait for the user to log in before continuing from the current step. - If automation is blocked by tenant permissions or admin approval, clearly describe the blocker and ask the user to manually complete that step before resuming.