UI Automation Activities
Unified activities that work identically on both desktop (Win32, WPF, WinForms, UWP, Electron — via FlaUI/UIA3) and web (Chrome/Edge — via Playwright/CDP). The same Click, Type Into, and Get Text activities work in both contexts; the engine is selected automatically based on the parent container scope (Use Application Browser injects the desktop engine, Launch Browser injects the web engine).
Use Application Browser
Container that opens (or attaches to) a desktop application and provides the desktop automation context to all child activities. Equivalent to UiPath's Use Application/Browser activity.
| Parameter | Type | Required | Description |
|---|---|---|---|
| AppPath | String | Yes | Executable path or process name (e.g., notepad.exe, C:\\App\\app.exe) |
| Arguments | String | No | Command-line arguments to pass on launch |
| WaitForReady | Boolean | No (default: true) | Wait for the application to be ready after launch |
| Body | Activity sequence | Yes | Desktop automation activities to execute in scope |
Click
Simulates a mouse click on a UI element. Works for both desktop controls (via UIA3) and web elements (via Playwright) depending on the parent container scope.
| Parameter | Type | Default | Description |
|---|---|---|---|
| Selector | Selector XML / String | — | UiPath-style XML selector for the target element |
| ClickType | Single | Double | Right | Single | Type of mouse click |
| InputMethod | Simulate | WindowMessages | HardwareEvents | Simulate | How to deliver the click at the OS level |
| TimeoutMs | Int32 | 30000 | Max milliseconds to wait for the element to appear |
Type Into
Types text into a focused input field. Supports variable references and special characters.
| Parameter | Type | Default | Description |
|---|---|---|---|
| Selector | Selector XML / String | — | Target input element |
| Text | String | — | Text to type. Supports ${'$'}{variable} references. |
| ClearFirst | Boolean | false | Clear existing content before typing |
| InputMethod | Simulate | WindowMessages | HardwareEvents | Simulate | Typing delivery method |
| TimeoutMs | Int32 | 30000 | Max wait for element |
| 1 | Type Into: |
| 2 | Selector: <ctrl automationid='txtEmail' controltype='Edit'/> |
| 3 | Text: "{userEmail{'}'}" |
| 4 | ClearFirst: true |
Get Text
Reads the displayed text or value of a UI element into a variable.
| Parameter | Type | Required | Description |
|---|---|---|---|
| Selector | Selector XML / String | Yes | Element to read |
| OutputVariable | String | Yes | Variable name to store the extracted text |
| TimeoutMs | Int32 | No | Max wait (default: 30000 ms) |
Wait For Element
Pauses execution until an element reaches a specified state — or throws if timeout is exceeded.
| Parameter | Type | Default | Description |
|---|---|---|---|
| Selector | Selector XML / String | — | Element to wait for |
| State | visible | enabled | clickable | visible | Required element state |
| TimeoutMs | Int32 | 30000 | Max milliseconds to wait before throwing |
Hover
Moves the mouse cursor over an element without clicking. Useful for revealing tooltips or dropdown menus.
| Parameter | Type | Required | Description |
|---|---|---|---|
| Selector | Selector XML / String | Yes | Element to hover over |
| TimeoutMs | Int32 | No | Max wait (default: 30000 ms) |
Select Item
Selects an option from a combo box, list box, or <select> element.
| Parameter | Type | Required | Description |
|---|---|---|---|
| Selector | Selector XML / String | Yes | The dropdown/list element |
| Item | String | Yes | Visible text of the option to select |
| TimeoutMs | Int32 | No | Max wait (default: 30000 ms) |
Send Hotkey
Sends a keyboard shortcut to the focused window or a specific element.
| Parameter | Type | Required | Description |
|---|---|---|---|
| Hotkey | String | Yes | Key combination, e.g. Ctrl+S, Alt+F4, Ctrl+Shift+N |
| Selector | Selector XML / String | No | Focus this element before sending the hotkey (optional) |
| 1 | Send Hotkey: Hotkey="Ctrl+S" // Save document |
| 2 | Send Hotkey: Hotkey="Alt+F4" // Close window |
| 3 | Send Hotkey: Hotkey="Ctrl+Shift+End" // Select to end |
Extract Table
Extracts structured tabular data from a UI grid, DataGrid, or web <table> into a DataTable variable.
| Parameter | Type | Required | Description |
|---|---|---|---|
| Selector | Selector XML / String | Yes | The grid or table container element |
| HasHeaders | Boolean | No (default: true) | Treat the first row as column headers |
| OutputVariable | String | Yes | DataTable variable to store the extracted data |
Take Screenshot
Captures a screenshot of the full screen, a specific window, or a UI element.
| Parameter | Type | Required | Description |
|---|---|---|---|
| Selector | Selector XML / String | No | Capture only this window/element (full screen if omitted) |
| SavePath | String | No | File path to save the image (.png). Stores in variable if omitted. |
| OutputVariable | String | No | Variable to hold the image for further processing |
Execute JavaScript
Executes a JavaScript snippet in the current browser tab. Only available inside a Launch Browser container.
| Parameter | Type | Required | Description |
|---|---|---|---|
| Script | String | Yes | JavaScript code to execute. Use return to produce an output value. |
| OutputVariable | String | No | Variable to store the script return value |
Navigate To
Navigates the current browser tab to a new URL. Only available inside a Launch Browser container.
| Parameter | Type | Required | Description |
|---|---|---|---|
| Url | String | Yes | Target URL |
Close
Closes the current application window (desktop) or browser tab (web). Use at the end of a container scope to cleanly shut down the automation target.