A decision block that interacts with the on-screen user interface.
If the proceed option is set to Immediately, then the action will be performed on the UI elements currently visible on screen, without pausing the fiber. If set to When UI element appeared, then the fiber will pause until the UI element has appeared on screen.
Only use this block as a last resort if there’s no other way of performing the desired automation.
There are two types of interactions:
The NO path is executed if the action failed to be performed, or the UI element isn’t visible on screen when using proceed Immediately.
Use the App start or App in foreground block to ensure that the correct activity is shown on screen. A delay between sequential interactions may be needed to ensure the UI has been fully loaded and redrawn.
The XML element “tag” name is the UI element view class. Attribute availability depends on type of UI element and Android version, see table below. Use the Inspect layout button to view the XML layout of a window shown on screen.
|boolean||Can display a check mark|
|boolean||Reacts to clicks|
|text||Associated content description|
|boolean||Reacts to context clicks (Android 6+)|
|boolean||Has an input method (Android 4.3+)|
|text||Error text (Android 5+)|
|boolean||Can take focus|
|boolean||Currently has focus|
|text||Hint text (Android 8+)|
|text||Identifier name (Android 4.3+)|
|text||Allowed type of text input, separated by '|' (Android 4.4+)|
|text||Identifier name of element it’s a label for (Android 4.3+)|
|text||Identifier name of label element (Android 4.3+)|
|(number)||Horizontal position on screen|
|(number)||Vertical position on screen|
|boolean||Reacts to long clicks|
|number||Maximum length of text input (Android 5+)|
|boolean||Input characters displayed as password dots|
Note! Interacting with Automate isn’t permitted, for security reasons. The Quick settings action may not work prior to Android 6. The Show input method picker action requires the “appear on top of other apps or parts of the screen” privilege on Android 9+.