The following commands allow you to specify positions using coordinates.
- Click specified position, Hover at specified position, Tap specified position, Drag & drop, Swipe
While we have filed the following items in our future development plans, this guide explains efficient methods for specifying X, Y coordinates under the current system.
Coordinate Specification Method
Hover your mouse over the element area where you want to specify the position by coordinates
Capture a screenshot of the highlighted area using your PC's screenshot function
For Macbook: Shift + Command + 4
Upload the captured image to a generative AI tool such as ChatGPT or Claude, and request X, Y coordinate confirmation using the following prompt:
Please tell me the coordinates of <the location you want to obtain> as X: xx%, Y: xx%
Specify the X, Y coordinates output by the generative AI in the command, then fine-tune manually afterward
X represents the percentage from the left edge of the screen, and Y represents the percentage from the top edge of the screen.
For example, in the case of the Tap specified position command:
- When (X, Y) = (0, 0), tap the top-left corner of the element
- When (X, Y) = (50, 50), tap the center of the element
- When (X, Y) = (100, 100), tap the bottom-right corner of the element
- When (X, Y) = (95, 50), tap the right edge of the element (within the element's range)