Stack Overflow
Stack Overflow

Questions tagged [sikuli-x]

SikuliX is an automation tool which uses OpenCV image recognition to record and play user's actions.

SikuliX automates anything you see on the screen of your desktop computer running Windows, Mac or some Linux/Unix. It uses image recognition powered by OpenCV to identify and control GUI components. This is handy in cases when there is no easy access to a GUI's internals or the source code of the application or web page you want to act on.

SikuliX supports as scripting languages

  • Python language level 2.7 (supported by Jython)
  • Running RobotFramework text-scripts is supported
  • Ruby language level 1.9 and 2.0 (supported by JRuby)
  • JavaScript (supported by the Java Scripting Engine)

SikuliX comes with text recognition (OCR) and can be used to search for text. This feature is powered by Tess4J / Tesseract.

80 questions
8
votes
2 answers

java.lang.NoSuchMethodError：accessibilityHitTest

I'm using Sikulix 2.0.6. There is an error in the message field: java.lang.NoSuchMethodError：accessibilityHitTest I looked https://github.com/openjdk/jdk/pull/5702 but still don't know how to fix it. and my terminal log: Exception in thread "AppKit…
Tatsuhiko Mizuno
  • 437
  • 6
  • 15
5
votes
0 answers

Getting [error] Mouse: not useable (blocked) while using Sikuli in Mac

I have used Sikulix maven dependency and getting below error while executing the script: [error] Mouse: not useable (blocked) Please find code snippet below Pattern p = new Pattern("path of the image"); org.sikuli.script.Screen s = new…
Ali
  • 51
  • 3
4
votes
1 answer

Sikuli cannot find image on screen through Jenkins

I have a maven project setup to run my JUnit tests. I am utilizing Sikuli to click on certain images on the screen. When executing my test using the "mvn test" command in a terminal or through Eclipse it will work. I now have to integrate these…
user7548672
3
votes
1 answer

How do I resolve this UnsatisfiedLinkError?

Goodmorning, Today I started with a POC with SikuliX and Java. I want to try the example in this link. Here a part of the screen is captured and searched. When I execute this, I receive the error: [error] RunTimeAPI: loadLib: opencv_java not usable:…
Sjakiepp
  • 83
  • 1
  • 10
2
votes
1 answer

[karate][standalone] how to add sikulixapi.jar to classpath by default using karate-config.js?

Karate version: 0.9.5.RC3 IDE : Visual Studio Code 1.38.1 OS: Windows 10 Ent I have downloaded the zip and was running Native Automation example with SikuliX using the karate standalone jar. Now to execute the tests I need to use below command java…
rahoolm
  • 733
  • 2
  • 12
  • 22
2
votes
1 answer

Find the co-ordinates of matching image using sikuli in java

I need to get the co-ordinates of matched image within the actualImage so that I can perform operations on it. However, I tried below two approaches,but both doesn't seem to work: Approach 1: Using below, I'm able to find a match but co-ordinates…
nagpai
  • 169
  • 1
  • 3
  • 15
2
votes
1 answer

RunTimeINIT: *** terminating: Java arch not 64 Bit or not detected

I am getting this error while running Sikulix from CMD with command java -jar sikulix.jar complete error is: [error] RunTimeINIT: *** terminating: Java arch not 64 Bit or not detected (java 8-32 version 1.8 vm 25.181-b13 class 52.0 arch null) I…
Mikku
  • 6,538
  • 3
  • 15
  • 38
2
votes
0 answers

How to call OpenCV in Sikuli/Jython?

I'm aware that Sikulix uses Jython and OpenCV for it's template matching, but I'm interested in performing some more complicated image processing tasks. Is it possible to directly access OpenCV in Sikulix/Jython, and are there any examples of how…
Booley
  • 819
  • 1
  • 9
  • 25
1
vote
1 answer

How to save captured region as an image to a disk file?

I would like to be able to save a captured region to a png file on disk The section of the code I have is: r = Region(150,350,1700,630) r.highlight(15) screen = Screen() image = screen.capture(r) How to save now? As mentioned in the documentation,…
Luis
  • 1,236
  • 5
  • 22
  • 31
1
vote
1 answer

webbrowser library is not working as intended on SikulixIDE

On SikulixIDE, the library webbrowser always open the default browser, even when i use the get method, i tried my code on regular python, it does work. Anyone know why it is reacting like that ? webbrowser.get('C:/Program…
Corentin Gauquier
  • 23
  • 7
1
vote
1 answer

Sikulix - exists function has timeout?

i have a sikulix code with 5 if statement like this : if exists("1642200162130.png"): It enter in only one if statement, where there is only one click() click(Location(me.x + paddingx, me.y + paddingy)) For a complete run, the scritp take…
Valentin Garreau
  • 963
  • 1
  • 10
  • 32
1
vote
2 answers

SikuliX cannot call makeOpts()

I am working on sikulixide-2.0.5 on windows. Now I would like to utilize user properties write/read functions to implement persistence of application parameters, So that I am learning as the part of reference shown :…
Ju-Hsien Lai
  • 643
  • 7
  • 14
1
vote
1 answer

SikuliX IDE is stuck starting up with message: SikuliX-IDE 2.0.4 is starting on Java 15

Machine: MacBook Pro running macOS Catalina V10.15.7 Downloaded Java JDK 15 from: https://jdk.java.net/15/ Put the jdk folder in /Library/Java/JavaVirtualMachines/ (I had to manually create the JavaVirtualMachines folder as I'd previously deleted…
Nick Hutchinson
  • 13
  • 3
1
vote
1 answer

Sikuli script does not run on Linux

My SikuliX script run on Windows10. However, under Linux (Debian 7.11), the script only opens my application and refuses to continue to execute the remaining script. I tried running on SikuliX versions 1.1.4 and 2.0.1. Gives an error…
Paul
  • 11
  • 1
1
vote
0 answers

Sikulix administrator right issue

I need to add to my selenium script a sikulix script to do a task that selenium can't do. When I run bellow script C:\Sikulix\\runsikulix.cmd -r C:\Sikulix\Scritps\WorkFlow.sikuli from normal or elevated CMD it works fine. But when I run it from…
Adrian
  • 149
  • 3
  • 16
1
2 3 4 5 6