Stack Overflow
Stack Overflow

Questions tagged [sikuli]

Sikuli is a Java based automation tool available for Windows, macOS and Linux that automates tasks using screen visual inspection. Sikuli operates by matching previously taken screenshots and emulates user interactions by taking control of mouse and keyboard. The biggest Sikuli advantage is being available for both Desktop and Web Applications as it doesn't require any API.

Sikuli is a visual technology to automate and test graphical user interfaces (GUI) using images (screenshots).

Sikuli includes

  • Sikuli Script, a visual scripting API for Jython,
  • Sikuli IDE, an integrated development environment for writing visual scripts with screenshots easily.
  • Sikuli-API, a visual scripting API for Java

Sikuli Script automates anything you see on the screen without internal API's support. You can programmatically control a web page, a Windows/Linux/Mac OS X desktop application, or even an iphone or android application running in a simulator or via VNC.

Sikuli was developed at User Interface Design Group, MIT Computer Science and Artificial Intelligence Laboratory (CSAIL) and supported in part by the National Science Foundation under award number IIS-0447800 and by Quanta Computer as part of the TParty project. It is now maintained by the Sikuli Lab at the University of Colorado Boulder. Sikuli Script and Sikuli IDE are both released under the MIT License.

871 questions
39
votes
12 answers

Has anybody used SIKULI for testing their GUI-based apps?

SIKULI seems to have an enormous amount of potential. Has anybody tried to use this as a tool for testing? Or would it be better suited for automating actions for users?
Michael Balint
  • 2,255
  • 4
  • 25
  • 27
29
votes
2 answers

What better tool than Sikuli to use for screen automation on Windows 7 (or preferably multi-platform)

I'm using Sikuli for Screen automation. i.e for clicking of GUI elements according to their appearance on the screen. This works all right, but Sikuli has one major disadvantage for me: Slow start-up for each script (because the whole JVM is loaded…
halloleo
  • 9,216
  • 13
  • 64
  • 122
24
votes
10 answers

How to send "Ctrl + c" in Sikuli?

This feels like it should be pretty easy but I can't find documentation on how to do this: I just want Sikuli to type Ctrl+C to copy text to the clipboard. type(KEY_CTRL+'c') doesn't work and neither does type(KEY_CTRL,'c'). Any suggestions?
Dave S
  • 599
  • 2
  • 8
  • 17
19
votes
2 answers

finding image in Sikuli X Java

I am having an issue trying to find an image on the screen, I tried doing it in two different ways and it doesn't seem to work for me. I am trying to do this with Appium running on IOS simulator which shows up on the screen, so I don't see this…
Elsid
  • 243
  • 2
  • 10
  • 25
19
votes
4 answers

How to get Sikuli working in headless mode

If we have a headless test server running sikuli (both ubuntu and windows configurations needed), how to get it work without a physical monitor and preferably for as many screen resolutions as possible.
Amr Lotfy
  • 2,937
  • 5
  • 36
  • 56
16
votes
5 answers

How to integrate Sikuli scripts into Selenium?

I'm extensively using Selenium for integration testing. Works great for all normal stuff (HTML/AJAX), but no go when I'm trying to test third party ActiveX, Java applets and Flash components. The solution I've found for this is Sikuli. Works great…
vartec
  • 131,205
  • 36
  • 218
  • 244
14
votes
5 answers

What are strategies to construct reusable Sikuli screen shot libraries?

I would like to use Sikuli to automate both GUI apps and Web apps running within browser on Mac OS X and Windows. My purpose is currently less for testing, and more for GUI automation of tedious, repetitive tasks for a team that unfortunately…
Jaharmi
  • 171
  • 1
  • 6
12
votes
3 answers

What's the command to take a picture in Sikuli

I'm using Sikuli IDE. I'd like to know what the command to take a screenshot is, so I can capture the screen at the end of a test. Something like this try : if bla bla bla: print("blablabla") else: TAKESCREENSHOT() …
Leonardo Sobral
  • 121
  • 1
  • 1
  • 3
9
votes
3 answers

How to pause, resume and stop a Sikuli program?

Suppose I am running a Sikuli program and I want to pause the program at a particular point and then after sometime I want to resume the program from that point where I paused, without affecting the process. And then I want to stop the process and…
Praveen kumar
  • 597
  • 2
  • 14
  • 26
8
votes
1 answer

Screen Region Recognition to Find Field location on Screen

I am trying to figure out a way of getting Sikuli's image recognition to use within C#. I don't want to use Sikuli itself because its scripting language is a little slow, and because I really don't want to introduce a java bridge in the middle of my…
MarkJoel60
  • 537
  • 2
  • 6
  • 24
8
votes
1 answer

.sendto() method on sikuli python script does not work on windows

I developed a sikuli python script on windows that uses this code: from socket import AF_INET, SOCK_DGRAM import sys import socket import struct, time host = "pool.ntp.org" port = 123 buf = 1024 address = (host,port) msg = '\x1b' + 47 * '\0' #…
user3472065
  • 1,259
  • 4
  • 16
  • 32
8
votes
4 answers

How to scroll down with sikuli

How to scroll down with Sikuli in Selenium Eebdriver with java? I am using screen.wheel(1 , 8); in my code to scroll down in an open window. Sometimes it works fine but after running my script 4-5 times it behaves differently. Instead of scrolling…
Jazz
  • 81
  • 1
  • 1
  • 4
7
votes
6 answers

Jython: Making a simple beep on Windows

I'm working with Sikuli, which (I think) is build on Jython. I want to make a script that does a small gentle beep to attract the user's attention. (This is on Windows.) How can I do this? I see that the winsound module is not available on…
Ram Rachum
  • 84,019
  • 84
  • 236
  • 374
7
votes
3 answers

Calling to a Sikuli script from Python (Selenium)

While running Selenium tests on a website, I have some Flash elements that I cannot test with Selenium/Python. I wanted to call out for a separate terminal window, run the Sikuli OCR tests, and then back into the Selenium/Python testing. I've not…
Dave
  • 1,031
  • 7
  • 19
  • 29
7
votes
2 answers

Sikuli, selenium testing on Jenkins: Allow the browser to be launched in the foreground, as it is when i run it from development machine?

The issue is that Sikuli's image recognition capabilities only work when the target of the Sikuli tests is in the foreground and it has full access to the mouse. In its current configuration, Jenkins projects are never visible from the desktop of…
user2387855
  • 314
  • 4
  • 9
1
2 3
…
58 59