screen 1024x768 different screen size, how can this be possible?

[Daka]

yes it doesn't ope inside of the window...
huh Im starting with this project and really 
I have not much oprions, but to go and relly
on the screen resolution, it is going to take
a lot of code work and guessing

If I only had one resolution than that code would work 
on any computer

[Earthshine]

can it run on a second monitor? 

[Daka]

what do you mean second monitor? I can run second monitor, but people who are going to use the software, will not have second monitor and then that is not the option

Why? Is there any solution with second monitor?

[Earthshine]

fix the second monitor to your desired resolution I guess. did you try imagesearch as junkew suggested? He's been trying to help you

Edited November 16, 2017 by Earthshine

[Daka]

yes the search image is not good one,
because it can be many black squares on that window.
So image will find it on many places.

My option is more to get the exactly where points are and from that 
go with pixelsearch and check if it is yellow black, orange etc.

 

[Daka]

So I fail to find the instance name of that particular square,
so I need to go with with x and y, but then that is much depended on
the screen resolution  and then again screen resolution may be the same
but not the position on the software. I discovered this with one laptop where
it was 1024 x 768 and it was totally different  from my same resolution

[Earthshine]

you can maybe find an old 1020x768 native res monitor? that should fix it. hmmmm

[Daka]

for me to build for one computer that is not the problem,
but building it for many computers it takes me too much time to rewrite the codes

[Daka]

Here is what I did on my virtualbox,
I opened various resolutions and that field
where everything is, I saw that it expends from
as resolution expend, so maybe some math would be good
to calculate the positions. but again if that stays same on all of those resolutions.

 

[junkew]

* Your buttons in the video have a name as i see in inspect.exe that it shows the text values and as such you should be able to find them by name with th uiawrapper udf

* Your rectangles I would make a small wrapper that you can click relative in percentage either from desktopsize or windowsize

testpercentagemove("50%","50%")

func testpercentagemove($x,$y)
    if stringinstr($x,"%") Then
        $realX=stringreplace($x,"%","") * (@DesktopWidth / 100)
        $realy=stringreplace($y,"%","") * (@DesktopHeight / 100)
        
        mousemove($realX ,$realy)
    EndIf
EndFunc

* And to handle above I normally would give something a logical name array/collection in between with a little more logic around it    
         logicalname["triangle1"]="50%,50%"

* falling back to findbmp udf or solution(s) like SikuliX I allmost never use as percentages with logical names keep things maintainable (and fast) enough

* I can mention a lot of commercial tools but I doubt if any of them are easy in bitmap recognition most fallback on the tesseract engine or similar ones