ControlClick seems not to work with certain elemtents

[MaximusCZ]

Hello, and apologies if this have been discussed before, but I googled and couldnt find anything relevant.

I have a problem where I try to send a control clink into to a window. 
Part of window I try to send clicks to looks like this . The black border is showing when I mouse over it Au3Info, I get following information:

I am testing its interaction with code

The result I get is that it makes control clicks trough first line, opens and closes menus, as expected.

When It gets to second line, it does not click a single icon. I can tell that coords are correct as the dropdown menus (No view active) gets focused(altough not rolled out). Same behaviour happens if roughly 40<y<60, so I know I am hitting good height. You can look at how it behaves here: output.webm 

Dropdown 1 focuses at around 8 sec mark, and 13 sec mark it changes to second dropdown, defocusing first one, seemingly not registering any clinks inbetween.

 

Have you ever encountered similar behaviour? I need to click the Key button, first on second line, with controlclick (or any other way not hijacking the mouse). I cant trigger that button by keyboard and There is no other control having control over it.

Help

 

[Earthshine]

Tip. Don’t post pictures. Post your code so others can help. 

[MaximusCZ]

Earthshine: The picture of code is just to give you idea of what I am doing: test-clicking in a row to see where the clicks register. Having this in copy-able format doesnt help anybody, as I dont think anyone have the program in question.

[Earthshine]

It doesn’t matter.  We are here to help you improve it and there are those here who will just hand over code so you should show something besides a pic. Also you have no logging so you have no idea what’s going on

[MaximusCZ]

I have no idea how to approach you at this point, and I got the feeling you either not read my post, or misunderstood the issue compleately.

My code is really just one line of code, that will not work anywhere else besides my PC, as explained before. Noone can test it, run it or do anything with it, whether I post a pic or code, and its not even desired to be able so. I will not distribute the program this script interact with, so there is not a single point of initiative for others to play with the code. I only posted to pic to give a general idea of what I am doing (that is, sending control click and example parameters, activating the window beforehand and showing a loop I am using to send this single line of code multipletimes), and provided a verification that its working in a certain part of a program, so there is no dispute about whether the line is good as is. 

I still dont see how sharing a single line of code could help anyone solve this, as they would still be missing the end program to test it with. 

The main concern of mine is if someone encountered similar issue, possibly with an idea of working with such unresponsive elements, they could share their insights.

 

So far your tip and following paragraph are unhelpfull and needless, so if you have no intention of actually helping solve the original issue, I am gonna ask you to please refrain from any more comments regarding the issue you found (and tried to validate) with my post.

 

Edited May 9, 2018 by MaximusCZ

[BrewManNH]

The coordinates in your ControlClick, are they the control coordinates, or the window coordinates? The ControlClick coordinates are the position inside the control bounds, so if you're using window coordinates, you're clicking in the wrong place.

[MaximusCZ]

I am clicking in control coordinates. Right position of clicks was already verified

[Earthshine]

well, I did some research on the control, and the good news is, that products like WinTask can use it through UI Automoation. FAQ 31 has a link for the IUIAutomation kit should all else fail. It has a SimpleSpy application that can find all the UI elements and their properties too.

When I first saw your post, I thought, oh boy, some old ActiveX OCX. I know from personal experience with them that they can be problematic when trying to interact with in standard AutoIT.

Anyway, good luck.

I just wanted to add that I needed the IUIAutomation kit for the old OCXs and applications if I was to do anything in AutoIT, even in one case it was just to get it to focus on the control so I can send key commands to it (that's how locked down they can be)

Edited May 9, 2018 by Earthshine

[Earthshine]

And, looking into WinTask, that looks like an amazing wrapper for UIAutomation using a VB syntax and a script generator/recorder. $299 for two years support, but it might be well worth it. I know i could whip up all the regression scripts for our products fast with it, and, if it worked with our old VB6 apps and controls, it would rule. this research lead me to that product. It can easily handle any WPF or WinForms, I am going to get the free trial to see if I can automate that horrid vb6 ocx.

Edited May 9, 2018 by Earthshine

[Earthshine]

so, i got WinTask free 30 day trial and already have whipped up a fair flame test. who knew it could be this easy. it's super fast and handles Winforms, WPF and VB6 and EVEN JAVA apps. Who knew? Buying it. Handles browsers too.

Edited May 9, 2018 by Earthshine

[Danp2]

I'll definitely be taking a look at WinTask. I wonder how it compares to UIPath?

[Earthshine]

UIPath? Now I need to know more. I’ll be fully shaking WinTask down for 30 days

Edited May 9, 2018 by Earthshine

[tentacole]

On 5/9/2018 at 8:35 AM, MaximusCZ said:

I am clicking in control coordinates. Right position of clicks was already verified

I'm currently having this same problem. Did you ever find a fix to this issue?

[junkew]

Uipath is more robotics oriented with a different focus then AutoIt has.

[MaximusCZ]

On 11/21/2018 at 3:10 PM, tentacole said:

I'm currently having this same problem. Did you ever find a fix to this issue?

Sadly, no. I still havent managed to click that button without my mouse actually pointing it it.

Funnily enough, I dived into WM_events and sent the window events regarding mouse movements, which worked for most of unresponsive UI, but this part is still out of my reach

[tentacole]

On 12/18/2018 at 10:40 AM, MaximusCZ said:

Sadly, no. I still havent managed to click that button without my mouse actually pointing it it.

Funnily enough, I dived into WM_events and sent the window events regarding mouse movements, which worked for most of unresponsive UI, but this part is still out of my reach

I figured out my problem I was having.. hopefully it may help you. For your ControlClicks function, it looks like you are using the ClassNameNN - Try using the Advanced(Class) instead. The problem I was having was that I was attempting to create a loop to select between two instances within the window, but when I would click on the second instance, the second instance would turn into the first instance.