ControlClick to Tk button control

[SlackerAl]

Hi,

I am experimenting with the automation of Altair HyperWorks - HyperView.

I used the Au3Info_x64.exe tool to obtain information on a button like control within the application ClassnameNN TkChild130 as a test. I have left the application window open on my desktop.

I then run the following code (this is the entire au3 file):

Opt('MustDeclareVars', 1)
Local $hWnd = WinWaitActive("Untitled - HyperWorks v14.0")
ControlClick ( $hWnd, "", "TkChild130")

I then click on the Altair application (forcing it to become active and tripping the WinWaitActive). As soon as I click the title bar of the application (there are no associated events with this action) I see the control I previously identified as TkChild130 produce a mouse click animation, but the menu system change associated with clicking that control does not happen.

So I know the window handle is correct, and I know the control is the correct ID, but the click event seems to be only partially recognised. I have tried repeating the last line to send 2 consecutive clicks, but there is no change. I can immediately click the control and it provides the menu system update I was expecting.

Is there an issue with interacting with Tk controls? 

I am using this on Win 7 Enterprise, I am not a privileged user (and cannot be).

Thank you in advance.

[SlackerAl]

Additional Information:

I see the mouse-click animation is no different to the mouse-over animation... perhaps only the latter is occurring.

[SlackerAl]

Apologies for the gentle bump of this. Perhaps I could add to this by asking if anyone has successfully used AutoIt to interact with Tk based controls? i.e. should I give up or invest a little more effort?

[junkew]

Faq 31

[SlackerAl]

Can you provide a little more information? I'm fairly sure I have already correctly identified the component. I don't wish to use image based selection or click coordinates (although I accept they may be an answer). Are you suggesting I need to use IUIAutomation?

[junkew]

Yes and try w i th simplespy or the other spy references that are given to identify your object.

[SlackerAl]

I tried with simplespy and got the following:

Spoiler

Mouse position is retrieved 2694-939
At least we have an element title: [] class: [TkChild]

Having the following values for all properties: 
Title is: <>    Class   := <TkChild>    controltype:= <UIA_PaneControlTypeId>    ,<50033>    , (0000C371)    2677;931;28;28
*** Parent Information top down ***
2: Title is: <Untitled - HyperWorks v14.0>    Class   := <TkTopLevel>    controltype:= <UIA_WindowControlTypeId>    ,<50032>    , (0000C370)    1911;-9;1938;1218
"Title:=Untitled - HyperWorks v14.0;controltype:=UIA_WindowControlTypeId;class:=TkTopLevel""    
1: Title is: <>    Class   := <TkChild>    controltype:= <UIA_PaneControlTypeId>    ,<50033>    , (0000C371)    1920;52;1920;1148
"Title:=;controltype:=UIA_PaneControlTypeId;class:=TkChild""    
0: Title is: <>    Class   := <TkChild>    controltype:= <UIA_PaneControlTypeId>    ,<50033>    , (0000C371)    2666;929;349;32
"Title:=;controltype:=UIA_PaneControlTypeId;class:=TkChild""    

;~ *** Standard code maintainable ***
#include "UIAWrappers.au3"
AutoItSetOption("MustDeclareVars", 1)

_UIA_setVar("oP1","Title:=Untitled - HyperWorks v14.0;controltype:=UIA_WindowControlTypeId;class:=TkTopLevel")    ;Untitled - HyperWorks v14.0
_UIA_setVar("oP2","Title:=;controltype:=UIA_PaneControlTypeId;class:=TkChild")    ;
_UIA_setVar("oP3","Title:=;controltype:=UIA_PaneControlTypeId;class:=TkChild")    ;

_UIA_setVar(".mainwindow","title:=;classname:=TkChild")

;~ Actions split away from logical/technical definition above can come from configfiles 

;~_UIA_Action("oP1","highlight")
_UIA_Action("oP1","setfocus")
;~_UIA_Action("oP2","highlight")
_UIA_Action("oP2","setfocus")
;~_UIA_Action("oP3","highlight")
_UIA_Action("oP3","setfocus")

_UIA_action(".mainwindow","setfocus")

;~ *** Standard code Flexible***
#include "UIAWrappers.au3"
AutoItSetOption("MustDeclareVars", 1)

Local $oP2=_UIA_getObjectByFindAll($UIA_oDesktop, "Title:=Untitled - HyperWorks v14.0;controltype:=UIA_WindowControlTypeId;class:=TkTopLevel", $treescope_children)    
_UIA_Action($oP2,"setfocus")
Local $oP1=_UIA_getObjectByFindAll($oP2, "Title:=;controltype:=UIA_PaneControlTypeId;class:=TkChild", $treescope_children)    
_UIA_Action($oP1,"setfocus")
Local $oP0=_UIA_getObjectByFindAll($oP1, "Title:=;controltype:=UIA_PaneControlTypeId;class:=TkChild", $treescope_children)    
_UIA_Action($oP0,"setfocus")
_UIA_setVar(".mainwindow","title:=;classname:=TkChild")
_UIA_action(".mainwindow","setfocus")

*** Detailed properties of the highlighted element ***
UIA_class:= <TkChild>
UIA_regexpclass:= <TkChild>
UIA_iaccessiblechildId:= <0>
UIA_handle:= <6227794>
UIA_RuntimeId:= <42;6227794>
UIA_BoundingRectangle:= <2677;931;28;28>
UIA_ProcessId:= <13028>
UIA_ControlType:= <50033>
UIA_LocalizedControlType:= <pane>
UIA_HasKeyboardFocus:= <False>
UIA_IsKeyboardFocusable:= <True>
UIA_IsEnabled:= <True>
UIA_ClassName:= <TkChild>
UIA_Culture:= <0>
UIA_IsControlElement:= <True>
UIA_IsContentElement:= <True>
UIA_IsPassword:= <False>
UIA_NativeWindowHandle:= <6227794>
UIA_IsOffscreen:= <False>
UIA_Orientation:= <0>
UIA_FrameworkId:= <Win32>
UIA_IsRequiredForForm:= <False>
UIA_IsDockPatternAvailable:= <False>
UIA_IsExpandCollapsePatternAvailable:= <False>
UIA_IsGridItemPatternAvailable:= <False>
UIA_IsGridPatternAvailable:= <False>
UIA_IsInvokePatternAvailable:= <False>
UIA_IsMultipleViewPatternAvailable:= <False>
UIA_IsRangeValuePatternAvailable:= <False>
UIA_IsScrollPatternAvailable:= <False>
UIA_IsScrollItemPatternAvailable:= <False>
UIA_IsSelectionItemPatternAvailable:= <False>
UIA_IsSelectionPatternAvailable:= <False>
UIA_IsTablePatternAvailable:= <False>
UIA_IsTableItemPatternAvailable:= <False>
UIA_IsTextPatternAvailable:= <False>
UIA_IsTogglePatternAvailable:= <False>
UIA_IsTransformPatternAvailable:= <False>
UIA_IsValuePatternAvailable:= <False>
UIA_IsWindowPatternAvailable:= <False>
UIA_ValueIsReadOnly:= <True>
UIA_RangeValueValue:= <0>
UIA_RangeValueIsReadOnly:= <True>
UIA_RangeValueMinimum:= <0>
UIA_RangeValueMaximum:= <0>
UIA_RangeValueLargeChange:= <0>
UIA_RangeValueSmallChange:= <0>
UIA_ScrollHorizontalScrollPercent:= <0>
UIA_ScrollHorizontalViewSize:= <100>
UIA_ScrollVerticalScrollPercent:= <0>
UIA_ScrollVerticalViewSize:= <100>
UIA_ScrollHorizontallyScrollable:= <False>
UIA_ScrollVerticallyScrollable:= <False>
UIA_SelectionCanSelectMultiple:= <False>
UIA_SelectionIsSelectionRequired:= <False>
UIA_GridRowCount:= <0>
UIA_GridColumnCount:= <0>
UIA_GridItemRow:= <0>
UIA_GridItemColumn:= <0>
UIA_GridItemRowSpan:= <1>
UIA_GridItemColumnSpan:= <1>
UIA_DockDockPosition:= <5>
UIA_ExpandCollapseExpandCollapseState:= <3>
UIA_MultipleViewCurrentView:= <0>
UIA_WindowCanMaximize:= <False>
UIA_WindowCanMinimize:= <False>
UIA_WindowWindowVisualState:= <0>
UIA_WindowWindowInteractionState:= <0>
UIA_WindowIsModal:= <False>
UIA_WindowIsTopmost:= <False>
UIA_SelectionItemIsSelected:= <False>
UIA_TableRowOrColumnMajor:= <2>
UIA_ToggleToggleState:= <2>
UIA_TransformCanMove:= <False>
UIA_TransformCanResize:= <False>
UIA_TransformCanRotate:= <False>
UIA_IsLegacyIAccessiblePatternAvailable:= <True>
UIA_LegacyIAccessibleChildId:= <0>
UIA_LegacyIAccessibleRole:= <10>
UIA_LegacyIAccessibleState:= <1048576>
UIA_IsDataValidForForm:= <False>
UIA_ProviderDescription:= <[pid:9936,hwnd:0x5F0752 Main:Nested [pid:13028,hwnd:0x5F0752 Annotation(parent link):Microsoft: Annotation Proxy (unmanaged:uiautomationcore.dll); Main:Microsoft: MSAA Proxy (unmanaged:uiautomationcore.dll)]; Hwnd(parent link):Microsoft: HWND Proxy (unmanaged:uiautomationcore.dll)]>
UIA_IsItemContainerPatternAvailable:= <False>
UIA_IsVirtualizedItemPatternAvailable:= <False>
UIA_IsSynchronizedInputPatternAvailable:= <False>

Which did not seem to work (notice how the instance of the TkChild is not identified). I tried to run the 'Standard code maintainable' but it failed to parse the line:

_UIA_setVar("oP1","Title:=Untitled - HyperWorks v14.0;controltype:=UIA_WindowControlTypeId;class:=TkTopLevel")

SciTE gives: error: Statement cannot be just an expression. (illegal character)

I did not pursue this further.

A quick search showed me some other unresolved posts regarding working with TkChild widgets... perhaps it is not going to work with AutoIt. After my initial posts I noticed a few things:

1) I was wrong, the button click animation is subtly different to the mouseover animation. ControlClick() is causing a mouse over event.

2) If I MouseClick() at the location (returned by Au3Info_x64.exe) it does work, click animation played and menu updates.

3) If I use ControlGetPos(), it returns some values (correct size), but not correct position (the error is not a scalar of control size), so I can't use ControlGetPos() to drive MouseClick(), which I'm sort of glad about as it seems so ugly. 

Any thoughts?

[junkew]

Is the proper rectangle highlighted?

If not try inspect.exe or ranorex spy,

If still issues try trial version of testcomplete from smartbear.

Try orca screenreader

Read http://ocemp.sourceforge.net/papidown.html

But seems atk and spi interfaces which are hard to reach when using windows. Tools fot tkwidgets you probably have to write in python

Edited July 19, 2017 by junkew

[mLipok]

For reference only:
 

https://www.autoitscript.com/trac/autoit/ticket/3561

 

[SlackerAl]

@mLipok I never had any success with it, I did manage to highlight the correct widget, but did not have any success activating it from AutoIt: I think I got as far as being able to trip the widget mouseover event, but that was it. 

In the end it wasn't worth it for the time I was spending on it. I didn't reply because of the final line of "But seems atk and spi interfaces which are hard to reach when using windows. Tools fot tkwidgets you probably have to write in python", pretty much summed up where I got to.

[Zedna]

Try my MouseClickFast() using directly Win32 mouse API

 

EDIT: Or generally try MouseClick() instead of ControlClick()

Edited August 18, 2020 by Zedna

[SlackerAl]

Sorry, this was from 3 years ago, I've long moved on from that.