IUIAutomation MS framework automate chrome, FF, IE, ....

[PeterlFF]

I figured it out so deleted my post to save everyone time. 

Edited April 29, 2022 by PeterlFF

[PeterlFF]

I used simplespy to get the code for an element I want to click on Power BI Online webpage. If I have the web page open in Microsoft Edge (I'm required to use this browser) and run the code below it works just fine.

;~ *** Standard code maintainable ***
#include "UIAWrappers.au3"
AutoItSetOption("MustDeclareVars", 1)
_UIA_setVar("oUIElement","Title:=Power BI Workload2;ControlType:=UIA_HyperlinkControlTypeId;classname:=name trimmedTextWithEllipsis ng-star-inserted")
_UIA_action("oUIElement","click")

If I add a step to open the browser and web page first then it doesn't work. It doesn't give an error. It just doesn't click the web page element.

#include "UIAWrappers.au3"
AutoItSetOption("MustDeclareVars", 1)

ShellExecute("https://app.powerbi.com/groups/me/list")
Sleep("4000")
_UIA_setVar("oUIElement","Title:=Power BI Workload2;ControlType:=UIA_HyperlinkControlTypeId;classname:=name trimmedTextWithEllipsis ng-star-inserted")
_UIA_action("oUIElement","click")

I thought maybe it page didn't have focus after it opened so I added a WinActivate for the browser window but that didn't help. I noticed that when the browser is opened using ShellExecute the search box o the page has focus and I can see the cursor flashing there. I tried sending a click to the page to get the cursor out of the search box in case that was an issue but that didn't help either. 

Any ideas on what the issue may be?

[junkew]

First thing to do is to use some highlight action's to see if its finding anything

I frequently have this as part of debugging and simplespy is giving you those basics

1. Find and highlight the browser
2. Find and highlight the document area
3. Start finding and highlighting some elements
4. DumpThemAll function will dump whatever is on screen to a lenghty file that you can analyze

Only if above 4 work I start with clicking, screenshotting etc.

The UIAWrappers contains "smart" finding where I know from there are issues in it so to really make sure you are not hitting an issue of the wrappers you can try to use the lower level MS UIA functions. 

Take also a look at @LarsJspy application and examples in the forum to get more feeling with the underlying patters for invoke which the wrappers have hidden away.

 

 

 

[PeterlFF]

Thanks @junkew. That was helpful and I was able to solve the issue.

Edited May 2, 2022 by PeterlFF

[PeterlFF]

@junkew I have my code working but I have an issue. I have my code loop to perform the same actions 5 times. On the second pass, when it executes the first click, I get this very vague error message:

"C:\Program Files (x86)\AutoIt3\Include\UIAWrappers.au3" (1673) : ==> Array variable has incorrect number of subscripts or subscript dimension range exceeded.:
$x = Int($t[1] + ($t[3] / 2))
$x = Int($t[1] + (^ ERROR
>Exit code: 1    Time: 559.6

I don't know exactly which line in my code is causing the error. Do you know what this error means, or is there something I can do to turn on more detailed error info?

[PeterlFF]

I tried to capture the error using If @error but that didn't work. I tried to using a unique name for the _UIA_setVar and _UIA_Action for each pass (i.e. element1 for pass one, element2 for pass two) and that worked. Is this the best way to avoid the error or is there something else I can do?

Edited May 4, 2022 by PeterlFF

[junkew]

Most likely you hit a bug in the wrappers. It uses an internal caching logic in an array with "RTI." prefix for Runtime Type Information 
You can clean this "cache" with below function

func _UIAResetRTIVars()
    for $i=(ubound($uia_vars, 1)-1) to 0 step -1
        if stringleft($uia_vars[$i][0],stringlen($cRTI_Prefix))=$cRTI_Prefix Then
            _ArrayDelete($UIA_Vars,$i)
        EndIf
    next
EndFunc

;~ example
_ArrayDisplay($UIA_Vars)
_UIAResetRTIVars()
_ArrayDisplay($UIA_Vars)

[PeterlFF]

@junkew I have tried this on 2 other systems and I have had issues. The first system I was able to adjust the code a little and it now is working. On the third system it errors out on the first click it tries to make. I have confirmed it has the same version of windows and is using Microsoft Edge like my system. 

The error is Line 26600, Error: Subscript used on non-accessible variable. This is the first click I send so no need to clean the cache. 

The error just lists my EXE so not sure where line 26600 is. Is there anyway to get more detailed error information?

[junkew]

1. Get example 1 to work and understand it

2. Use simplespy on your application and get that generated code working

3. Give your details of the error: Most likely your description of the object is just incorrect or just differently nested. All this information is in the log after you run _uia_dumpthemall

4. Most likely it errors in Func _UIA_action

and you can see in log :Not an object failing action

            _UIA_LOG("Not an object failing action " & $strAction & " on " & $obj_or_string & @CRLF, $UIA_Log_Wrapper)
or it errors on 

            $t = StringSplit(_UIA_getPropertyValue($obj2ActOn, $UIA_BoundingRectanglePropertyId), ";")

[SaeidN]

On 4/23/2022 at 3:57 AM, junkew said:

You can set textvalues directly but then you have to study how this uia model works. Its a huge model and there are many ways to get values into a textbox completely depending on its class. Why do you not want to activate a window?

I can type into text box with type and typetext: _UIA_action("comment","type","this is a test")

comment is title of the window which has a textbox inside it. But it activates the window first which I don't want.

This one shows a red border around the window but doesn't activate or type anything. _UIA_action("comment","send","this is a test")

This is the inspection of textbox:

and sometimes it is like this:

I need to send a text into textbox without activating the window.

I appreciate any help.

 

[junkew]

For that you have to study the code within the wrapper functions.

the type action is like sending keys. 

you are looking more for settextvalue action

It really depends on the text box if you can set or retrieve values without activating it. Look for uia textpattern and valuepattern.

Many controls do not fully support these patterns and as such the wrappers fallback to just some kind of sendkeys after setting focus to the control.

 

 

[Onolox]

I'm learning UIA and I'm using FlaUI, and there are  2 options: UIA2 and UIA3, this UDF have versions or is universal? 

[junkew]

flaui and this uiawrappers all make use of the microsoft technology UIA automation and boils down to uiautomationcore.dll which is the unmanaged com version dll. Not sure where flaui defines uia2/uia3 but here is where MS has documented the foundation.
https://docs.microsoft.com/en-us/windows/win32/winauto/entry-uiautocore-overview a usefull library where i based the uiawrappers udf on.

This wrapper is around what flaui calls uia2 but as said I don't know that description from MS itself. UIA3 you refer to is the .net managed dll version but both give also access to iaccessible.iaccessible2 interface.

[Onolox]

• Delete

Edited June 30, 2022 by Onolox

[junkew]

Thats a copy/paste from FLAUI libraries documentation. Any specific question you have?

 

[phat_2008]

Hello,

I have been using this tool for a while and I like it and now I'm running into a roadblock. I'm able to script where I can open this program, open the UIA_MenuItemControlTypeId based on my criteria. Then a popup menu opens. After that, I am not able to get any elements because it's reading Chrome_RenderWiedgetHostWHND. The pop up menu titled "ANALOG_3_1" has multiple buttons and I'd like to click on the one that says "Detail" (when my mouse hovers to this button it says Detail".  But there's no way of determining what the name actually is. So I just hit CTRL+W on this button below is what I have. I also tried to do something with the UIA_BoundingRectangle properties but no luck. Any suggestions?

UIA_BoundingRectangle:= <1012;541;18;18>

   

 

expandcollapse popup

;~ *** Standard code maintainable ***
#include "UIAWrappers.au3"
AutoItSetOption("MustDeclareVars", 1)

_UIA_setVar("oP1","Title:=DeltaV Live;controltype:=UIA_WindowControlTypeId;class:=Window")  ;Inhouse software
_UIA_setVar("oP2","Title:=ANALOG_3_1;controltype:=UIA_WindowControlTypeId;class:=Window")   ;ANALOG_3_1
_UIA_setVar("oP3","Title:=Display Viewer Shell;controltype:=UIA_CustomControlTypeId;class:=ShellView")  ;Display Viewer Shell
_UIA_setVar("oP4","Title:=Graphic Host;controltype:=UIA_CustomControlTypeId;class:=GraphicHostView")    ;Graphic Host
_UIA_setVar("oP5","Title:=;controltype:=UIA_PaneControlTypeId;class:=WindowsFormsHost") ;
_UIA_setVar("oP6","Title:=;controltype:=UIA_PaneControlTypeId;class:=WindowsForms10.Window.8.app.0.34cbfc8_r9_ad1") ;
_UIA_setVar("oP7","Title:=;controltype:=UIA_PaneControlTypeId;class:=CefBrowserWindow") ;
_UIA_setVar("oP8","Title:=;controltype:=UIA_PaneControlTypeId;class:=Chrome_WidgetWin_0")   ;
_UIA_setVar("oP9","Title:=Inhouse Software;controltype:=UIA_DocumentControlTypeId;class:=Chrome_RenderWidgetHostHWND")  ;Inhouse software
_UIA_setVar("oP10","Title:=;controltype:=UIA_GroupControlTypeId;class:=")   ;
_UIA_setVar("oP11","Title:=;controltype:=UIA_GroupControlTypeId;class:=")   ;
_UIA_setVar("oP12","Title:=;controltype:=UIA_GroupControlTypeId;class:=")   ;
_UIA_setVar("oP13","Title:=;controltype:=UIA_GroupControlTypeId;class:=")   ;
_UIA_setVar("oP14","Title:=;controltype:=UIA_GroupControlTypeId;class:=")   ;
_UIA_setVar("oP15","Title:=;controltype:=UIA_GroupControlTypeId;class:=")   ;
_UIA_setVar("oP16","Title:=;controltype:=UIA_GroupControlTypeId;class:=")   ;
_UIA_setVar("oP17","Title:=;controltype:=UIA_GroupControlTypeId;class:=")   ;

;~ $oUIElement=_UIA_getObjectByFindAll(".mainwindow", "title:=;ControlType:=UIA_GroupControlTypeId", $treescope_subtree)
_UIA_setVar("oUIElement","Title:=;controltype:=UIA_GroupControlTypeId;class:=") ;ControlType:=UIA_GroupControlTypeId;classname:=")

;~ Actions split away from logical/technical definition above can come from configfiles 

;~_UIA_Action("oP1","highlight")
_UIA_Action("oP1","setfocus")
;~_UIA_Action("oP2","highlight")
_UIA_Action("oP2","setfocus")
;~_UIA_Action("oP3","highlight")
_UIA_Action("oP3","setfocus")
;~_UIA_Action("oP4","highlight")
_UIA_Action("oP4","setfocus")
;~_UIA_Action("oP5","highlight")
_UIA_Action("oP5","setfocus")
;~_UIA_Action("oP6","highlight")
_UIA_Action("oP6","setfocus")
;~_UIA_Action("oP7","highlight")
_UIA_Action("oP7","setfocus")
;~_UIA_Action("oP8","highlight")
_UIA_Action("oP8","setfocus")
;~_UIA_Action("oP9","highlight")
_UIA_Action("oP9","setfocus")
;~_UIA_Action("oP10","highlight")
_UIA_Action("oP10","setfocus")
;~_UIA_Action("oP11","highlight")
_UIA_Action("oP11","setfocus")
;~_UIA_Action("oP12","highlight")
_UIA_Action("oP12","setfocus")
;~_UIA_Action("oP13","highlight")
_UIA_Action("oP13","setfocus")
;~_UIA_Action("oP14","highlight")
_UIA_Action("oP14","setfocus")
;~_UIA_Action("oP15","highlight")
_UIA_Action("oP15","setfocus")
;~_UIA_Action("oP16","highlight")
_UIA_Action("oP16","setfocus")
;~_UIA_Action("oP17","highlight")
_UIA_Action("oP17","setfocus")

_UIA_action("oUIElement","highlight")
;~_UIA_action("oUIElement","click")


;~ *** Standard code Flexible***
#include "UIAWrappers.au3"
AutoItSetOption("MustDeclareVars", 1)

Local $oP16=_UIA_getObjectByFindAll($UIA_oDesktop, "Title:=DeltaV Live;controltype:=UIA_WindowControlTypeId;class:=Window", $treescope_children)    
_UIA_Action($oP16,"setfocus")
Local $oP15=_UIA_getObjectByFindAll($oP16, "Title:=ANALOG_3_1;controltype:=UIA_WindowControlTypeId;class:=Window", $treescope_children) 
_UIA_Action($oP15,"setfocus")
Local $oP14=_UIA_getObjectByFindAll($oP15, "Title:=Display Viewer Shell;controltype:=UIA_CustomControlTypeId;class:=ShellView", $treescope_children)    
Local $oP13=_UIA_getObjectByFindAll($oP14, "Title:=Graphic Host;controltype:=UIA_CustomControlTypeId;class:=GraphicHostView", $treescope_children)  
Local $oP12=_UIA_getObjectByFindAll($oP13, "Title:=;controltype:=UIA_PaneControlTypeId;class:=WindowsFormsHost", $treescope_children)   
_UIA_Action($oP12,"setfocus")
Local $oP11=_UIA_getObjectByFindAll($oP12, "Title:=;controltype:=UIA_PaneControlTypeId;class:=WindowsForms10.Window.8.app.0.34cbfc8_r9_ad1", $treescope_children)   
_UIA_Action($oP11,"setfocus")
Local $oP10=_UIA_getObjectByFindAll($oP11, "Title:=;controltype:=UIA_PaneControlTypeId;class:=CefBrowserWindow", $treescope_children)   
_UIA_Action($oP10,"setfocus")
Local $oP9=_UIA_getObjectByFindAll($oP10, "Title:=;controltype:=UIA_PaneControlTypeId;class:=Chrome_WidgetWin_0", $treescope_children)  
_UIA_Action($oP9,"setfocus")
Local $oP8=_UIA_getObjectByFindAll($oP9, "Title:=DeltaV Operations;controltype:=UIA_DocumentControlTypeId;class:=Chrome_RenderWidgetHostHWND", $treescope_children) 
_UIA_Action($oP8,"setfocus")
Local $oP7=_UIA_getObjectByFindAll($oP8, "Title:=;controltype:=UIA_GroupControlTypeId;class:=", $treescope_children)    
Local $oP6=_UIA_getObjectByFindAll($oP7, "Title:=;controltype:=UIA_GroupControlTypeId;class:=", $treescope_children)    
Local $oP5=_UIA_getObjectByFindAll($oP6, "Title:=;controltype:=UIA_GroupControlTypeId;class:=", $treescope_children)    
Local $oP4=_UIA_getObjectByFindAll($oP5, "Title:=;controltype:=UIA_GroupControlTypeId;class:=", $treescope_children)    
Local $oP3=_UIA_getObjectByFindAll($oP4, "Title:=;controltype:=UIA_GroupControlTypeId;class:=", $treescope_children)    
Local $oP2=_UIA_getObjectByFindAll($oP3, "Title:=;controltype:=UIA_GroupControlTypeId;class:=", $treescope_children)    
Local $oP1=_UIA_getObjectByFindAll($oP2, "Title:=;controltype:=UIA_GroupControlTypeId;class:=", $treescope_children)    
Local $oP0=_UIA_getObjectByFindAll($oP1, "Title:=;controltype:=UIA_GroupControlTypeId;class:=", $treescope_children)    
;~ First find the object in the parent before you can do something
;~$oUIElement=_UIA_getObjectByFindAll(".mainwindow", "title:=;ControlType:=UIA_GroupControlTypeId", $treescope_subtree)
Local $oUIElement=_UIA_getObjectByFindAll($oP0, "title:=;ControlType:=UIA_GroupControlTypeId", $treescope_subtree)
;~_UIA_action($oUIElement,"highlight")
_UIA_action($oUIElement,"click")


*** Detailed properties of the highlighted element ***
UIA_iaccessiblechildId:= <0>
UIA_handle:= <0>
UIA_BoundingRectangle:= <1012;541;18;18>
UIA_ProcessId:= <12272>
UIA_ControlType:= <50026>
UIA_LocalizedControlType:= <group>
UIA_HasKeyboardFocus:= <False>
UIA_IsKeyboardFocusable:= <False>
UIA_IsEnabled:= <True>
UIA_Culture:= <0>
UIA_IsControlElement:= <True>
UIA_IsContentElement:= <True>
UIA_IsPassword:= <False>
UIA_NativeWindowHandle:= <0>
UIA_IsOffscreen:= <False>
UIA_Orientation:= <0>
UIA_IsRequiredForForm:= <False>
UIA_IsDockPatternAvailable:= <False>
UIA_IsExpandCollapsePatternAvailable:= <False>
UIA_IsGridItemPatternAvailable:= <False>
UIA_IsGridPatternAvailable:= <False>
UIA_IsInvokePatternAvailable:= <True>
UIA_IsMultipleViewPatternAvailable:= <False>
UIA_IsRangeValuePatternAvailable:= <False>
UIA_IsScrollPatternAvailable:= <False>
UIA_IsScrollItemPatternAvailable:= <False>
UIA_IsSelectionItemPatternAvailable:= <False>
UIA_IsSelectionPatternAvailable:= <False>
UIA_IsTablePatternAvailable:= <False>
UIA_IsTableItemPatternAvailable:= <False>
UIA_IsTextPatternAvailable:= <False>
UIA_IsTogglePatternAvailable:= <False>
UIA_IsTransformPatternAvailable:= <False>
UIA_IsValuePatternAvailable:= <False>
UIA_IsWindowPatternAvailable:= <False>
UIA_ValueIsReadOnly:= <True>
UIA_RangeValueValue:= <0>
UIA_RangeValueIsReadOnly:= <True>
UIA_RangeValueMinimum:= <0>
UIA_RangeValueMaximum:= <0>
UIA_RangeValueLargeChange:= <0>
UIA_RangeValueSmallChange:= <0>
UIA_ScrollHorizontalScrollPercent:= <0>
UIA_ScrollHorizontalViewSize:= <100>
UIA_ScrollVerticalScrollPercent:= <0>
UIA_ScrollVerticalViewSize:= <100>
UIA_ScrollHorizontallyScrollable:= <False>
UIA_ScrollVerticallyScrollable:= <False>
UIA_SelectionCanSelectMultiple:= <False>
UIA_SelectionIsSelectionRequired:= <False>
UIA_GridRowCount:= <0>
UIA_GridColumnCount:= <0>
UIA_GridItemRow:= <0>
UIA_GridItemColumn:= <0>
UIA_GridItemRowSpan:= <1>
UIA_GridItemColumnSpan:= <1>
UIA_DockDockPosition:= <5>
UIA_ExpandCollapseExpandCollapseState:= <3>
UIA_MultipleViewCurrentView:= <0>
UIA_WindowCanMaximize:= <False>
UIA_WindowCanMinimize:= <False>
UIA_WindowWindowVisualState:= <0>
UIA_WindowWindowInteractionState:= <0>
UIA_WindowIsModal:= <False>
UIA_WindowIsTopmost:= <False>
UIA_SelectionItemIsSelected:= <False>
UIA_TableRowOrColumnMajor:= <2>
UIA_ToggleToggleState:= <2>
UIA_TransformCanMove:= <False>
UIA_TransformCanResize:= <False>
UIA_TransformCanRotate:= <False>
UIA_IsLegacyIAccessiblePatternAvailable:= <True>
UIA_LegacyIAccessibleChildId:= <0>
UIA_LegacyIAccessibleRole:= <20>
UIA_LegacyIAccessibleState:= <0>
UIA_LegacyIAccessibleDefaultAction:= <click ancestor>
UIA_IsDataValidForForm:= <False>
UIA_ProviderDescription:= <[pid:12272,hwnd:0x0 Main(parent link):Microsoft: MSAA Proxy (unmanaged:UIAutomationCore.dll)]>
UIA_IsItemContainerPatternAvailable:= <False>
UIA_IsVirtualizedItemPatternAvailable:= <False>
UIA_IsSynchronizedInputPatternAvailable:= <False>
UIA_OptimizeForVisualContent:= <False>
UIA_IsObjectModelPatternAvailable:= <False>
UIA_AnnotationAnnotationTypeId:= <0>
UIA_IsAnnotationPatternAvailable:= <False>
UIA_IsTextPattern2Available:= <False>
UIA_StylesStyleId:= <0>
UIA_StylesFillColor:= <0>
UIA_StylesFillPatternColor:= <0>
UIA_IsStylesPatternAvailable:= <False>
UIA_IsSpreadsheetPatternAvailable:= <False>
UIA_IsSpreadsheetItemPatternAvailable:= <False>
UIA_Transform2CanZoom:= <False>
UIA_IsTransformPattern2Available:= <False>
UIA_LiveSetting:= <0>
UIA_IsTextChildPatternAvailable:= <False>
UIA_IsDragPatternAvailable:= <False>
UIA_DragIsGrabbed:= <False>
UIA_DragDropEffects:= <True>
UIA_IsDropTargetPatternAvailable:= <False>
UIA_DropTargetDropTargetEffects:= <True>
UIA_Transform2ZoomLevel:= <1>
UIA_Transform2ZoomMinimum:= <1>
UIA_Transform2ZoomMaximum:= <1>
UIA_IsTextEditPatternAvailable:= <False>
UIA_IsPeripheral:= <False>
UIA_IsCustomNavigationPatternAvailable:= <False>
UIA_PositionInSet:= <0>
UIA_SizeOfSet:= <0>
UIA_Level:= <0>
UIA_LandmarkType:= <0>

 

Edited July 7, 2022 by phat_2008

[junkew]

1. For this you can use index/indexrelative:=nn
   so you first find an object with a name and then just +/- nn objects
   It can take a while to learn how to count but with the inspect.exe you should be able to identify the value for nn
   Check in the examples for index....  should become something like below (or another object thats closeby with an easy property)

   Local $oP9=_UIA_getObjectByFindAll($oP9, "Title:=DeltaV Operations;controltype:=UIA_DocumentControlTypeId;class:=Chrome_RenderWidgetHostHWND;indexrelative:=5", $treescope_children)

2. Do something like above with a treewalker. See examples how to use that

Check also FAQ31 with references to tools from @LarsJ that makes life easier with spying and getting barebone uia code
 

 

[phat_2008]

Thank junkew for the reply. When Using Spy the Parent groups highlighted are two different icons/buttons but both uses the same property values. When using inspect.exe there's no object property that I can use to invoke some clicking.

 

 

  

 

Inspect.exe

[junkew]

There are some calculated proporties that you doet see in inspect like index and indexrelative which you  can see in the wrapper source. So you can use 

Index or indexrelative and Just experiment with the value. Advice is to taken first a look in the examples to see how that works. Uia dump them all function can help in this.

[poisonkiller]

Hello,

I am hopping here from AHK forums to hopefully get some advice about automating Skype, since Autoit has a much longer history with UIA .

The thing is, Skype (and other Electron/Chromium apps) is very fussy with UIAutomation. ElementFromPoint and GetFocusedElement seems to work fine, but using FindAll with TrueCondition on the Skype window element doesn't display the whole UIA tree, and neither does recursively iterating over the Skype window elements with a TreeWalker with TrueCondition nor RawViewWalker: the content (Chromium) part is always missing. I've tried sending the WM_GETOBJECT message to Chrome_RenderWidgetHostHWND1 control, but it seems Chromium is activated, just not accessible. Setting up an event handler to send WM_GETOBJECT after a EVENT_SYSTEM_ALERT doesn't work. Also if it accessibility was turned off, then ElementFromPoint wouldn't work, so I think the problem is somewhere else. Activating the window or bringing to focus beforehand doesn't matter, the content still isn't found. 

When I run the following snippet with Skype open:

Local $oP1=_UIA_getObjectByFindAll($UIA_oDesktop, "Title:=Skype;controltype:=UIA_PaneControlTypeId", $treescope_children)
_UIA_Action($oP1,"setfocus")
_UIA_DumpThemAll($oP1, $treescope_subtree)

I get this:

expandcollapse popup

<log space="preserve">
<logline level="5" timestamp="20220712-134100996">
<information> Information _UIA_VersionInfo version: T0.7-0; Release date: 20190501; OS Version: WIN_10</information>
</logline>
<logline level="5" timestamp="20220712-134100996"> _UIA_normalizeExpression Title:=Skype;controltype:=UIA_PaneControlTypeId;elements 1-2 in properties array</logline>
<logline level="5" timestamp="20220712-134100997"> _UIA_normalizeExpression property 1 Title:=Skype</logline>
<logline level="5" timestamp="20220712-134100997"> name:[Title] value:[Skype] having index 3</logline>
<logline level="5" timestamp="20220712-134100999"> _UIA_normalizeExpression property 2 controltype:=UIA_PaneControlTypeId</logline>
<logline level="5" timestamp="20220712-134101999"> name:[controltype] value:[50033] having index 15</logline>
<logline level="5" timestamp="20220712-134101000"> *** Try to get a list of elements *** treescopetype:=2</logline>
<logline level="0" timestamp="20220712-134101362"> _UIA_getObjectByFindAll walk thru the tree with n elements where n equals 11</logline>
<logline level="5" timestamp="20220712-134101398"> Found match with element: 4 the Name is: <Title is: <Skype> Class := <Chrome_WidgetWin_1> controltype:= <UIA_PaneControlTypeId> ,<50033> , (0000C371) rect := < 10;0;620;680> hwnd := < 2427216> acceleratorkey := < > automationid := <> </logline>
<logline level="5" timestamp="20220712-134101398">
<propertymatching/>
</logline>
<logline level="5" timestamp="20220712-134101405"> Storing parent for found object in RTI as RTI.PARENT Desktop 1</logline>
<logline level="0" timestamp="20220712-134101539"> </logline>
<logline level="0" timestamp="20220712-134101541"> Quickly referenced object : <action>Action 1 setfocus on _UIA_IsElement:=1 Parameters 1:=0 2:=0 3:=0 4:=0</action></logline>
<logline level="0" timestamp="20220712-134102161">
<treedump>
<treeheader>***** Dumping tree *****</treeheader>
<elementinfo>Title is: <Skype> Class := <Chrome_WidgetWin_1> controltype:= <UIA_PaneControlTypeId> ,<50033> , (0000C371) , acceleratorkey:= <> , automationid:= <> </elementinfo>
<elementinfo>Title is: <> Class := <Intermediate D3D Window> controltype:= <UIA_PaneControlTypeId> ,<50033> , (0000C371) , acceleratorkey:= <> , automationid:= <> </elementinfo>
<elementinfo>Title is: <> Class := <> controltype:= <UIA_TitleBarControlTypeId> ,<50037> , (0000C375) , acceleratorkey:= <> , automationid:= <> </elementinfo>
<elementinfo>Title is: <System> Class := <> controltype:= <UIA_MenuBarControlTypeId> ,<50010> , (0000C35A) , acceleratorkey:= <> , automationid:= <MenuBar> </elementinfo>
<elementinfo>Title is: <System> Class := <> controltype:= <UIA_MenuItemControlTypeId> ,<50011> , (0000C35B) , acceleratorkey:= <> , automationid:= <> </elementinfo>
<elementinfo>Title is: <Minimize> Class := <> controltype:= <UIA_ButtonControlTypeId> ,<50000> , (0000C350) , acceleratorkey:= <> , automationid:= <> </elementinfo>
<elementinfo>Title is: <Maximize> Class := <> controltype:= <UIA_ButtonControlTypeId> ,<50000> , (0000C350) , acceleratorkey:= <> , automationid:= <> </elementinfo>
<elementinfo>Title is: <Close> Class := <> controltype:= <UIA_ButtonControlTypeId> ,<50000> , (0000C350) , acceleratorkey:= <> , automationid:= <> </elementinfo>
<elementinfo>Title is: <> Class := <> controltype:= <UIA_PaneControlTypeId> ,<50033> , (0000C371) , acceleratorkey:= <> , automationid:= <> </elementinfo>
<elementinfo>Title is: <> Class := <> controltype:= <UIA_PaneControlTypeId> ,<50033> , (0000C371) , acceleratorkey:= <> , automationid:= <> </elementinfo>
<elementinfo>Title is: <> Class := <> controltype:= <UIA_PaneControlTypeId> ,<50033> , (0000C371) , acceleratorkey:= <> , automationid:= <> </elementinfo>
<elementinfo>Title is: <> Class := <> controltype:= <UIA_PaneControlTypeId> ,<50033> , (0000C371) , acceleratorkey:= <> , automationid:= <> </elementinfo>
<elementinfo>Title is: <> Class := <> controltype:= <UIA_PaneControlTypeId> ,<50033> , (0000C371) , acceleratorkey:= <> , automationid:= <> </elementinfo>
</treedump>
</logline>
</log>

When I inspect the Skype window with Accessibility Insights, the tree also contains Window element with CurrentName="Skype" and Document element with CurrentName="Skype", both of which are missing from _DumpThemAll.

I've tested this on other Windows builds and the result seems to be the same. Sometimes when I kill all skype.exe processes and start Skype freshly, it works until Skype has been hidden behind another window, then it stops working and nothing gets it working again. In my main build, the FindAll/TreeWalker methods haven't worked even after killing the Skype processes. 

Perhaps user @LarsJ has ideas what might be going on? A bug in UIA?

Edited July 12, 2022 by poisonkiller