AccessibleObjectFromWindow failing to return IDispatch

[zfisherdrums]

All,

Based on this thread, I am attempting to retrieve a control's Accessible object. The ultimate goal here is to provide the ability to utilize Active Accessibility for Test Automation purposes without having to rely on an external DLL to wrap around oleacc.dll.

In the mock-up below, I am expecting $result[4] to be a reference to an IDispatch object. However, it is returning empty. Does anyone see the err of my ways, and if so, could provide some advisement? Thanks in advance.

Global Const $OBJID_WINDOW = 0x00000000

; Open Calculator and obtain handle for the '2' button
Run("calc.exe")
WinWait("Calculator")
Dim $hWnd = ControlGetHandle("Calculator", "", "[TEXT:2]")

; Define the IAccessible GUID
Dim $IID_IAccessible = DllStructCreate("int;short;short;byte[8]")
DllStructSetData($IID_IAccessible, 1, 0x626FC520)
DllStructSetData($IID_IAccessible, 2, 0xA41E)
DllStructSetData($IID_IAccessible, 3, 0x11CF)
DllStructSetData($IID_IAccessible, 4, 0xA7, 1)
DllStructSetData($IID_IAccessible, 4, 0x31, 2)
DllStructSetData($IID_IAccessible, 4, 0x0, 3)
DllStructSetData($IID_IAccessible, 4, 0xA0, 4)
DllStructSetData($IID_IAccessible, 4, 0xC9, 5)
DllStructSetData($IID_IAccessible, 4, 0x8, 6)
DllStructSetData($IID_IAccessible, 4, 0x26, 7)
DllStructSetData($IID_IAccessible, 4, 0x37, 8)

; Call to AccessibleObjectFromWindow in the hopes of receiving a valid IDispatch object
DllCall("ole32.dll", "long", "CoInitialize", "ptr", "")
Dim $result = DllCall("oleacc.dll", "long", "AccessibleObjectFromWindow", "hwnd", $hWnd, "long", _
        $OBJID_WINDOW, "ptr", DllStructGetPtr($IID_IAccessible), "idispatch*", 0)

; Post the test result to the console
Dim $actualResult = IsObj($result[4])
ConsoleWrite(StringFormat("Expected: 1\tActual: %s", $actualResult) & @CRLF)

; Cleanup
WinClose("Calculator")

+>14:07:13 Starting AutoIt3Wrapper v.1.10.1.14 Environment(Language:0409 Keyboard:00000409 OS:WIN_XP/Service Pack 2 CPU:X86 ANSI)

>Running AU3Check (1.54.14.0) from:C:\Program Files\AutoIt3

+>14:07:13 AU3Check ended.rc:0

>Running:(3.3.0.0):C:\Program Files\AutoIt3\autoit3.exe "C:\Documents and Settings\fisherz\Desktop\test.au3"

Expected: 1 Actual: 0

+>14:07:13 AutoIT3.exe ended.rc:0

+>14:07:15 AutoIt3Wrapper Finished

>Exit code: 0 Time: 2.255

EDIT: Wrong variable name provided. Edited January 5, 2009 by zfisherdrums

[yehia]

just what im looking for please keep me in touch if u get this to work

thanks alot

[junkew]

In IE.AU3 there is code like below. Maybe that solves the problem

expandcollapse popup

;===============================================================================
;
; Function Name:    __IEControlGetObjFromHWND()
; Description:      Returns a COM Object Window reference to an embebedded Webbrowser control
; Parameter(s):     $hWin       - HWND of a Internet Explorer_Server1 control obtained for example:
;                   $hwnd = ControlGetHandle("MyApp","","Internet Explorer_Server1")
; Requirement(s):   Windows XP, Windows 2003 or higher.
;                   Windows 2000; Windows 98; Windows ME; Windows NT may install the
;                   Microsoft Active Accessibility 2.0 Redistributable:
;                   http://www.microsoft.com/downloads/details.aspx?FamilyId=9B14F6E1-888A-4F1D-B1A1-DA08EE4077DF&displaylang=en
; Return Value(s):  On Success  - Returns DOM Window object
;                  On Failure   - 0  and sets @ERROR = 1
; Author(s):        Larry with thanks to Valik
;
;===============================================================================
;
Func __IEControlGetObjFromHWND(ByRef $hWin)
    DllCall("ole32.dll", "int", "CoInitialize", "ptr", 0)
    Local Const $WM_HTML_GETOBJECT = __IERegisterWindowMessage("WM_HTML_GETOBJECT")
    Local Const $SMTO_ABORTIFHUNG = 0x0002
    Local $lResult, $typUUID, $aRet, $oIE
    
    __IESendMessageTimeout($hWin, $WM_HTML_GETOBJECT, 0, 0, $SMTO_ABORTIFHUNG, 1000, $lResult)
    
    $typUUID = DllStructCreate("int;short;short;byte[8]")
    DllStructSetData($typUUID, 1, 0x626FC520)
    DllStructSetData($typUUID, 2, 0xA41E)
    DllStructSetData($typUUID, 3, 0x11CF)
    DllStructSetData($typUUID, 4, 0xA7, 1)
    DllStructSetData($typUUID, 4, 0x31, 2)
    DllStructSetData($typUUID, 4, 0x0, 3)
    DllStructSetData($typUUID, 4, 0xA0, 4)
    DllStructSetData($typUUID, 4, 0xC9, 5)
    DllStructSetData($typUUID, 4, 0x8, 6)
    DllStructSetData($typUUID, 4, 0x26, 7)
    DllStructSetData($typUUID, 4, 0x37, 8)

    $aRet = DllCall("oleacc.dll", "long", "ObjectFromLresult", "lresult", $lResult, "ptr", DllStructGetPtr($typUUID), _
            "wparam", 0, "idispatch*", 0)

    If IsObj($aRet[4]) Then
        $oIE = $aRet[4] .Script()
    ; $oIE is now a valid IDispatch object
        Return $oIE.document.parentwindow
    Else
        SetError(1)
        Return 0
    EndIf
EndFunc  ;==>__IEControlGetObjFromHWND

[ProgAndy]

I think AutoIt can't use an IAccessible object, just IDispatch. So you would have to use IID_Dispatch to get the object.

[yehia]

i will test that thanks junkew

and i dont know the difference between IDispatch and IAccessible

and is there any examples for that thanks alot i searched alot and got nothing

[zfisherdrums]

No dice on any of the above.

I had already tried the IE.au3 method, but unfortunately, the WM_HTML_GETOBJECT message is not what I need when testing a Non-web based application. I attempted to use the same methodology using WM_GETOBJECT, but was not able to retrieve a valid IDispatch object from "ObjectFromLresult". If I recall correctly, one upstream problems was getting back a valid $lResult from my SendMessage() call.

Anyhoo, I wrapped up some MsAA functionality in VB6 and created a DLL. It is based on source code found here. Also, I used Fritsche's source code as a point of reference - although the two code bases appear very similar.

If you're flexible with your solution, you could write your script in VBA. I ported this example into VBA with little change and received the desired output. As of today, I've had no success in porting this to AutoIt. c'est la vie.

Declare Function AccessibleObjectFromPoint& Lib "oleacc" (ByVal x&, ByVal y&, ppoleAcc As Object, pvarElement As Variant)
Declare Function GetRoleText& Lib "oleacc" Alias "GetRoleTextA" (ByVal Role&, ByVal Text$, ByVal Size&)
Declare Function GetStateText& Lib "oleacc" Alias "GetStateTextA" (ByVal State&, ByVal Text$, ByVal Size&)

Type POINTAPI
    x As Integer
    y As Integer
End Type

Public Sub Test()
    Dim objAccessible As Object, pt As POINTAPI, dl&, sName$, sValue$
    Dim v As Variant, vState As Variant, sRole As Variant
    
    pt.x = 251   '<---these coordinates should be obtained via a call to WinGetPos() [AutoItX.dll]
    pt.y = 293
    
    dl = AccessibleObjectFromPoint(pt.x, pt.y, objAccessible, v)
    sName = objAccessible.accName(v)
    sValue = Trim$(objAccessible.accValue(v))
    vState = objAccessible.accState(v)
    sRole = objAccessible.accRole(v)
    
    Debug.Print (sName)
    Debug.Print (sValue)
    Debug.Print (vState)
    Debug.Print (sRole)
End Sub

Edit: I PORTED the example, not POSTED; big difference!

Edited January 12, 2009 by zfisherdrums

[junkew]

AccessibleObjectFromPoint maybe gives a better result?

[yehia]

sry for asking for help in ur topic zfisherdrums

though im still lost

im trying to get the Value of an object and i have the source code of a prog that does this .BAS

if u have any experience in BASIC we can try working on that

Edit : and btw i guess AccessibleObjectFromPoint is not what im looking for as far as i know it gives the value in an object which the mouse is over or with the pos defined but i need to specify the object name like "history" and still lost though

Edited January 12, 2009 by yehia