Find Control Handle with only Screen Coordinates ? Like the Finder tool!

[Rickname]

Hi,

I want to know how can I find what control of a window is in the specific point of a window, like AutoIt Window Info Finder tool does, when you drag that 'target' to a window with controls, it highlights the window's control in that point( if any) and lists every detail about that control.

Now how can this be possible >_< ? Thanks alot!

[guinness]

Search for _WinAPI_WindowFromPoint and search the Examples section for an example by Yashied.

[Rickname]

Search for _WinAPI_WindowFromPoint and search the Examples section for an example by Yashied.

Oh I found it in the Help file : and yes it works very well, thanks alot guinness !

#include

HotKeySet("{ESC}", "Close") ; Set ESC as a hotkey to exit the script.

Global $tStruct = DllStructCreate($tagPOINT) ; Create a structure that defines the point to be checked.

Example()

Func Example()
Local $hWnd

While 1
ToolTip("")
Position() ; Update the X and Y elements with the X and Y co-ordinates of the mouse.
$hWnd = _WinAPI_WindowFromPoint($tStruct) ; Retrieve the window handle.
ToolTip($hWnd) ; Set the tooltip with the handle under the mouse pointer.
Sleep(100)
WEnd
EndFunc ;==>Example

Func Position()
DllStructSetData($tStruct, "x", MouseGetPos(0))
DllStructSetData($tStruct, "y", MouseGetPos(1))
EndFunc ;==>Position

Func Close()
Exit
EndFunc ;==>Close

But how about , by just knowing the coordinates related to that window only, and the window to be minimized ? Can that be possible ?

Edited April 4, 2013 by Rickname

[guinness]

This is a more appropriate example;

#include <Constants.au3>
#include <WinAPI.au3>
#include <WindowsConstants.au3>

HotKeySet('{ESC}', '_Exit')

Example()

Func Example()
    Local $hWnd = 0, $hWnd_Previous = 0, $tGetMousePos = 0 ; Declaring variables in the loop will slow it down.

    While 1
        $tGetMousePos = _WinAPI_GetMousePos()
        $hWnd = _WinAPI_GetAncestor(_WinAPI_WindowFromPoint($tGetMousePos), $GA_ROOT)
        If Not ($hWnd = $hWnd_Previous) Then
            $hWnd_Previous = $hWnd
            ConsoleWrite($hWnd & @CRLF)
            TrayTip('', $hWnd, 2)
        EndIf
        Sleep(20)
    WEnd
EndFunc   ;==>Example

Func _Exit()
    Exit MsgBox($MB_SYSTEMMODAL, '', 'Exiting...', 1)
EndFunc   ;==>_Exit

I'm not really following your last point, sorry.

Edited April 4, 2013 by guinness

[Rickname]

This is a more appropriate example;

#include <Constants.au3>
#include <WinAPI.au3>
#include <WindowsConstants.au3>

HotKeySet('{ESC}', '_Exit')

Example()

Func Example()
Local $hWnd = 0, $hWnd_Previous = 0, $tGetMousePos = 0 ; Declaring variables in the loop will slow it down.

While 1
$tGetMousePos = _WinAPI_GetMousePos()
$hWnd = _WinAPI_GetAncestor(_WinAPI_WindowFromPoint($tGetMousePos), $GA_ROOT)
If Not ($hWnd = $hWnd_Previous) Then
$hWnd_Previous = $hWnd
ConsoleWrite($hWnd & @CRLF)
TrayTip('', $hWnd, 2)
EndIf
Sleep(20)
WEnd
EndFunc ;==>Example

Func _Exit()
Exit MsgBox($MB_SYSTEMMODAL, '', 'Exiting...', 1)
EndFunc ;==>_Exit

I'm not really following your last point, sorry.

Regarding the last point, why ? Its too hard ? Thanks ! Edited April 4, 2013 by Rickname

[guinness]

Look at WinGetPos and WinGetState. Just pass the handle ($hWnd variable) to those functions. If the window is minimised though then the pointer won't be under the window.

[Rickname]

Look at WinGetPos and WinGetState. Just pass the handle ($hWnd variable) to those functions. If the window is minimised though then the pointer won't be under the window.

Correct. Thats why Im wondering if the window is minimized or obstructioned by other window, can be possible then to see what control is in that point of that obstrutioned window thru other method ?

[guinness]

One way I can think, is use WinList and WinGetPos to store the window positions and then get the position of the mouse and compare with what window should be under the mouse. But this is complicated and not to mentioned flawed in implementation.

What's your purpose?

[PhoenixXL]

Here We go

#include <WinAPI.au3>

;Works for Minimized Hidden and disabled Windows

$hWinMain = GUICreate("Test", 500, 100)
GUICtrlCreateLabel("This is a Label", 10, 10, 50, 30 )
GUISetState( @SW_MINIMIZE )

$hLabel = _ChildWindowFromPointEx( $hWinMain, 11, 16 )
MsgBox ( 64, "Result:", StringFormat("hWnd: %s\nClass: %s",$hLabel, _WinAPI_GetClassName($hLabel)))

GUISetState()

While GUIGetMsg()<>-3
Sleep(10)
WEnd

Func _ChildWindowFromPointEx($hWnd, $iX, $iY, $iFlags = 0)

Local $Ret = DllCall('user32.dll', 'hwnd', 'ChildWindowFromPointEx', 'hwnd', $hWnd, 'int', $iX, 'int', $iY, 'uint', $iFlags)

If @error Then
Return SetError(1, 0, 0)
EndIf
Return $Ret[0]
EndFunc ;==>_WinAPI_ChildWindowFromPointEx

Thumbs up if it helped

Regards

Edited April 4, 2013 by PhoenixXL

[guinness]

WinAPI include is missing.

[PhoenixXL]

Thanks

[Rickname]

Here We go

#include <WinAPI.au3>

;Works for Minimized Hidden and disabled Windows

$hWinMain = GUICreate("Test", 500, 100)
GUICtrlCreateLabel("This is a Label", 10, 10, 50, 30 )
GUISetState( @SW_MINIMIZE )

$hLabel = _ChildWindowFromPointEx( $hWinMain, 11, 16 )
MsgBox ( 64, "Result:", StringFormat("hWnd: %s\nClass: %s",$hLabel, _WinAPI_GetClassName($hLabel)))

GUISetState()

While GUIGetMsg()<>-3
Sleep(10)
WEnd

Func _ChildWindowFromPointEx($hWnd, $iX, $iY, $iFlags = 0)

Local $Ret = DllCall('user32.dll', 'hwnd', 'ChildWindowFromPointEx', 'hwnd', $hWnd, 'int', $iX, 'int', $iY, 'uint', $iFlags)

If @error Then
Return SetError(1, 0, 0)
EndIf
Return $Ret[0]
EndFunc ;==>_WinAPI_ChildWindowFromPointEx

Thumbs up if it helped

Regards

I need to mention that I tested your script with several windows and controls and on some windows works, and on some don't, and when I said 'don't, I mean it works but the control that finds is a wrong one than what AutoIt Info tool finds ! And AutoIt Info tool shows every time the correct control, just like Spyxx (Spy++) does - a program created by Microsoft exactly for this scope and many other things...! Edited April 4, 2013 by Rickname

[Rickname]

WinAPI include is missing.

lol ? The "_WinAPI_WindowFromPoint" really does exists in the help file of the latest AutoIt version in the UDF section -> WinAPI Management - > then scroll till bottom there should be

[guinness]

That wasn't aimed at you.

[PhoenixXL]

I need to mention that I tested your script with several windows and controls and on some windows works, and on some don't, and when I said 'don't, I mean it works but the control that finds is a wrong one than what AutoIt Info tool finds ! And AutoIt Info tool shows every time the correct control, just like Spyxx (Spy++) does - a program created by Microsoft exactly for this scope and many other things...!

When you use those tools, It's obvious that the window isn't obscured or hidden. Could you please give examples of the code where it doesn't work

[Rickname]

When you use those tools, It's obvious that the window isn't obscured or hidden. Could you please give examples of the code where it doesn't work

Sure, try it on the Google Chrome browser on its client control. The class is "Chrome_WidgetWin_1" but your script shows it as "Chrome_WidgetWin_0" and the handle is not the same as AutoIt Window Info shows as !

[PhoenixXL]

"Chrome_WidgetWin_0" and the handle is not the same as AutoIt Window Info shows as !

Right. Au3Info shows something different. Maybe it's something I'm not aware of .

The class is "Chrome_WidgetWin_1"

Nah!. That's the WindowClass, the control class is Chrome_RenderWidgetHostHWND

Maybe there is some difference what _WindowFromPoint and what _ChildWindowFromPointEx returns

Check this out

#include <WinAPI.au3>
#include <Misc.au3>

;Works for Minimized Hidden and disabled Windows

$hWinMain = WinGetHandle("[CLASS:Chrome_WidgetWin_1]")

$tPoint = DllStructCreate($tagPoint)
DllStructSetData($tPoint, 1, 5)
DllStructSetData($tPoint, 2, 71)

;Proceed further when LMouse is pressed
While _IsPressed("01") = 0
Sleep(10) ;Use this to activate the Google Chrome
WEnd

$hLabel = _WinAPI_WindowFromPoint($tPoint) ;_ChildWindowFromPointEx($hWinMain, 5, 71)
MsgBox(64, "Result:", StringFormat("hWnd: %s\nClass: %s", $hLabel, _WinAPI_GetClassName($hLabel)))


Func _ChildWindowFromPointEx($hWnd, $iX, $iY, $iFlags = 0)

Local $Ret = DllCall('user32.dll', 'hwnd', 'ChildWindowFromPointEx', 'hwnd', $hWnd, 'int', $iX, 'int', $iY, 'uint', $iFlags)

If @error Then
Return SetError(1, 0, 0)
EndIf
Return $Ret[0]
EndFunc ;==>_ChildWindowFromPointEx

_WindowFromPoint returns what is shown in Au3Info but thats different from what _ChildWindowFromPointEx returns.

Strange.

Edit: This Link should help http://blogs.msdn.com/b/oldnewthing/archive/2010/12/30/10110077.aspx

Finally found the Solution

#include <WinAPI.au3>
#include <Constants.au3>

;Works for Minimized Hidden and disabled Windows

$hWinMain = WinGetHandle("[CLASS:Chrome_WidgetWin_1]")

$hLabel = _WindowFromPointEx($hWinMain, 5, 71) ;Its Slow but works :)
MsgBox(64, "Result:", StringFormat("hWnd: %s\nClass: %s", $hLabel, _WinAPI_GetClassName($hLabel)))


Func _WindowFromPointEx($hWnd, $iX, $iY)

Local $Ret = DllCall('user32.dll', 'hwnd', 'ChildWindowFromPoint', 'hwnd', $hWnd, 'int', $iX, 'int', $iY)

If @error Then
Return SetError(1, 0, 0)
EndIf
Return _WinAPI_GetWindow($Ret[0], $GW_CHILD)
EndFunc ;==>_ChildWindowFromPointEx

Edited April 7, 2013 by PhoenixXL