Mouse click on explorer window...item to click is not displayed on screen

[davidacrozier]

I am attempting to drag and drop a file from one windows explorer window to another windows explorer window (henceforth referred to as window1 and window2).  I am not using the web.  I have used autowinexp.au3 (taken from LarsJ's automatewindowsexplorer.au3) to give focus (function GetFileFocus)  to a file on window1.   The problem is that sometimes the file with the focus is not displayed on window1 because it is farther down the list than what is displayed in window1.  There are other ways to accomplish this (like copy and paste) but I want to emulate the GUI doing a drag and drop.  I work as a digital forensicator and my task is to examine what artifacts are left behind on move/copy vs a drag and drop.  Please note that when I open window1 and window2 they are on top of each other, so I drag window2 over about 1150 pixels and that part works great.    

My code is listed below.  Please understand that I have tried several different methods to accomplish this task.  The last one was to estimate that the top of the window1 header is approximately 320 pixels and to multiply the index of the file by 20 pixels since that appears to be the approximate height of individual files using the AutoIT Windows Info tool.  Ideally the program would search window1 for the file name text and provide a mouse position for it.  Or the program would allow me to scroll to where the file name is located.  Any and all ideas are welcome.

Using Windows 10

AutoIT v3.3.14.2

Thanks!

DavidaCrozier

PS Any problems in autowinexp.au3 are mine and not the author of automatewindowsexplorer.au3.  

 

DragAndDropForum.au3

autowinexp.au3

Edited July 14, 2017 by davidacrozier

[Danyfirex]

Hello. Try to add all the references. I did this PoC without using extern UDF.  Tested in Windows 10 (Spanish Lang)

 

expandcollapse popup

#RequireAdmin ; Runs script as admin user
#include <AutoItConstants.au3>


Local $sTextDesktop="Escritorio"  ;Use "Desktop" for English OS
Local $sTextDocuments="Documentos" ;Use  "Documents" for English OS

;just for closing the windows if they exist
WinClose("[CLASS:CabinetWClass]", $sTextDesktop)
WinClose("[CLASS:CabinetWClass]",$sTextDocuments)

Local $sFile = @UserProfileDir & "\Desktop\testautoit.txt"
FileWrite($sFile,"My Demo File")
Local $filePath1 = @UserProfileDir & "\Desktop"
Local $filePath2 = @UserProfileDir & "\Documents"

Local $iPid1 = Run("explorer.exe " & $filePath1)
Local $hHandle1 = WinWait("[CLASS:CabinetWClass]", $sTextDesktop)


Local $iPid2 = Run("explorer.exe " & $filePath2)
Local $hHandle2 = WinWait("[CLASS:CabinetWClass]", $sTextDocuments)

ConsoleWrite("Handle1: " & $hHandle1 & @TAB & "Title: " & WinGetTitle($hHandle1) & @CRLF)
ConsoleWrite("Handle2: " & $hHandle2 & @TAB & "Title: " & WinGetTitle($hHandle2) & @CRLF)


Local $iWidth = @DesktopWidth / 2
Local $iHeight = @DesktopHeight - 50
ConsoleWrite($iWidth & @CRLF)
ConsoleWrite($iHeight & @CRLF)

WinMove($hHandle1, "", 1, 1, $iWidth, $iHeight) ;move window 1
WinMove($hHandle2, "", $iWidth, 1, $iWidth, $iHeight) ;move window 2
Sleep(500)
WinActivate($hHandle1, "")


Local $oShell = ObjCreate("Shell.Application")
Local $oDocument = 0
For $oWindow In $oShell.Windows
    If $hHandle1 = $oWindow.HWND Then
        ConsoleWrite(Hex($oWindow.HWND) & @CRLF)
        $oDocument = $oWindow.Document
    EndIf
Next


If IsObj($oDocument) Then
    Local $bFound = False
    Local $iCountIndex = 0
    Local $oItems = $oDocument.Folder.Items

    For $oItem In $oItems
        If $iCountIndex = 0 Then $oDocument.SelectItem($oItem, 1) ;select First Item
        If $oItem.Path = $sFile Then
            ConsoleWrite($oItem.Path & @CRLF)
            $bFound = True
            ExitLoop
        EndIf
        $iCountIndex += 1
    Next
    If $bFound Then
        ConsoleWrite($iCountIndex & @CRLF)
        ControlSend($hHandle1, "", "", "{DOWN " & $iCountIndex & "}")
        Local $aPixel = PixelSearch(0, 0, $iWidth, $iHeight, 0xCCE8FF)
        If IsArray($aPixel) Then
;~          MouseMove($aPixel[0] + 10, $aPixel[1] + 10)
;~          MouseMove($iWidth + ($iWidth / 2), 10)
            MouseClickDrag($MOUSE_CLICK_LEFT, $aPixel[0] + 10, $aPixel[1] + 10, $iWidth + ($iWidth / 2), 10)
        EndIf
        Else
        MsgBox(0,"Information","File Not Found")
        EndIf

EndIf

Exit

Saludos

 

[LarsJ]

Interesting solution. I usually use UI Automation code.

[davidacrozier]

@Danyfirex  This works amazingly well.  Very simple but elegant.  I never knew that you could drag to the top of the window.  Muchas gracias. Realmente aprecio su ayuda.

[davidacrozier]

@LarsJ Thanks so much for your solution.  A couple of questions.  You do not seem to worry about using the ObjCreateInterface even though it is marked as experimental.  Is this your code doing the function?  Second, where did you learn to code with the interfaces and objects within Windows?  I would love to have a better command of these coding techniques.  If I am understanding your code correctly... the Realize method for the VirtualItem makes it visible.  Does this include focus for the item?   Can I then get the mouse position for this item or do I need to search the array for the name?  Hope this makes sense to you.

Thanks again. 

[Danyfirex]

You're welcome. (De nada )

 

About question to LarsJ. I know He can answer better than me But I want to write a bit.

ObjCreateInterface It's not experimental. We have been using it since years without any bug. 

To learn about  interfaces and objects  You need to know about COM/Interface Implementation, check msdn doc.

Then You can search over the forum We have a lot of examples using ObjCreateInterface. 

 

About Focus and Position. Sure It's possible. I can't check right now but sure LarsJ will provide a solution. Of course you can try by yourself probably reading the whole LarsJ 's topic about Automation Windows Explorer You'll find the answer or a correct way to go to.

 

Saludos

 

 

 

[davidacrozier]

@Danyfirex would you please explain to me what the following statement does.

Local $aPixel = PixelSearch(0, 0, $iWidth, $iHeight, 0xCCE8FF)

I know that PixelSearch searches a rectangle of pixels for the pixel color provided.  What color did you choose and why?  Then the statement returns an array containing the x,y coordinates of the results of the search.  I am just trying to understand why you are searching for that 0xCCE8FF color and how  you knew to do the search,

Thanks again!

[Danyfirex]

Look:

https://prnt.sc/fwus0y

 

If the Selection color is Diferent It will fail.

 

Saludos

 

[davidacrozier]

Excellent. I just wanted to understand what was going on.

[davidacrozier]

Hello again.  I am using my modified version of automatewindowsexplorer.au3 to get the focus for folders.  This script creates a folder on desktop, documents, and temp folders.  Then it turns around and deletes those same folders.  It appears that the folder to be deleted has focus but something in my code is causing it to deselect the focus before I can delete the file.  As always your help is appreciated.  This script uses the GUI in order to observe what artifacts are created by windows.

 

Davida Crozier

 

deleteFileTest.au3

autowinexp.au3

[BrewManNH]

Are you using the Windows Explorer window to delete the folder? Why?

Use DirRemove instead and just pass it your folder path, not sure I've ever seen anyone try to do it the way you're doing it.

 

[davidacrozier]

@BrewManNH...I am using this script to test some digital forensics artifacts that are left behind when the Windows GUI does these functions.  I need to ensure that the Windows GUI is performing the delete.  Thanks for your reply.

One additional note as I keep working with this issue.  I am attempting to get the delete to work on folders when I include the appropriate automatewindowsexplorer.au3 code inline with my script.  I just wasn't sure why the folder lost the focus.

Any help is greatly appreciated.

DavidaCrozier