How to click in a sequence of pixels

[SomeBody22]

Hi, I need a way to click sequence of pixels.

I want to give just a click where you find the following colors:

Example: Blue>> Yellow>> White

This is my code, but is not working properly, it is clicking somewhere else:

MsgBox(0, "", "Initializing", 5)
$ColorLeft = 0x003366FF ;Blue
$ColorCenter = 0x00FFFF00 ;Yellow
$ColorRight = 0x00FFFFFF ;White
$ColorExists = 0
$LeftPosition = 1
$TopPosition = 1
Do
    $First = PixelSearch($LeftPosition, $TopPosition, @DesktopWidth, @DesktopHeight, $ColorLeft)
    If IsArray($First) Then
        $LeftPosition = $First[0]
        $TopPosition = $First[1]
        $Second = PixelSearch($LeftPosition, $TopPosition, @DesktopWidth, @DesktopHeight, $ColorCenter)
        $LeftPosition = $Second[0]
        If IsArray($Second) Then
            $Third = PixelSearch($LeftPosition, $TopPosition, @DesktopWidth, @DesktopHeight, $ColorRight)
            If IsArray($Second) Then
                $Left = PixelGetColor($Second[0] - 1, $Second[1])
                $Center = PixelGetColor($Third[0] - 1, $Third[1])
                If $Left = $ColorLeft And $Center = $ColorCenter Then
                    MouseClick("left",$First[0], $First[1])
                    MsgBox(0, "", "Done")
                    $ColorExists = 1
                Else
                    ;$LeftPosition = $First[0]+1
                    $TopPosition = $First[1] + 1
                EndIf
            EndIf
        EndIf
    EndIf
Until $ColorExists <> 0

[BrewManNH]

You're searching your entire desktop area, is it possible one of those colors might exist somewhere else on your desktop or whatever is on the screen at the time? Limit the search area to where you think the thing you're looking for might be and you'll probably find less false clicks.

[SomeBody22]

Yes, I'm looking at the entire desktop. Because the idea is to identify exactly where the sequence of colors pixels to click it.

[BrewManNH]

That search pattern isn't going to find what you're looking for unless you limit the area to be searched. I can understand the first search looking through the entire screen, but you are only limiting the second/third search patterns by using the top and left of the found pixel before it. You're still searching the rest of the screen for the next pixel if the first pixel found isn't in the image you showed, it might find the next 2 colors anywhere on the screen.

If you've ever played the game Battleship, think of your search area as looking for the PT boat, you hit the first pixel, you should look for the second pixel within a very small area around the first one, not the whole screen, same as with the third pixel, search in a small area around the second pixel.If you don't find it in that area, rerun the first search pattern again and try again.

[SomeBody22]

Well, thanks for the explanation, but it is really what I'm trying to do, he first looks around the desktop, if not find a sequence of pixels searched, he traces the beginning of search where the first pixel was found, but do not know where I am missing, since the research is not running in the correct area to redo the search ...

Below is a second code that I tried to make it work properly, but without success:

MsgBox(0, "", "Initializing", 5)
$ColorLeft = 0x003366FF ;Blue
$ColorCenter = 0x00FFFF00 ;Yellow
$ColorRight = 0x00FFFFFF ;White
$LeftPosition = 1
$ColorExists = 0
Do
$First = PixelSearch($LeftPosition, 1, @DesktopWidth, @DesktopHeight, $ColorLeft)
If IsArray($First) Then
  $Center = PixelGetColor($First[0] + 1, $First[1])
  $Right = PixelGetColor($First[0] + 2, $First[1])
  If $Center = $ColorCenter And $Right = $ColorRight Then
   $ColorExists = 1
   MouseClick("left", $First[0], $First[1])
   MsgBox(0, "", "Done")
  Else
   $LeftPosition = $First[0] + 1
   ToolTip("Searching... [" & $LeftPosition & "]", 1, 1)
  EndIf
EndIf
Until $ColorExists <> 0

[BrewManNH]

expandcollapse popup

MsgBox(0, "", "Initializing", 5)
$ColorLeft = 0x0000ff ;Blue
$ColorCenter = 0xFFFF00 ;Yellow
$ColorRight = 0xFFFFFF ;White
$ColorExists = 0
$LeftPosition = 1
$TopPosition = 1
$RightPosition = @DesktopWidth
$BottomPosition = @DesktopHeight
Do
    $First = PixelSearch($LeftPosition, $TopPosition, $RightPosition, $BottomPosition, $ColorLeft)
    If IsArray($First) Then ; first pixel found, look for the second pixel
        MsgBox(64, "", "Found the first pixel")
        $LeftPosition = $First[0]
        $TopPosition = $First[1]
        $RightPosition = $LeftPosition + 100 ; search within 100 pixels to the right and below the first pixel
        $BottomPosition = $TopPosition + 100 ;
        $Second = PixelSearch($LeftPosition, $TopPosition, $RightPosition, $BottomPosition, $ColorCenter)
        If IsArray($Second) Then ; second pixel found, look for the third pixel
            MsgBox(64, "", "Found the second pixel")
            $LeftPosition = $Second[0]
            $TopPosition = $Second[1]
            $RightPosition = $LeftPosition + 100 ; search within 100 pixels to the right and below the second pixel
            $BottomPosition = $TopPosition + 100
            $Third = PixelSearch($LeftPosition, $TopPosition, $RightPosition, $BottomPosition, $ColorRight)
            If IsArray($Third) Then
                MsgBox(64, "", "Found the third pixel")
                $Left = PixelGetColor($Second[0] - 1, $Second[1])
                $Center = PixelGetColor($Third[0] - 1, $Third[1])
                If $Left = $ColorLeft And $Center = $ColorCenter Then
                    MouseClick("left", $First[0], $First[1])
                    MsgBox(0, "", "Done")
                    $ColorExists = 1
                Else ; third pixel not found in that area, reset the search area using the last checked spot
                    $LeftPosition = $RightPosition
                    $TopPosition = $BottomPosition
                    $BottomPosition = @DesktopHeight
                    $RightPosition = @DesktopWidth
                EndIf
            EndIf
        Else ; second pixel not found in that area, reset the search area using the last checked spot
            $LeftPosition = $RightPosition
            $TopPosition = $BottomPosition
            $BottomPosition = @DesktopHeight
            $RightPosition = @DesktopWidth
        EndIf
    Else
        $TopPosition = @DesktopHeight ; bail out, the first pixel isn't on the screen at all, no point looking any more
    EndIf
Until $TopPosition >= @DesktopHeight - 50
MsgBox("", "", "Exiting")

Something like this might work for you. It looks within a rectangle 100 pixels wide by 100 pixels tall for the next pixel color. If it doesn't find it in that area, it resets the search area and looks again.

[SomeBody22]

Thanks but still does not work.

[BrewManNH]

Check to make sure that the colors being searched for are the correct colors, and try a shade variation if the color is sometimes different by a little bit.

[SomeBody22]

I made some adjustments to the initial code and successfully I got what wanted.

Thanks for the support BrewManNH!