BETA: SciTE v5x & lua Dynamic_include and "Smart" AutoComplete for Vars/UDFs/Abbrevs

[Jos]

10 hours ago, jpm said:

Still no working due to fold.on.open=1

Thanks for debugging that!  I understand now and fixed it in the current lua.zip version.  

[mLipok]

I was testing with this script snippet:

#Region ; *** Dynamically added Include files ***
#include "Z:\!!!_SVN_AU3\UDF_Forum\mLipok\ADO.au3"
#include "z:\!!!_SVN_AU3\UDF_Forum\Other_Members\WinHttp.au3"
#include "z:\!!!_SVN_AU3\UDF_Forum\Other_Members\WinHttpConstants.au3"
#include "z:\!!!_SVN_AU3\UDF_Forum\Other_Members\wd_helper.au3"
#include <File.au3>                                          ; (07/03/22 14:50:57
#include <FileConstants.au3>                                 ; (07/03/22 14:51:25
#include <Array.au3>                                         ; (07/03/22 15:00:34
#EndRegion ; *** Dynamically added Include files ***
_Example()
Func _Example()
    Local $aTemp = _FileListToArray(@ScriptDir, '*', $FLTA_FILES, False)
    
    _ArrayDisplay(

    _ADO_Execute(
    $ADO_

    _WinHttpConnect(
    $WINHTTP_

    _WD_CreateSession($_WD_EmptyDict)
    $_WD_OPTION_
EndFunc   ;==>_Example

 

Question 1:
Why Array.au3 was added ?

#include <Array.au3>                                         ; (07/03/22 15:00:34

It is already referenced in File.au3

Question 2:
Why I'm not able to popup the menu to choose constants for:

$ADO_
$WINHTTP_
$_WD_OPTION_

 

Edited July 3, 2022 by mLipok

[mLipok]

do you plan in the future to save the comments 

Quote

; (07/03/22 15:00:34

?

if so I propse to change them:

Quote

; automatically added by SciTE4AutoIt - 07/03/22 15:00:34

 

[mLipok]

I'm still not sure how to use:

#SciTE4AutoIt3_Include_Path

I already try to use them like in this following example:

#Region ; *** Dynamically added Include files ***
#SciTE4AutoIt3_Include_Path=;z:\!!!_SVN_AU3\UDF_ML;Z:\!!!_SVN_AU3\UDF_Forum\mLipok\;z:\!!!_SVN_AU3\UDF_Forum\Other_Members\
#include <File.au3>                                          ; (07/03/22 14:50:57
#include <FileConstants.au3>                                 ; (07/03/22 14:51:25
#include <Array.au3>                                         ; (07/03/22 15:00:34
#EndRegion ; *** Dynamically added Include files ***
_Example()
Func _Example()
    Local $aTemp = _FileListToArray(@ScriptDir, '*', $FLTA_FILES, False)

    _ArrayDisplay(

    _ADO_Execute(
    $ADO_

    _WinHttpConnect(
    $WINHTTP_

    _WD_CreateSession(
    $_WD_OPTION_
EndFunc   ;==>_Example

But I'm not able to invoke this feature when I try to use this following functions:

_ADO_Execute(
_WinHttpConnect(
_WD_CreateSession(

I mean include are not added automaticaly.

What am I doing wrong?

 

[Jos]

16 minutes ago, mLipok said:

Question 1:
Why Array.au3 was added ?

Dynamic Include doesn't check if another #include file already has an Include for the required file, but will simply check whether the required include (array.au3) is already in it's source. I have deliberately done it that way and believe that this is the way it should be, not depending on other files as else things become really messy!

16 minutes ago, mLipok said:

Question 2:
Why I'm not able to popup the menu to choose constants for:

Works fine for me, but you know the drill when you like me to have a look!

Spoiler

autoittools.debug=1
restart SciTE
Send me your dynamic_udfs.err log

 

Edited July 3, 2022 by Jos

[Jos]

8 minutes ago, mLipok said:

do you plan in the future to save the comments 

Don't know what you are asking here... save where?  

 

8 minutes ago, mLipok said:

if so I propse to change them:

Nope...  They are inside the #region created by Dynamic Includes and they are added at the end of it with the Date/Timestamp, which I my humble opion is enough.

[Jos]

3 minutes ago, mLipok said:

I mean include are not added automaticaly.

What am I doing wrong?

 

3 minutes ago, Jos said:

Works fine for me, but you know the drill when you like me to have a look!

  Reveal hidden contents

autoittools.debug=1
restart SciTE
Send me your dynamic_udfs.err log

 

 

Did you open that debug log and have a look at it...   it gives you a lot of info about what it is doing.....  

Edited July 3, 2022 by Jos

[mLipok]

22 minutes ago, Jos said:

Did you open that debug log and have a look at it...   it gives you a lot of info about what it is doing.....

Yes.
 

Quote

>15:32:59 ->PerfDynUDFs ->GetCFileUDFs > Scan include 6-25 file=z:\!!!_svn_au3\udf_forum\mlipok\ADO_API.au3
 15:32:59 ->PerfDynUDFs ->GetCFileUDFs   + cfiFunc 170 =>_ADO_API
 15:32:59 ->PerfDynUDFs ->GetCFileUDFs   + cfiFunc 171 =>_ADO_API2
 15:32:59 ->PerfDynUDFs ->GetCFileUDFs   + cfiFunc 172 =>_ADO_API_ConnectionString
>15:32:59 ->PerfDynUDFs ->GetCFileUDFs > Scan include 7-25 file=z:\!!!_svn_au3\udf_forum\mlipok\ADOX.au3
 15:32:59 ->PerfDynUDFs ->GetCFileUDFs   + cfiFunc 173 =>_ADOX_ErrFunc
 15:32:59 ->PerfDynUDFs ->GetCFileUDFs   + cfiFunc 174 =>_ADOX_GetErrMsg
 15:32:59 ->PerfDynUDFs ->GetCFileUDFs   + cfiFunc 175 =>_ADOX_RegisterErrorHandler
 15:32:59 ->PerfDynUDFs ->GetCFileUDFs   + cfiFunc 176 =>_ADOX_UnRegisterErrorHandler
>15:32:59 ->PerfDynUDFs ->GetCFileUDFs > Scan include 8-25 file=z:\!!!_svn_au3\udf_forum\mlipok\ADOX_2.au3
 15:32:59 ->PerfDynUDFs ->GetCFileUDFs   + cfiFunc 177 =>_ADOX_CreateDatabase
 15:32:59 ->PerfDynUDFs ->GetCFileUDFs   + cfiFunc 178 =>_ADOX_CreateIndexes
 15:32:59 ->PerfDynUDFs ->GetCFileUDFs   + cfiFunc 179 =>_ADOX_CreateKey

but z:\!!!_svn_au3\udf_forum\mlipok\ADO.au3  was not processed at all.

Then I found:

Quote

 15:33:01 ->PerfDynUDFs ->GetCFileUDFs  Skipping over 28-25 include file=z:\!!!_svn_au3\udf_forum\mlipok\ADO_CONSTANTS.au3
 15:33:01 ->PerfDynUDFs ->GetCFileUDFs  Skipping over 29-25 include file=z:\!!!_svn_au3\udf_forum\mlipok\ADO.au3
 15:33:02 ->PerfDynUDFs ->GetCFileUDFs  Skipping over 177-25 include file=z:\!!!_svn_au3\udf_forum\other_members\WinHttp.au3
 15:33:02 ->PerfDynUDFs ->GetCFileUDFs  Skipping over 178-25 include file=z:\!!!_svn_au3\udf_forum\other_members\WinHttpConstants.au3
 15:33:02 ->PerfDynUDFs ->GetCFileUDFs  Skipping over 189-25 include file=z:\!!!_svn_au3\udf_forum\other_members\winhttp_websocket.au3
 15:33:03 ->PerfDynUDFs ->GetCFileUDFs  Skipping over 190-25 include file=z:\!!!_svn_au3\udf_forum\other_members\wd_capabilities.au3
 15:33:03 ->PerfDynUDFs ->GetCFileUDFs  Skipping over 210-25 include file=z:\!!!_svn_au3\udf_forum\other_members\wd_cdp.au3
 15:33:03 ->PerfDynUDFs ->GetCFileUDFs  Skipping over 211-25 include file=z:\!!!_svn_au3\udf_forum\other_members\wd_helper.au3
 15:33:03 ->PerfDynUDFs ->GetCFileUDFs  Skipping over 212-25 include file=z:\!!!_svn_au3\udf_forum\other_members\wd_core.au3

 

Edited July 3, 2022 by mLipok

[mLipok]

3 minutes ago, mLipok said:

but z:\!!!_svn_au3\udf_forum\mlipok\ADO.au3  was not processed at all.

Then I found:

So the questions is why some files are skipped ?

[Jos]

See my answer I just send in the Email, but for everybody else: The description in the properties describes:

#> Max number of includes files to read from each directory in the list. This doesn't including the standard AutoIt3 includes.
dynamic.max.includes=25
#> Max number total UDFs in the Userlist. This doesn't including the standard AutoIt3 includes.
dynamic.max.funcs=1000

So when you have more Includes that contain UDFs you need to up those properties to whatever you feel need to be your limit.... but there probably is a price to pay each time SciTE is Started and the first au3 file is opened as at that time ALL those files need to be scanned.

[Jos]

8 minutes ago, mLipok said:

So the questions is why some files are skipped ?

Please slow down a little with these rapid posts containing questions and lets go back to the way we agreed a while ago...  One question at a time and wait for the answer before asking the next thing. As stated: The log tells you everything and I have explained in Email and now also here what the issue is:

15:23:32 ->PerfDynUDFs ->GetCFileUDFs  Skipping over 31-25 include file=z:\!!!_svn_au3\udf_forum\mlipok\\ADO.au3

Skipping over 31-25 include file  means => more than the current set 25 limit so skipping it!

Edited July 3, 2022 by Jos

[mLipok]

3 minutes ago, Jos said:

Please slow down a little with these rapid posts containing questions

Please don't offend.

Here:

8 minutes ago, mLipok said:

So the questions is why some files are skipped ?

 

I was just answering your question:

12 minutes ago, mLipok said:

Did you open that debug log and have a look at it...   it gives you a lot of info about what it is doing.....

 

 

Edited July 3, 2022 by mLipok

[Jos]

3 minutes ago, mLipok said:

Please don't offend.

Won't happen easily as you know.  

... but I am interested how the performance will be in your case and what would be good Limits to set for those 2  properties. 

Edited July 3, 2022 by Jos

[mLipok]

31 minutes ago, Jos said:

a price to pay each time SciTE is Started and the first au3 file is opened as at that time ALL those files need to be scanned.

I notice that I have lag, also when I switch to another tab, or when I save current file, or even when I close SciTE.
Was that intentional ?

 

Quote

>16:16:29 ->fn ->PerfDynUDFs > Dynamic UDFs is enabled.
>16:16:29 ->fn ->PerfDynUDFs > Action:save  dynamic.includes:1  AutoItTools.dynamic.includesinit.done:on  props['AutoItTools.lastFileUDFs']: Z:\1\test.au3
!16:16:29 ->PerfDynUDFs ->GetCFileUDFs !===== start GetCFileUDFs saveZ:\1\test.au3 ============================================================================
 

 

Edited July 3, 2022 by mLipok

[Jos]

12 minutes ago, mLipok said:

I notice that I have lag, also when I switch to another tab, or when I save current file, or even when I close SciTE.
Was that intentional ?

The lag is much higher when debugging is switched on, because the debuglog is build with quite a lot of info, but the answer to the rest is in the docs: 

Quote

1. All Funcs in the default autoit/includes directory with format _ABC(), undocumented Funcs will be added ot AutoComplete
2. All Funcs except __*.au3 from all extra *.au3 Files in the openfile= paths that have a #include-once in it, are added to Style 16 (UserUDFs).
3. All Funcs from the current script file are added to style 17 (InFIleUDFs)
4. All Gobal Const Variables defined in any of the previous defined paths that are defined in a *constants*.au3 scriptfile which also includes #include-once.
5. All Funcs except __*.au3 from all *.au3 Files in the current script directory are added to Style 16 (UserUDFs).
6. All Funcs except __*.au3 from all *.au3 Files in the directories defined with Directive:#SciTE4AutoIt3_Include_Path=;Includes\relative\path;d;\includes\absolute\path
   
   Items 1-4 are read from those directories one time during the life of SciTE, but only when the first *.au3 files is opened. (slows it down ~0.5 sec one time to build all required tables)
   Items 5-6 are read each time an *au3 file is Opened or Switched to its Tab.  (slows it down ~0.1 - 0.2 secs per change of tab and at Save time,  to build all required current file tables)

.. so it is deliberate because there is only one CurrentFile at a time, so when you switch, the current file changes so we need to read current files Info and at save time I do also a rebuild of the current file's specs in case the Directive was Added of other Includefiles were added.
 

Edited July 3, 2022 by Jos

[mLipok]

1 minute ago, Jos said:

The lag is much higher when debugging is switched on

I will check it with swtiched off ASAP

[Jos]

Could you add this property in your SciTEUser.properties which I use while developing:

timing.debug=1

This will show the time it takes for the initial load of the Standard stuff and then for each Tab change or Save:

!-> Get_Std_UDFs time: 1.04 Debugging:0-0-0
--> GetCFileUDFs time: 0.11 Debugging:0-0-0  C:\Program Files (x86)\AutoIt3\SciTE\SciTEConfig\SciteConfig.au3
><- PerfDynUDFs  time: 1.16 Debugging:0-0-0  open   C:\Program Files (x86)\AutoIt3\SciTE\SciTEConfig\SciteConfig.au3
--> GetCFileUDFs time: 0.10 Debugging:0-0-0  C:\Program Files (x86)\AutoIt3\SciTE\SciTEConfig\AbbrevMan.au3
><- PerfDynUDFs  time: 0.10 Debugging:0-0-0  open   C:\Program Files (x86)\AutoIt3\SciTE\SciTEConfig\AbbrevMan.au3
--> GetCFileUDFs time: 0.10 Debugging:0-0-0  C:\Program Files (x86)\AutoIt3\SciTE\SciTEConfig\SciteConfig.au3
><- PerfDynUDFs  time: 0.10 Debugging:0-0-0  switch C:\Program Files (x86)\AutoIt3\SciTE\SciTEConfig\SciteConfig.au3
--> GetCFileUDFs time: 0.09 Debugging:0-0-0  C:\Program Files (x86)\AutoIt3\SciTE\SciTEConfig\AbbrevMan.au3
><- PerfDynUDFs  time: 0.09 Debugging:0-0-0  switch C:\Program Files (x86)\AutoIt3\SciTE\SciTEConfig\AbbrevMan.au3
--> GetCFileUDFs time: 0.10 Debugging:0-0-0  C:\Program Files (x86)\AutoIt3\SciTE\SciTEConfig\SciteConfig.au3
><- PerfDynUDFs  time: 0.11 Debugging:0-0-0  switch C:\Program Files (x86)\AutoIt3\SciTE\SciTEConfig\SciteConfig.au3

 

[mLipok]

5 minutes ago, mLipok said:

35 minutes ago, Jos said:

a price to pay each time SciTE is Started and the first au3 file is opened as at that time ALL those files need to be scanned.

I notice that I have lag, also when I switch to another tab, or when I save current file, or even when I close SciTE.
Was that intentional ?

 

The same lag (related to re-checking all the files) occurs when I type:

_WD_CreateSession(

I think that this need to be created once, even on user demand (for example in SciTEConfig), and then LUA on the fly should only use already created files.
Alos I think that It can not create this files all the time.
I can agree that you can have other opinion also beacuse I'm still have debugging switched on (as I said I must test it when debugging is switched off)

I also notice that each time I save file, switch tab, use function, only au3.file.dynamic.calltips.api changes, but not au3.user.dynamic.calltips.api how they differ ?

[mLipok]

2 minutes ago, Jos said:

Could you add this property in your SciTEUser.properties which I use while developing:

timing.debug=1

This will show the time it takes for the initial load of the Standard stuff and then for each Tab change or Save:

sure just now checking

[mLipok]

1 minute ago, mLipok said:

I think that this need to be created once, even on user demand (for example in SciTEConfig), and then LUA on the fly should only use already created files.

I mean:
At least for non standard UDF (USER UDF currently defined in #SciTE4AutoIt3_Include_Path but maybe they sholud be defined by SciteConfig.au3 in some kind of ini file).