[CrystalP]

Looks like the crash is related to an addon and there is no need for symbol files.

So as we did before, please try with a vanilla portable installation. It means no customizations of any kind after the install (settings, addons, skin, ...), except for the addition of the source to launch the library scan.

[kittmaster]

Looks like the crash is related to an addon and there is no need for symbol files.

So as we did before, please try with a vanilla portable installation. It means no customizations of any kind after the install (settings, addons, skin, ...), except for the addition of the source to launch the library scan.

I will revert it, can you tell me what addon? I should have actually read the info, but didn't, not sure if it made sense or not... to me anyway.

Will report back.

[kittmaster]

First note: I am on Estuary skin, the slow down into the alphabet is still present doesn't seem to be skin dependent. 

I wouldn't anticipate a crash if you mention it may be my skin addon related, but if I can figure out which one, maybe I can rectify what is wrong so it will be a problem going forward.

[CrystalP]

Cannot tell which with a stack trace, but that will come after finding out if there is still a problem with zero addons (except for the few preinstalled ones of course...)

[kittmaster]

Cannot tell which with a stack trace, but that will come after finding out if there is still a problem with zero addons (except for the few preinstalled ones of course...)

It finished and behaves as expected, no crashes. 

Is there a buffer/flow controller that can be tweaked? It is very "odd" that not kidding, starts off like lightning.... (using silly letters) A-C, and then starts to get progressively slower saaaay around letter P.... 

That of course is anecdotal on timeframe, but it is "visually" noticeable from watching it (the names of the movies scanning by)... task manager doesn't show anything odd... I don't see any pegging or anything like a gotcha... and I know I may be shooting myself in the foot for saying it.. but even if nothing else was done, it is running "ok"... if a tweak could be found or implemented... even better... but SDD doesn't have this issue..... at all...... I still "say" it looks like the I/O buffer is just maxed out the further in it gets... maybe I'm wrong, that is just from the outside looking in.

[CrystalP]

You will see the slowdown in the log (time between successive "VideoInfoScanner: Scanning dir XXXXXX" or maybe time elapsed between "VideoInfoScanner: Scanning dir XXXXXX" and "VideoInfoScanner: Finished adding information from dir XXXXXX" pairs)
You could quantify the effect and compare HDD vs SDD slowdown.
SSD may remain fast enough that it's not visually noticeable, but it doesn't mean that there is no slow down.

The effect would likely be magnified on low power boxes (Android, pi, ...)

[kittmaster]

You will see the slowdown in the log (time between successive "VideoInfoScanner: Scanning dir XXXXXX" or maybe time elapsed between "VideoInfoScanner: Scanning dir XXXXXX" and "VideoInfoScanner: Finished adding information from dir XXXXXX" pairs)
You could quantify the effect and compare HDD vs SDD slowdown.
SSD may remain fast enough that it's not visually noticeable, but it doesn't mean that there is no slow down.

The effect would likely be magnified on low power boxes (Android, pi, ...)

So turn on the debug logger and then run it again yes? I'll start that, LMK if I missed a step.

[kittmaster]

So I ran it on the HDD just as a basic test for a simple feedback until I can do a full SSD etc etc.

Here is the sample except:

Start: Batteries not included
22:43:52.210
22:43:52.809

2024-11-01 22:43:52.210 T:16972   debug <general>: VideoInfoScanner: Scanning dir 'X:\Movies\_batteries not included (1987)\' as not in the database
2024-11-01 22:43:52.211 T:16972   debug <general>: CUtil::ExcludeFileOrFolder: File 'X:\Movies\_batteries not included (1987)\_batteries not included (1987)-trailer.mp4' excluded. (Matches exclude rule RegExp: '-trailer')
2024-11-01 22:43:52.218 T:16972   debug <general>: VideoInfoScanner: Found matching full NFO file: X:\Movies\_batteries not included (1987)\_batteries not included (1987).nfo
2024-11-01 22:43:52.554 T:16972   debug <general>: VideoInfoScanner: Adding new item to movies:X:\Movies\_batteries not included (1987)\_batteries not included (1987).mp4
2024-11-01 22:43:52.564 T:10244   debug <general>: Caching image 'X:\Movies\A View to a Kill (1985)\.actors\Christopher_Walken.jpg' to '8/8f6f78d7.jpg':
2024-11-01 22:43:52.577 T:10244   debug <general>: cached image 'special://masterprofile/Thumbnails/8/8f6f78d7.jpg' size 480x720
2024-11-01 22:43:52.710 T:10244   debug <general>: Caching image 'X:\Movies\A View to a Kill (1985)\.actors\Tanya_Roberts.jpg' to '0/00686f9e.jpg':
2024-11-01 22:43:52.724 T:10244   debug <general>: cached image 'special://masterprofile/Thumbnails/0/00686f9e.jpg' size 480x720
2024-11-01 22:43:52.800 T:16972   debug <general>: VideoInfoScanner: Finished adding information from dir X:\Movies\_batteries not included (1987)\
2024-11-01 22:43:52.809 T:16972   debug <general>: VideoInfoScanner: Skipping dir 'X:\Movies\_batteries not included (1987)\extrafanart\' due to no change

End: Zombieland
23:10:09.935
23:10:11.515

2024-11-01 23:10:09.935 T:16972   debug <general>: VideoInfoScanner: Scanning dir 'X:\Movies\Zombieland (2009)\' as not in the database
2024-11-01 23:10:09.937 T:16972   debug <general>: CUtil::ExcludeFileOrFolder: File 'X:\Movies\Zombieland (2009)\Zombieland (2009)-trailer.mp4' excluded. (Matches exclude rule RegExp: '-trailer')
2024-11-01 23:10:09.954 T:16972   debug <general>: VideoInfoScanner: Found matching full NFO file: X:\Movies\Zombieland (2009)\Zombieland (2009).nfo
2024-11-01 23:10:10.025 T:10244   debug <general>: Caching image 'X:\Movies\Django Unchained (2012)\.actors\Ato_Essandoh.jpg' to 'b/bec69da4.jpg':
2024-11-01 23:10:10.041 T:10244   debug <general>: cached image 'special://masterprofile/Thumbnails/b/bec69da4.jpg' size 480x720
2024-11-01 23:10:10.166 T:10244   debug <general>: Caching image 'X:\Movies\Django Unchained (2012)\.actors\Sammi_Rotibi.jpg' to '8/8de8ec01.jpg':
2024-11-01 23:10:10.182 T:10244   debug <general>: cached image 'special://masterprofile/Thumbnails/8/8de8ec01.jpg' size 480x720
2024-11-01 23:10:10.220 T:16972   debug <general>: VideoInfoScanner: Adding new item to movies:X:\Movies\Zombieland (2009)\Zombieland (2009).mp4
2024-11-01 23:10:10.413 T:10244   debug <general>: Caching image 'X:\Movies\Django Unchained (2012)\.actors\Clay_Donahue_Fontenot.jpg' to 'f/f0611530.jpg':
2024-11-01 23:10:10.413 T:10244   debug <general>: cached image 'special://masterprofile/Thumbnails/f/f0611530.jpg' size 300x450
2024-11-01 23:10:10.528 T:10244   debug <general>: Caching image 'X:\Movies\Django Unchained (2012)\.actors\Don_Johnson.jpg' to '7/71c73fc2.jpg':
2024-11-01 23:10:10.543 T:10244   debug <general>: cached image 'special://masterprofile/Thumbnails/7/71c73fc2.jpg' size 480x720
2024-11-01 23:10:11.174 T:10244   debug <general>: Caching image 'X:\Movies\Django Unchained (2012)\.actors\Franco_Nero.jpg' to '4/436fd9e8.jpg':
2024-11-01 23:10:11.193 T:10244   debug <general>: cached image 'special://masterprofile/Thumbnails/4/436fd9e8.jpg' size 480x720
2024-11-01 23:10:11.386 T:10244   debug <general>: Caching image 'X:\Movies\Django Unchained (2012)\.actors\James_Russo.jpg' to '3/3a4630ed.jpg':
2024-11-01 23:10:11.400 T:10244   debug <general>: cached image 'special://masterprofile/Thumbnails/3/3a4630ed.jpg' size 480x720
2024-11-01 23:10:11.442 T:16972   debug <general>: VideoInfoScanner: Finished adding information from dir X:\Movies\Zombieland (2009)\
2024-11-01 23:10:11.453 T:16972   debug <general>: VideoInfoScanner: Skipping dir 'X:\Movies\Zombieland (2009)\extrafanart\' due to no change
2024-11-01 23:10:11.462 T:16972   debug <general>: VideoInfoScanner: Skipping dir 'X:\Movies\Zombieland (2009)\extrathumbs\' due to no change

[kittmaster]

@CrystalP

Just downloaded: KodiSetup-20241110-2507aee4-Omega-x64

Installed on my office machine, on the HDD spinner, same problem has risen again.

There is one Omega nightly between KodiSetup-20241102-ebf7b562-Omega-x64 it which I haven't tried yet, but this version (2 ago), works exactly fine, this current output is acting like the old behavior!

I will try that one to verify, but there is something really wrong again with KodiSetup-20241110-2507aee4-Omega-x64.

Can you please review what is wrong? I would guess someone committed their old stuff with your new fixes and overwrote and built the garbage back in... would be my guess.

Thank you.
Chris

[Neo1973]

Installed on my office machine, on the HDD spinner, same problem has risen again.

That is very unlikely. There have only been 4 changes to the Omega branch:

1. An Android only fix
   
2. Fixing a buffer overflow when reading to long ENV vars
   
3. An Android build fix
   
4. An OpenGL fix (not build on Windows)
   

So only one change that even would affect Windows. An that change is performance neutral. And in totally unrelated code.

[kittmaster]

What can I tell ya? I had the latest version installed, saw the issue, unzipped the version I reference, overwrote all the files in the folder it lives in for test on the HDD, and full operation was restored that CrystalP fixed/addressed.

While I hear what you're saying, and agree with the feedback on the changes, doesn't change the fact that this version is doing EXACTLY what this entire thread is about.... again. I verified it several times before I posted it here as I'm not going to create work for folks on a whim.

I can record a live video if that will make it more concise, but since I've lived this for the last 6 months, I know exactly what I'm looking for... and it is back with the latest nightly i.e. HDD is maxed at 100%. Maybe the build KodiSetup-20241110-45c02915-Omega-x64.exe introduced it back and it is carrying on from there, I don't know, I will test that one out shortly to see if it shows up there as well.

The difference isn't subtle, it really is a degradation of the system when it is happening.

Regards,
Chris

[CrystalP]

Surprising but confirmed.
KodiSetup-20241110-45c02915-Omega-x64.exe (dated Nov 10) is fine
 KodiSetup-20241110-2507aee4-Omega-x64.exe (dated Nov 18) is not.
The only difference between the 2 revisions is the GL patch, which is not even included in the Windows version so that doesn't make sense.

A locally built version of Omega/2507aee4 is fine.

Looks like the build bot get confused somehow and pulled the wrong revision?

[kittmaster]

Surprising but confirmed.
KodiSetup-20241110-45c02915-Omega-x64.exe (dated Nov 10) is fine
 KodiSetup-20241110-2507aee4-Omega-x64.exe (dated Nov 18) is not.
The only difference between the 2 revisions is the GL patch, which is not even included in the Windows version so that doesn't make sense.

A locally built version of Omega/2507aee4 is fine.

Looks like the build bot get confused somehow and pulled the wrong revision?

I'm glad you confirmed it, I hate telling a team member that they are wrong, but this is one mountain I'm willing to die on to get this issue resolved due to its edge case implications to me specifically but also to all users even when they are not aware of what and why.

I'll pass back a comment which I mentioned to you before, I asked about how to guard against this going forward and it seems to have popped up again, it seems that it might need some additional thought on how to watch for it and ensure it doesn't occur in the future builds???

Thank you for taking a look at this crazy issue again, hopefully you can sort out what is going on. If you need to me to test something, please advise and I'll happily give it a go.

Much appreciated.

Best,
Chris