[gooner_47]

I haven't got it set to update at startup, as it'll be running 24/7 so won't actually be restarting.

The timer for the music library is set to 1 hour, as is the video library.

When you enable/disable the music or video update, what is this actually doing? Does it set a flag somewhere from 0 to 1 or something?

[robweber]

Yes, it should write to the settings.xml file in the userdata/addon_data/service.libraryautoupdate directory. It is either a 0/1 or true/false type of situation in the file.

Have you test only checking music and not video at all to see if it runs. When you click "OK" to save the settings you should see a notification information you of the next job that is scheduled to run. If Music is the only one selected you should see "Update Music Library" with a date/time. Might be worth a try. I'll do some more testing with a 1 hour setting and see what the logs say.

[gooner_47]

Interesting... I've enabled notifications (if that's enabled by default, I must have disabled it assuming it will display unnecessary info to my parents who will be the end users).

I disabled video update, saved settings, saw the prompt for a music update in 1m, and it's now worked. The music library is showing the new music I added.

Possible turning on/off notifications has some effect? I'll do some more testing.

[robweber]

The notifications shouldn't do anything, but reading through the source code last night I think you may have stumbled upon an interesting bug. I'll have to figure out a way to recreate this but I think the current logic may play out in certain circumstances to skip a scan and then re-calculate the next run time as though it ran. Basically two scans would have to have the same schedule, and the first scan would have to run long enough that the other didn't get a chance to run before it's timer expired. Like I said, really specific circumstances but that is probably why it wasn't caught until now. I'll look into it further and see what I can find out.

[robweber]

@gooner_47 - I just pushed a change to github. This should delay stacked jobs until previous scans are finished running. This must be an edge case as it hasn't come up before. Hopefully it will fix your issue. Please download from github, reset your addon back to the settings you wanted originally and see if the updates happen. There should be logs for both Music and Video now.

Also note, the version # did not change yet. I'll bump if this works and I push to the repo.

[gooner_47]

Thanks for that. Downloaded the zip from github, uninstalled the old addon, installed from zip file, set both video and music libraries to update with a 1 hour interval, left notifications on, select OK (notification informs me when the video library is happening, but doesn't mention music - is that normal?).

Anyway, checking the log an hour later the music update doesn't appear to have run. I haven't actually added any new media, so I have no way of checking this within the GUI:

22:09:19 T:3040780928 NOTICE: DVDPlayer: finished waiting
22:09:19 T:3040780928 NOTICE: COMXPlayer::CloseFile
22:09:19 T:3040780928 WARNING: CDVDMessageQueue(player):ut MSGQ_NOT_INITIALIZED
22:09:19 T:3040780928 NOTICE: COMXPlayer: waiting for threads to exit
22:09:19 T:3040780928 NOTICE: DVDPlayer: finished waiting
22:09:19 T:2810180672 NOTICE: Thread Jobworker start, auto delete: true
22:09:22 T:2760856640 NOTICE: Thread Background Loader start, auto delete: false
22:09:22 T:2938106944 NOTICE: Thread Jobworker start, auto delete: true
22:09:30 T:2777633856 NOTICE: Previous line repeats 1 times.
22:09:30 T:2777633856 NOTICE: Thread Background Loader start, auto delete: false
22:11:16 T:2810180672 NOTICE: Previous line repeats 1 times.
22:11:16 T:2810180672 NOTICE: Thread Jobworker start, auto delete: true
22:11:18 T:2938106944 NOTICE: Previous line repeats 1 times.
22:11:18 T:2938106944 NOTICE: Thread Background Loader start, auto delete: false
22:11:19 T:2938106944 NOTICE: Thread Jobworker start, auto delete: true
22:11:24 T:2777633856 NOTICE: Thread Background Loader start, auto delete: false
22:27:07 T:2810180672 NOTICE: Thread Jobworker start, auto delete: true
23:00:00 T:2921329728 NOTICE: Previous line repeats 1 times.
23:00:00 T:2921329728 NOTICE: service.libraryautoupdate: Starting network check
23:00:07 T:2921329728 NOTICE: service.libraryautoupdate: Update Video Library
23:00:07 T:2921329728 NOTICE: service.libraryautoupdate: Starting network check
23:00:07 T:2810180672 NOTICE: Thread CVideoInfoScanner start, auto delete: false
23:00:07 T:2810180672 NOTICE: VideoInfoScanner: Starting scan ..
23:00:09 T:2921329728 NOTICE: service.libraryautoupdate: Waiting for other scan to finish
23:00:35 T:2810180672 NOTICE: VideoInfoScanner: Finished scan. Scanning for video info took 00:28
23:00:35 T:2938106944 NOTICE: Thread Jobworker start, auto delete: true
23:00:37 T:2921329728 NOTICE: Previous line repeats 1 times.
23:00:37 T:2921329728 NOTICE: service.libraryautoupdate: update timers
23:01:00 T:2921329728 NOTICE: service.libraryautoupdate: Starting network check
23:01:05 T:2921329728 NOTICE: service.libraryautoupdate: Update Video Library
23:01:05 T:2921329728 NOTICE: service.libraryautoupdate: Starting network check
23:01:05 T:2760856640 NOTICE: Thread CVideoInfoScanner start, auto delete: false
23:01:05 T:2760856640 NOTICE: VideoInfoScanner: Starting scan ..
23:01:07 T:2921329728 NOTICE: service.libraryautoupdate: Waiting for other scan to finish
23:01:40 T:2760856640 NOTICE: VideoInfoScanner: Finished scan. Scanning for video info took 00:35
23:01:40 T:2938106944 NOTICE: Thread Jobworker start, auto delete: true
23:01:42 T:2921329728 NOTICE: Previous line repeats 1 times.
23:01:42 T:2921329728 NOTICE: service.libraryautoupdate: update timers
23:06:06 T:2938106944 NOTICE: Thread XBPyThread start, auto delete: false
23:06:06 T:2938106944 NOTICE: -->Python Interpreter Initialized<--

[robweber]

Thanks for that. Downloaded the zip from github, uninstalled the old addon, installed from zip file, set both video and music libraries to update with a 1 hour interval, left notifications on, select OK (notification informs me when the video library is happening, but doesn't mention music - is that normal?).

Anyway, checking the log an hour later the music update doesn't appear to have run. I haven't actually added any new media, so I have no way of checking this within the GUI:

22:09:19 T:3040780928 NOTICE: DVDPlayer: finished waiting
22:09:19 T:3040780928 NOTICE: COMXPlayer::CloseFile
22:09:19 T:3040780928 WARNING: CDVDMessageQueue(player):ut MSGQ_NOT_INITIALIZED
22:09:19 T:3040780928 NOTICE: COMXPlayer: waiting for threads to exit
22:09:19 T:3040780928 NOTICE: DVDPlayer: finished waiting
22:09:19 T:2810180672 NOTICE: Thread Jobworker start, auto delete: true
22:09:22 T:2760856640 NOTICE: Thread Background Loader start, auto delete: false
22:09:22 T:2938106944 NOTICE: Thread Jobworker start, auto delete: true
22:09:30 T:2777633856 NOTICE: Previous line repeats 1 times.
22:09:30 T:2777633856 NOTICE: Thread Background Loader start, auto delete: false
22:11:16 T:2810180672 NOTICE: Previous line repeats 1 times.
22:11:16 T:2810180672 NOTICE: Thread Jobworker start, auto delete: true
22:11:18 T:2938106944 NOTICE: Previous line repeats 1 times.
22:11:18 T:2938106944 NOTICE: Thread Background Loader start, auto delete: false
22:11:19 T:2938106944 NOTICE: Thread Jobworker start, auto delete: true
22:11:24 T:2777633856 NOTICE: Thread Background Loader start, auto delete: false
22:27:07 T:2810180672 NOTICE: Thread Jobworker start, auto delete: true
23:00:00 T:2921329728 NOTICE: Previous line repeats 1 times.
23:00:00 T:2921329728 NOTICE: service.libraryautoupdate: Starting network check
23:00:07 T:2921329728 NOTICE: service.libraryautoupdate: Update Video Library
23:00:07 T:2921329728 NOTICE: service.libraryautoupdate: Starting network check
23:00:07 T:2810180672 NOTICE: Thread CVideoInfoScanner start, auto delete: false
23:00:07 T:2810180672 NOTICE: VideoInfoScanner: Starting scan ..
23:00:09 T:2921329728 NOTICE: service.libraryautoupdate: Waiting for other scan to finish
23:00:35 T:2810180672 NOTICE: VideoInfoScanner: Finished scan. Scanning for video info took 00:28
23:00:35 T:2938106944 NOTICE: Thread Jobworker start, auto delete: true
23:00:37 T:2921329728 NOTICE: Previous line repeats 1 times.
23:00:37 T:2921329728 NOTICE: service.libraryautoupdate: update timers
23:01:00 T:2921329728 NOTICE: service.libraryautoupdate: Starting network check
23:01:05 T:2921329728 NOTICE: service.libraryautoupdate: Update Video Library
23:01:05 T:2921329728 NOTICE: service.libraryautoupdate: Starting network check
23:01:05 T:2760856640 NOTICE: Thread CVideoInfoScanner start, auto delete: false
23:01:05 T:2760856640 NOTICE: VideoInfoScanner: Starting scan ..
23:01:07 T:2921329728 NOTICE: service.libraryautoupdate: Waiting for other scan to finish
23:01:40 T:2760856640 NOTICE: VideoInfoScanner: Finished scan. Scanning for video info took 00:35
23:01:40 T:2938106944 NOTICE: Thread Jobworker start, auto delete: true
23:01:42 T:2921329728 NOTICE: Previous line repeats 1 times.
23:01:42 T:2921329728 NOTICE: service.libraryautoupdate: update timers
23:06:06 T:2938106944 NOTICE: Thread XBPyThread start, auto delete: false
23:06:06 T:2938106944 NOTICE: -->Python Interpreter Initialized<--

Yes, when you close the settings you get a notification regarding the very next scan that will be run. So if video is first, then you'll see that and not a notifcation for music.

Are you 100% sure the addon is setup correctly? According to your log you are running 2 video scans about a minute apart. So one is running, and then another is scheduled to run right behind it. When I've been testing this I see the same behavior you are seeing - only I see a video and then a music scan.

Please download the newest version from github again. I've added some additional logging so you'll see lines like the following when the timers are created:

Code:

08:19:16 T:6800  NOTICE: service.libraryautoupdate: Creating timer for Video Library
08:19:16 T:6800  NOTICE: service.libraryautoupdate: Creating timer for Music Library

This way you can tell exactly what schedules are being added when the addon starts, or settings are updated.

[gooner_47]

Thanks for that. Downloaded the zip from github, uninstalled the old addon, installed from zip file, set both video and music libraries to update with a 1 hour interval, left notifications on, select OK (notification informs me when the video library is happening, but doesn't mention music - is that normal?).

Anyway, checking the log an hour later the music update doesn't appear to have run. I haven't actually added any new media, so I have no way of checking this within the GUI:

22:09:19 T:3040780928 NOTICE: DVDPlayer: finished waiting
22:09:19 T:3040780928 NOTICE: COMXPlayer::CloseFile
22:09:19 T:3040780928 WARNING: CDVDMessageQueue(player):ut MSGQ_NOT_INITIALIZED
22:09:19 T:3040780928 NOTICE: COMXPlayer: waiting for threads to exit
22:09:19 T:3040780928 NOTICE: DVDPlayer: finished waiting
22:09:19 T:2810180672 NOTICE: Thread Jobworker start, auto delete: true
22:09:22 T:2760856640 NOTICE: Thread Background Loader start, auto delete: false
22:09:22 T:2938106944 NOTICE: Thread Jobworker start, auto delete: true
22:09:30 T:2777633856 NOTICE: Previous line repeats 1 times.
22:09:30 T:2777633856 NOTICE: Thread Background Loader start, auto delete: false
22:11:16 T:2810180672 NOTICE: Previous line repeats 1 times.
22:11:16 T:2810180672 NOTICE: Thread Jobworker start, auto delete: true
22:11:18 T:2938106944 NOTICE: Previous line repeats 1 times.
22:11:18 T:2938106944 NOTICE: Thread Background Loader start, auto delete: false
22:11:19 T:2938106944 NOTICE: Thread Jobworker start, auto delete: true
22:11:24 T:2777633856 NOTICE: Thread Background Loader start, auto delete: false
22:27:07 T:2810180672 NOTICE: Thread Jobworker start, auto delete: true
23:00:00 T:2921329728 NOTICE: Previous line repeats 1 times.
23:00:00 T:2921329728 NOTICE: service.libraryautoupdate: Starting network check
23:00:07 T:2921329728 NOTICE: service.libraryautoupdate: Update Video Library
23:00:07 T:2921329728 NOTICE: service.libraryautoupdate: Starting network check
23:00:07 T:2810180672 NOTICE: Thread CVideoInfoScanner start, auto delete: false
23:00:07 T:2810180672 NOTICE: VideoInfoScanner: Starting scan ..
23:00:09 T:2921329728 NOTICE: service.libraryautoupdate: Waiting for other scan to finish
23:00:35 T:2810180672 NOTICE: VideoInfoScanner: Finished scan. Scanning for video info took 00:28
23:00:35 T:2938106944 NOTICE: Thread Jobworker start, auto delete: true
23:00:37 T:2921329728 NOTICE: Previous line repeats 1 times.
23:00:37 T:2921329728 NOTICE: service.libraryautoupdate: update timers
23:01:00 T:2921329728 NOTICE: service.libraryautoupdate: Starting network check
23:01:05 T:2921329728 NOTICE: service.libraryautoupdate: Update Video Library
23:01:05 T:2921329728 NOTICE: service.libraryautoupdate: Starting network check
23:01:05 T:2760856640 NOTICE: Thread CVideoInfoScanner start, auto delete: false
23:01:05 T:2760856640 NOTICE: VideoInfoScanner: Starting scan ..
23:01:07 T:2921329728 NOTICE: service.libraryautoupdate: Waiting for other scan to finish
23:01:40 T:2760856640 NOTICE: VideoInfoScanner: Finished scan. Scanning for video info took 00:35
23:01:40 T:2938106944 NOTICE: Thread Jobworker start, auto delete: true
23:01:42 T:2921329728 NOTICE: Previous line repeats 1 times.
23:01:42 T:2921329728 NOTICE: service.libraryautoupdate: update timers
23:06:06 T:2938106944 NOTICE: Thread XBPyThread start, auto delete: false
23:06:06 T:2938106944 NOTICE: -->Python Interpreter Initialized<--

Yes, when you close the settings you get a notification regarding the very next scan that will be run. So if video is first, then you'll see that and not a notifcation for music.

Are you 100% sure the addon is setup correctly? According to your log you are running 2 video scans about a minute apart. So one is running, and then another is scheduled to run right behind it. When I've been testing this I see the same behavior you are seeing - only I see a video and then a music scan.

Please download the newest version from github again. I've added some additional logging so you'll see lines like the following when the timers are created:

Code:

08:19:16 T:6800  NOTICE: service.libraryautoupdate: Creating timer for Video Library
08:19:16 T:6800  NOTICE: service.libraryautoupdate: Creating timer for Music Library

This way you can tell exactly what schedules are being added when the addon starts, or settings are updated.

I've now got the new version, but all I get in the log is:

NOTICE: service.libraryautoupdate: update timers

I've tried uninstalling again, disabling the add-on itself, disabling the video/music updates in turn and re-enabling them in turn... I can't figure out how to get it to create the timers from scratch (which is presumably when the logs you mentioned will be displayed rather than updating the existing ones).

Anyway, I'll post back again when I've left it for an hour or two and see what the log turns up re the actual running of the updates.

[robweber]

the timers get recreated every time the computer reboots (or xbmc is opened/closed). they have to as when xbmc starts the addon has no information about what is is supposed to do and has to create these items.

[gooner_47]

That's odd then, restarted the pi and the first thing going in the log is updating the timers, rather than creating.

21:10:34 T:2837562432 NOTICE: Thread CTCPServer start, auto delete: false
21:10:34 T:2820785216 NOTICE: Thread AirPlayServer start, auto delete: false
21:10:34 T:2829173824 NOTICE: Thread Jobworker start, auto delete: true
21:10:34 T:2812310592 NOTICE: Thread AirTunesServer start, auto delete: false
21:10:35 T:3041034880 ERROR: GLES: Vertical Blank Syncing unsupported
21:10:35 T:2794472512 NOTICE: Thread Jobworker start, auto delete: true
21:10:42 T:2896397376 NOTICE: -->Python Interpreter Initialized<--
21:10:42 T:2922632256 NOTICE: Artwork Downloader: ## Service - Run at startup: False
21:10:42 T:2922632256 NOTICE: Artwork Downloader: ## Service - Delayed startup: minutes
21:10:42 T:2922632256 NOTICE: Artwork Downloader: ## Service - Run as service: False
21:10:42 T:2922632256 NOTICE: Artwork Downloader: ## Service - Time: :00
21:10:42 T:2939409472 NOTICE: service.libraryautoupdate: Update Library Service starting...
21:10:43 T:2939409472 NOTICE: service.libraryautoupdate: update timers
21:10:46 T:2947798080 NOTICE: Thread CAlarmClock start, auto delete: false
21:10:47 T:2896397376 NOTICE: StorageServer Module loaded RUN
21:10:47 T:2896397376 NOTICE: StorageClient-2.5.2 Starting server
21:10:47 T:2896397376 NOTICE: StorageServer-2.5.2 Storage Server starting /home/pi/.xbmc/temp/commoncache.db
21:10:48 T:2956186688 NOTICE: services: {'sys.service.avahi': 'true', 'sys.service.remote': 'true', 'sys.service.surveil': 'false', 'sys.service.ftp': 'tru$
21:10:48 T:2956186688 NOTICE: enable service: avahi-daemon

However, both library updates seems to be running now. I have one set to 1 hour intervals, and the other set to 2. I'm confused as to why I'm seeing the same update occur around 1 minute after the prveious one though (in bold below):

00:01:28 T:2939409472 NOTICE: service.libraryautoupdate: update timers
00:02:08 T:2761409600 NOTICE: Thread Jobworker start, auto delete: true
00:02:08 T:2753020992 NOTICE: Thread CFileCache start, auto delete: false
00:04:13 T:2753020992 NOTICE: Previous line repeats 1 times.
00:04:13 T:2753020992 NOTICE: Thread Background Loader start, auto delete: false
00:11:13 T:2761409600 NOTICE: Previous line repeats 1 times.
00:11:13 T:2761409600 NOTICE: Thread XBPyThread start, auto delete: false
00:11:13 T:2761409600 NOTICE: -->Python Interpreter Initialized<--
00:19:43 T:2761409600 NOTICE: Thread Jobworker start, auto delete: true
01:00:00 T:2939409472 NOTICE: Previous line repeats 1 times.
01:00:00 T:2939409472 NOTICE: service.libraryautoupdate: Starting network check
01:00:00 T:2939409472 NOTICE: service.libraryautoupdate: Update Music Library
01:00:00 T:2761409600 NOTICE: Thread CMusicInfoScanner start, auto delete: false
01:00:30 T:2761409600 NOTICE: Previous line repeats 1 times.
01:00:30 T:2761409600 NOTICE: My Music: Scanning for music info using worker thread, operation took 00:30
01:00:31 T:2761409600 NOTICE: Thread Jobworker start, auto delete: true
01:00:31 T:2753020992 NOTICE: Thread Background Loader start, auto delete: false
01:00:32 T:2939409472 NOTICE: Previous line repeats 1 times.
01:00:32 T:2939409472 NOTICE: service.libraryautoupdate: update timers
01:01:00 T:2939409472 NOTICE: service.libraryautoupdate: Starting network check
01:01:00 T:2939409472 NOTICE: service.libraryautoupdate: Update Music Library
01:01:00 T:2753020992 NOTICE: Thread CMusicInfoScanner start, auto delete: false
01:01:29 T:2753020992 NOTICE: Previous line repeats 1 times.
01:01:29 T:2753020992 NOTICE: My Music: Scanning for music info using worker thread, operation took 00:28
01:01:29 T:2753020992 NOTICE: Thread Jobworker start, auto delete: true
01:01:29 T:2956186688 NOTICE: Thread Background Loader start, auto delete: false
01:01:30 T:2939409472 NOTICE: Previous line repeats 1 times.
01:01:30 T:2939409472 NOTICE: service.libraryautoupdate: update timers
01:11:16 T:2753020992 NOTICE: Thread XBPyThread start, auto delete: false
01:11:16 T:2753020992 NOTICE: -->Python Interpreter Initialized<--
01:22:49 T:2753020992 NOTICE: Thread Jobworker start, auto delete: true
02:00:00 T:2939409472 NOTICE: Previous line repeats 1 times.
02:00:00 T:2939409472 NOTICE: service.libraryautoupdate: Starting network check
02:00:00 T:2939409472 NOTICE: service.libraryautoupdate: Update Video Library
02:00:00 T:2939409472 NOTICE: service.libraryautoupdate: Starting network check
02:00:00 T:2753020992 NOTICE: Thread CVideoInfoScanner start, auto delete: false
02:00:00 T:2753020992 NOTICE: VideoInfoScanner: Starting scan ..
02:00:01 T:2939409472 NOTICE: service.libraryautoupdate: Waiting for other scan to finish
02:00:29 T:2753020992 NOTICE: VideoInfoScanner: Finished scan. Scanning for video info took 00:29
02:00:30 T:2753020992 NOTICE: Thread Jobworker start, auto delete: true
02:00:30 T:2956186688 NOTICE: Thread Background Loader start, auto delete: false
02:00:31 T:2939409472 NOTICE: Previous line repeats 1 times.
02:00:31 T:2939409472 NOTICE: service.libraryautoupdate: update timers
02:01:00 T:2939409472 NOTICE: service.libraryautoupdate: Starting network check
02:01:00 T:2939409472 NOTICE: service.libraryautoupdate: Update Video Library
02:01:00 T:2939409472 NOTICE: service.libraryautoupdate: Starting network check
02:01:00 T:2753020992 NOTICE: Thread CVideoInfoScanner start, auto delete: false
02:01:00 T:2753020992 NOTICE: VideoInfoScanner: Starting scan ..
02:01:02 T:2939409472 NOTICE: service.libraryautoupdate: Waiting for other scan to finish
02:01:24 T:2753020992 NOTICE: VideoInfoScanner: Finished scan. Scanning for video info took 00:23
02:01:24 T:2753020992 NOTICE: Thread Jobworker start, auto delete: true
02:01:24 T:2956186688 NOTICE: Thread Background Loader start, auto delete: false
02:01:26 T:2939409472 NOTICE: Previous line repeats 1 times.
02:01:26 T:2939409472 NOTICE: service.libraryautoupdate: update timers

[Ritsuke]

Damn, I should have had this addon many months ago but just found out about it. Thank you!

[robweber]

Gotham Updates:

I finally started updating this addon for Gotham. Nightly build users please check out the development branch for Gotham - https://github.com/robweber/xbmclibrarya...gotham-dev and report back any bugs. I'll push this to the Gotham repo and replace the Frodo version that is there soon.

Major change in this version is the removal of the "verify sources" option under the Clean Library settings. This was removed since Gotham will now perform this check on its own as part of the clean library process. If this behavior isn't working correctly I encourage you to submit a trac ticket so it can be fixed as part of the XBMC core before Gotham is released.

[rokall]

I totally agree with the previous message awesome addon can we plz have more slots I have 16tb on 4 drives on a freenas server for videos and music plus two sharecentres each with 2 drives i find Im out of available slots to get it all in the library.

Cheers

[robweber]

Do you mean more slots for specific library path updates? I'm guessing you don't want to do full library updates to scan all those paths, is that the issue?

[HellDiver]

I've read most of this thread, but it's long and difficult to follow.

Currently, I have 2 XBMC 12.3 clients (Windows), and a shared library running on MySQL on an Asustor NAS. The video files are also stored on the NAS and shared via SMB.

So, I'd like to run another machine (a low powered Celeron NUC) to automatically update the library, so the clients don't have to scan and scrape every time they're started.

If I run another XBMC running this plugin, and it updated the library hourly, could I turn off the library scan on the clients? Will they pick up the changes in the library at boot without having to scan themselves?