Solved - Why is Kodi searching for directories that don't exist?

Solved Why is Kodi searching for directories that don't exist? - Printable Version

+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: General Support (https://forum.kodi.tv/forumdisplay.php?fid=111)
+---- Forum: OS independent / Other (https://forum.kodi.tv/forumdisplay.php?fid=228)
+---- Thread: Solved Why is Kodi searching for directories that don't exist? (/showthread.php?tid=369467)

Pages: 1 2 3

Why is Kodi searching for directories that don't exist? - mrob - 2022-08-30

When I restart Kodi and then check the log file, I see many "WARNING <general>: Process directory ... does not exist - skipping scan" and "ERROR <general>: GetDirectory - Error getting" for movie directories that don't exist.

What's up with this? Are these file names coming from the database? The directories existed in the past, but I have deleted and/or renamed them.

How can I get rid of these spurious warnings/errors?

Why is Kodi searching for directories that don't exist? - Dangelus - 2022-08-30

To receive meaningful assistance you will need to provide a full debug log.

The instructions are here... debug log (wiki)

If you are using the Basic Method, then ensure the following is applied...
1.Enable debugging in Settings>System Settings>Logging,
2.Restart Kodi
3.Replicate the problem.
4.Upload the log to Kodi Paste Site manually or use the Kodi Logfile Uploader. (wiki) With either method post the link to the log back here.

If you are using the Advanced Method ensure you have correctly created and applied the advancedsettings.xml file (wiki)

In both instances, you should see the word DEBUG throughout the log.

Note: Full logs only. No partial or redacted logs
Do NOT post your logs directly into the forum. Use the Kodi Paste Site. Post the link to your pasted log in the forum

RE: Why is Kodi searching for directories that don't exist? - Klojum - 2022-08-30

(2022-08-30, 15:06)mrob Wrote: What's up with this? Are these file names coming from the database? The directories existed in the past, but I have deleted and/or renamed them.

Likely, yes. You cannot expect Kodi to handle your media collection and go blank when certain subdirectories/folders are suddenly missing because of "outside intervention".

(2022-08-30, 15:06)mrob Wrote: How can I get rid of these spurious warnings/errors?

Try doing a "Clean Video Library" action. Also use Kodi's own delete routines when removing files.

RE: Why is Kodi searching for directories that don't exist? - mrob - 2022-09-01

Okay, I am trying to share a debug log, but Ubuntu pastebinit doesn't recognize paste.kodi.tv, and the Ubuntu site requires a login.

Any suggestions for an exact shell command to upload the log file (i.e., not just 'try curl')...?

Thanks!

P.S. I have tried 'Clean Video Library', but the errors persist. I guess 'Clean Video Library' doesn't actually delete Kodi references to directories that no longer exist?

RE: Why is Kodi searching for directories that don't exist? - Klojum - 2022-09-01

(2022-09-01, 04:33)mrob Wrote: Okay, I am trying to share a debug log, but Ubuntu pastebinit doesn't recognize paste.kodi.tv

Either one separately should be fine. Doesnt paste.kodi.tv work for you, perhaps cut the log into smaller pieces then.

(2022-09-01, 04:33)mrob Wrote: and the Ubuntu site requires a login.

Hmm... Perhaps they changed some things there.

(2022-09-01, 04:33)mrob Wrote: Any suggestions for an exact shell command to upload the log file (i.e., not just 'try curl')...?

On Ubuntu machines, the 'pastebinit' command should work (when installed). But I have no clue what OS you have now.

(2022-09-01, 04:33)mrob Wrote: I guess 'Clean Video Library' doesn't actually delete Kodi references to directories that no longer exist?

The current cleaning routines may not be as effective when certain elements of a video are missing. Perfecting those routines is a work-in-progress.

RE: Why is Kodi searching for directories that don't exist? - mrob - 2022-09-01

As mentioned, I'm on Ubuntu. The site paste.kodi.tv seems to work fine, but pastebinit is hosed and probably dead. Error "Unknown website, please post a bugreport".

I opened a bug report on github for that back in April, and the dev suggested trying a totally different app, which requires an API key, ergo unsuitable for sharing Kodi logs.

With debugging enabled, the Kodi log file is 5375179 bytes, so not feasible to cut/paste to a browser.

Any other ideas? :/

RE: Why is Kodi searching for directories that don't exist? - Klojum - 2022-09-01

In such a long log file, there are bound to be identical lines which can be discarded. Perhaps you can clean up the log to the nitty-gritty, and then upload the smaller log file.

RE: Why is Kodi searching for directories that don't exist? - mrob - 2022-09-01

Uh... I have no idea what 'nitty gritty' means in this context, and we're talking about 2600+ pages in an editor like nano.

So there is really no way to upload this to some paste bin using the command line?

RE: Why is Kodi searching for directories that don't exist? - mrob - 2022-09-02

Here's the log file:

https://www113.zippyshare.com/v/jQLeKt04/file.html

Thanks

RE: Why is Kodi searching for directories that don't exist? - Karellen - 2022-09-02

(2022-08-30, 15:06)mrob Wrote: WARNING <general>: Process directory ... does not exist - skipping scan" and "ERROR <general>: GetDirectory - Error getting" for movie directories that don't exist.

What's up with this? Are these file names coming from the database? The directories existed in the past, but I have deleted and/or renamed them.

That is normal and yes, they are coming from the database.
There are three tables in the database that are not cleaned when you run the Clean Library option:
1. bookmark
2. files
3. path
streamdetails was not cleaned either, but that was changed for v19 as it was causing problems for users that were upgrading lower quality movies with higher quality movies, and they were having problems removing the old codec details from the display. ie, the movie is now 4k, but it still shows as 480
Why are they not cleaned? No idea. Probably some historical reason that no longer applies to the current era and no developer has any interest in changing this behaviour, most likey because it causes no problems.

(2022-08-30, 15:06)mrob Wrote: How can I get rid of these spurious warnings/errors?

Rebuild your library.
If you are confident with SQL databases, you can delete the entries from the database, but I would recommend rebuilding rather than this option.
Having these old entries causes no problems, its just a notification flag in the log.

RE: Why is Kodi searching for directories that don't exist? - mrob - 2022-09-02

Thanks for clarifying. What's the best procedure for rebuilding the database?

Also, is there anything I need to consider before I do that?

EDIT: Also, if there is a way to upload log files from the Ubuntu command line, I would still like to know how to do that.

To come here and ask questions, I need to provide a log file. I didn't do that in the first place, because pastebinit doesn't work any more, and I haven't figured out an alternative. I know something about Linux, but not high level and a lot of cryptic stuff like "curl -s -F "content=<-" https://dpaste.com/api/v2/" is just beyond my understanding.

RE: Why is Kodi searching for directories that don't exist? - Karellen - 2022-09-02

(2022-09-02, 01:12)mrob Wrote: Thanks for clarifying. What's the best procedure for rebuilding the database?

Personally, I would export to Separate nfo files. I would also install Artwork Dump and have it download the original artwork. When you rebuild, it will use the local info and be a lot faster. Just make sure you add the advancedsettings.xml entries to preserve playcount... https://kodi.wiki/view/Import-export_library/Video
But this depends on how old your library is. If it is many years old, the chances are high that a lot of the artwork has been deleted from the scraper sites, so Artwork Dump won't be able to download the artwork, and the artwork links in the nfo files are dead, so you will end up with library entries with missing artwork.
This is the reason I always insist users download the original artwork.

(2022-09-02, 01:12)mrob Wrote: Also, is there anything I need to consider before I do that?

Just make sure you have your folders organised the way you want them. Nows the best time to rearrange.

(2022-09-02, 01:12)mrob Wrote: EDIT: Also, if there is a way to upload log files from the Ubuntu command line, I would still like to know how to do that.

Sorry, no idea. I don't use Linux.

RE: Why is Kodi searching for directories that don't exist? - mrob - 2022-09-02

(2022-09-02, 01:29)Karellen Wrote:
(2022-09-02, 01:12)mrob Wrote: Thanks for clarifying. What's the best procedure for rebuilding the database?
This is the reason I always insist users download the original artwork.

Okay, how can I ensure that this is enabled?

Also, how do I rebuild the database? Here's /home/kodi/.kodi/userdata/Database ...

Quote:drwxr-xr-x 3 kodi kodi 4096 Sep 2 09:12 .
drwxr-xr-x 10 kodi kodi 4096 Nov 23 2021 ..
-rw-r--r-- 1 kodi kodi 1482752 Jul 1 2020 Addons27.db
-rw-r--r-- 1 kodi kodi 1482752 Aug 29 2020 Addons28.db
-rw-r--r-- 1 kodi kodi 1482752 Sep 21 2020 Addons31.db
-rw-r--r-- 1 kodi kodi 1482752 Sep 2 09:12 Addons33.db
drwxr-xr-x 2 kodi kodi 4096 Jul 15 2018 CDDB
-rw-r--r-- 1 kodi kodi 28672 Jul 15 2018 Epg11.db
-rw-r--r-- 1 kodi kodi 28672 Sep 14 2018 Epg12.db
-rw-r--r-- 1 kodi kodi 28672 Apr 11 2020 Epg13.db
-rw-r--r-- 1 kodi kodi 10735616 Dec 6 2019 MyMusic72.db
-rw-r--r-- 1 kodi kodi 10936320 Apr 10 2020 MyMusic73.db
-rw-r--r-- 1 kodi kodi 11423744 May 30 2020 MyMusic75.db
-rw-r--r-- 1 kodi kodi 11423744 Jun 9 2020 MyMusic76.db
-rw-r--r-- 1 kodi kodi 11423744 Jun 24 2020 MyMusic77.db
-rw-r--r-- 1 kodi kodi 12292096 Jun 28 2020 MyMusic78.db
-rw-r--r-- 1 kodi kodi 12886016 Aug 29 2020 MyMusic79.db
-rw-r--r-- 1 kodi kodi 12562432 Sep 20 2020 MyMusic80.db
-rw-r--r-- 1 kodi kodi 12562432 Nov 6 2020 MyMusic81.db
-rw-r--r-- 1 kodi kodi 18690048 Sep 2 09:09 MyMusic82.db
-rw-r--r-- 1 kodi kodi 17469440 May 17 2020 MyVideos116.db
-rw-r--r-- 1 kodi kodi 18345984 Aug 28 2020 MyVideos117.db
-rw-r--r-- 1 kodi kodi 19083264 Sep 16 2020 MyVideos118.db
-rw-r--r-- 1 kodi kodi 32894976 Sep 1 22:21 MyVideos119.db
-rw-r--r-- 1 kodi kodi 40960 Jul 15 2018 TV32.db
-rw-r--r-- 1 kodi kodi 49152 Apr 18 2019 TV33.db
-rw-r--r-- 1 kodi kodi 49152 Apr 25 2019 TV34.db
-rw-r--r-- 1 kodi kodi 49152 Sep 15 2019 TV35.db
-rw-r--r-- 1 kodi kodi 49152 Oct 6 2019 TV36.db
-rw-r--r-- 1 kodi kodi 49152 Oct 15 2020 TV37.db
-rw-r--r-- 1 kodi kodi 49152 Apr 29 2021 TV38.db
-rw-r--r-- 1 kodi kodi 21708800 Sep 1 20:42 Textures13.db
-rw-r--r-- 1 kodi kodi 20480 Jun 15 2021 ViewModes6.db

What should I do with these?

EDIT: Sorry, one more question. Before rebuilding, I want to do any possible clean-up. E.g., I have a movie that won't scrape, but I don't understand why. The log:

Quote:2022-09-01 11:10:59.302 T:2483 DEBUG <CAddonSettings[metadata.themoviedb.org.python]>: trying to load setting definitions from old format...
2022-09-01 11:10:59.302 T:2483 ERROR <general>: GetDirectory - Error getting [...]
2022-09-01 11:10:59.302 T:2483 DEBUG <general>: VideoInfoScanner: Scanning dir [...] as not in the database
2022-09-01 11:10:59.302 T:2483 DEBUG <general>: VideoInfoScanner: No (new) information was found in dir [...]

I replaced the file path and name with [...]. What does this error mean? I've double-checked and the movie exists on TMDB.

RE: Why is Kodi searching for directories that don't exist? - Karellen - 2022-09-02

(2022-09-02, 02:26)mrob Wrote: Okay, how can I ensure that this is enabled?

Install Artwork Dump... https://forum.kodi.tv/showthread.php?tid=360078
Set it to update after each scrape. It will download the original artwork for you and save it locally.

(2022-09-02, 02:26)mrob Wrote: Also, how do I rebuild the database?

It depends. If you are quite happy starting with Kodi as a fresh install, then delete the Kodi data folder (wiki) and rebuild your setup from a new install.
If you have made a lot of modifications and don't want to do that, then delete the MyVideos119.db, textures13.db and the "thumbnails" folder. Restart Kodi and these will be recreated as new. Now setup your library again by adding the sources and scraping.

(2022-09-02, 02:26)mrob Wrote: What should I do with these?

Check the current database versions here... https://kodi.wiki/view/Databases#Database_Versions
Delete all the old databases.

(2022-09-02, 02:26)mrob Wrote: I replaced the file path and name with [...]. What does this error mean? I've double-checked and the movie exists on TMDB.

It means nothing on its own. I need to see the data around it from a log that has debug mode enabled. Provide the full log.

RE: Why is Kodi searching for directories that don't exist? - mrob - 2022-09-02

(2022-09-02, 04:39)Karellen Wrote: It means nothing on its own. I need to see the data around it from a log that has debug mode enabled. Provide the full log.

Well, I'm unable to upload it to a pastebin, but the log file is here: https://www113.zippyshare.com/v/jQLeKt04/file.html