(2020-10-27, 19:18)ramis52 Wrote: Hi,

maybe this is the wrong section but i have a question how the scraper and kodi matrix handles the images. I realized that when i use matrix + the new python scrapers, the storage of my fire tv cube is getting smaller and smaller. I used the following settings in the scraper and kodi matrix artwork section

scraper: clearart, clearlogo, poster
matrix: custom, clearart, clearlogo

after scraping law and order svu (20 Seasons), Blue Bloods (10 Seasons) the thumbnail folder was already 700mb big. Did i misss any setting? This doesnt happen on leia.

regards
r

(2020-10-27, 21:23)pkscout Wrote:

(2020-10-27, 19:18)ramis52 Wrote: Hi,

maybe this is the wrong section but i have a question how the scraper and kodi matrix handles the images. I realized that when i use matrix + the new python scrapers, the storage of my fire tv cube is getting smaller and smaller. I used the following settings in the scraper and kodi matrix artwork section

scraper: clearart, clearlogo, poster
matrix: custom, clearart, clearlogo

after scraping law and order svu (20 Seasons), Blue Bloods (10 Seasons) the thumbnail folder was already 700mb big. Did i misss any setting? This doesnt happen on leia.

regards
r

First, you might want to check and make sure you have the most current version of the scraper (v.1.3.0). That version eliminates all the art settings in favor of using the art settings from Matrix core.  That won't affect the rest of the answer I'm about to give, but since you mentioned two sets of settings, I thought I'd mention it.

That image cache folder isn't just for scrapes, it's for all artwork, so the size of the cache is dependent on lots of things including TV shows, movies, skin images, other addons, etc.  And once something is cached, it stays for quite awhile, so unless you started with an absolutely clean install of Matrix (including deleting all your settings), and then scraped ONLY those two shows, it's hard to say that the 700mb is all from those two shows.

Having said all that, here's how the caching works.  The scraper provides Kodi urls to the various art, and then Kodi caches the default ones for each image type at the time of the show scrape. For something like SVU given your settings, that means 1 show poster, 1 show fanart (I'm pretty sure you can't disable fanart without disabling all art, but I'm still learning the new Matrix behavior), 1 show clearart, 1 show clearlogo, and then 20 season posters.  If you open the art selector, Kodi also caches a small thumbnail of every available image for that section and then caches the larger version of whatever you select. So if you are changing art alot trying to find the one you like, I could see how you'd get to 700mb even with a couple shows with lots of seasons, but you'd have to be changing a fair amount of art.

(2020-10-30, 19:45)ramis52 Wrote: thanks for comment and the explanation of the caching

i startet with a clean install on a firetv stick few minutes ago. I used the newest scraper and the newest matrix nightly version. No Skin or other addons installed, besides this scraper. This time i have set it to use fanart.tv download to true, and use the basic Settings in Media for Artwork.

After scraping the 2 mentioned Series i checked the thumbnail folder and it was again that big. Then i checked some images inside and realized that many actor pictures have a size of ~400kb. The same Pictures in Leia have a size of ~16kb.

Maybe there is something wrong how Matrix or the scraper handles the setting "Download Actor thumbnails" in the Media Settings?

(2020-10-30, 21:16)pkscout Wrote:

(2020-10-30, 19:45)ramis52 Wrote: thanks for comment and the explanation of the caching

i startet with a clean install on a firetv stick few minutes ago. I used the newest scraper and the newest matrix nightly version. No Skin or other addons installed, besides this scraper. This time i have set it to use fanart.tv download to true, and use the basic Settings in Media for Artwork.

After scraping the 2 mentioned Series i checked the thumbnail folder and it was again that big. Then i checked some images inside and realized that many actor pictures have a size of ~400kb. The same Pictures in Leia have a size of ~16kb.

Maybe there is something wrong how Matrix or the scraper handles the setting "Download Actor thumbnails" in the Media Settings?

I looked through some of the actor images on TMDb for those two shows, and at least a few of them are very large (like 1200 x 1800).  The new python scraper provides a URL for the original image, so when large images like that are uploaded to TMDb they are then cached that large by Kodi.  I suspect if I just change the scraper to provide a URL for a smaller image that someone will complain about the quality of the images.  I may look at adding a setting to provide "smaller" actor images for people with space constrained devices, but I need to figure out whether to just provide one smaller image option or something like "small, medium, large, original."  I'm guessing the older scraper on Leia provides a URL for a smaller image, which is why you're seeing the difference.  And at 16kb, it is a *really* small image.

(2020-10-31, 22:03)ramis52 Wrote:

(2020-10-30, 21:16)pkscout Wrote:

(2020-10-30, 19:45)ramis52 Wrote: thanks for comment and the explanation of the caching

i startet with a clean install on a firetv stick few minutes ago. I used the newest scraper and the newest matrix nightly version. No Skin or other addons installed, besides this scraper. This time i have set it to use fanart.tv download to true, and use the basic Settings in Media for Artwork.

After scraping the 2 mentioned Series i checked the thumbnail folder and it was again that big. Then i checked some images inside and realized that many actor pictures have a size of ~400kb. The same Pictures in Leia have a size of ~16kb.

Maybe there is something wrong how Matrix or the scraper handles the setting "Download Actor thumbnails" in the Media Settings?

I looked through some of the actor images on TMDb for those two shows, and at least a few of them are very large (like 1200 x 1800).  The new python scraper provides a URL for the original image, so when large images like that are uploaded to TMDb they are then cached that large by Kodi.  I suspect if I just change the scraper to provide a URL for a smaller image that someone will complain about the quality of the images.  I may look at adding a setting to provide "smaller" actor images for people with space constrained devices, but I need to figure out whether to just provide one smaller image option or something like "small, medium, large, original."  I'm guessing the older scraper on Leia provides a URL for a smaller image, which is why you're seeing the difference.  And at 16kb, it is a *really* small image.

Hi,

thanks for considering about an option to add the "small,medium, large". I switched over to path substitution and using my pihole device for the the thumbnails. now i have plenty of space available

another thing which i think should be looked at is the Poster download. Alot of Posters are in russian language after the initial scrape (1000+ series, ~120 have russian posters). I have no problem changing them, but maybe there is an option that the prefered language is the first download, then the english fallback. Another thing with posters is, the scraper adds posters without title by default i think. Correct me if iam wrong. I like posters with show titles alot more. Maybe this can be an option too in Settings of the scraper.

thanks alot for your good work in the tv and movie scraper..

(2020-11-14, 20:58)Hebotsuki Wrote: It's not working for me either. According to Travis from TheMoviedb, some new fileds have been added to the credits in order to a future support for translated person names. That's probably what broke the scraper. I guess the scraper developpers are already aware of the problem.

(2020-11-15, 08:52)MeC!as Wrote: I just tried the "TMDb TV Shows" scraper 1.1.18 and there is nothing be scraped at all.

(2020-11-15, 08:52)MeC!as Wrote: If I go to the files (within kodi) and just try that episode to be scraped to the database a error message pops up saying "No information found!".

(2020-11-15, 09:24)MeC!as Wrote: The Python scraper works, I apparently used an example with umlauts (mysteriöse Mordfälle). This one did not work.