+- Kodi Community Forum (https://forum.kodi.tv)
+-- Forum: Support (https://forum.kodi.tv/forumdisplay.php?fid=33)
+--- Forum: General Support (https://forum.kodi.tv/forumdisplay.php?fid=111)
+---- Forum: OS independent / Other (https://forum.kodi.tv/forumdisplay.php?fid=228)
+---- Thread: MySQL Error for movie "Halloween (1978)" (/showthread.php?tid=358473)
MySQL Error for movie "Halloween (1978)" - fishbulb - 2020-11-17
Guessing this is because there are 65 movie posters? https://www.themoviedb.org/movie/948-halloween/images/posters?language=en-US
LibreELEC (official): 9.2.4
Database: MariaDB (FreeBSD) 10.5.8
Quote:2020-11-16 19:45:45.273 T:140618160400128 ERROR: SQL: [MyVideos116] Undefined MySQL error: Code (1406)
Query: UPDATE movie SET c00='Halloween',c01='On a black and unholy Halloween night years ago, little Michael Myers brutally slaughtered his sister in cold bold. But for the last fifteen years, town residents have rested easy, knowing that he was safely locked away in a mental hospital – until tonight. Tonight, Michael returns to the same quiet neighbourhood to relive his grisly murder again…and again…and again. For this is a night of evil. Tonight is Halloween!',c02='',c03='The night he came home!',c05='1779',c06='Debra Hill / John Carpenter',c08='<thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/7BAoBjLCdS5dQQDqRDBbllNpyqR.jpg\">https://image.tmdb.org/t/p/original/7BAoBjLCdS5dQQDqRDBbllNpyqR.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/2uqHV6YcD9jEL2WuJYjXiiuRDqd.jpg\">https://image.tmdb.org/t/p/original/2uqHV6YcD9jEL2WuJYjXiiuRDqd.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/cLBt7Suqm6fNwhrJZAtnwENDMLo.jpg\">https://image.tmdb.org/t/p/original/cLBt7Suqm6fNwhrJZAtnwENDMLo.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/9rH2XjftQHm4OeiOFCYQAcxjF2r.jpg\">https://image.tmdb.org/t/p/original/9rH2XjftQHm4OeiOFCYQAcxjF2r.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/1vRkDRigitF6igyfQvjb2i3GG95.jpg\">https://image.tmdb.org/t/p/original/1vRkDRigitF6igyfQvjb2i3GG95.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/rCnjVKC7K5uBWtS7BSjcnLBLwS.jpg\">https://image.tmdb.org/t/p/original/rCnjVKC7K5uBWtS7BSjcnLBLwS.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/wyXaCnXYGB5fvb8rdZIlhr847bE.jpg\">https://image.tmdb.org/t/p/original/wyXaCnXYGB5fvb8rdZIlhr847bE.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/eyfZegVKa8golMdNPeZbctXveQ9.jpg\">https://image.tmdb.org/t/p/original/eyfZegVKa8golMdNPeZbctXveQ9.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/5Xyr3hNax5IVmCgFb5seXdzpZnr.jpg\">https://image.tmdb.org/t/p/original/5Xyr3hNax5IVmCgFb5seXdzpZnr.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/akUATrscWfijUlBpdyOYhHryQE5.jpg\">https://image.tmdb.org/t/p/original/akUATrscWfijUlBpdyOYhHryQE5.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/rWNU5cPg0oeaXtPBoZ5wFPfNHJ6.jpg\">https://image.tmdb.org/t/p/original/rWNU5cPg0oeaXtPBoZ5wFPfNHJ6.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/beCi8tfUDcvas4QAzv2hBjheNVn.jpg\">https://image.tmdb.org/t/p/original/beCi8tfUDcvas4QAzv2hBjheNVn.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/sDNv9fzlk5EyN8dUaM1xSDm1UcF.jpg\">https://image.tmdb.org/t/p/original/sDNv9fzlk5EyN8dUaM1xSDm1UcF.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/ypmNAVYIkrNSmaPyj1WPWt1C90k.jpg\">https://image.tmdb.org/t/p/original/ypmNAVYIkrNSmaPyj1WPWt1C90k.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/ezLeuHXAXpZ08JHgnZHapiFWdJO.jpg\">https://image.tmdb.org/t/p/original/ezLeuHXAXpZ08JHgnZHapiFWdJO.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/mmNlxzYovQ9Oa4Bd2ZzIzp7dikt.jpg\">https://image.tmdb.org/t/p/original/mmNlxzYovQ9Oa4Bd2ZzIzp7dikt.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/kCLTEMwxqUmq3SZzc6RW3AHbCpf.jpg\">https://image.tmdb.org/t/p/original/kCLTEMwxqUmq3SZzc6RW3AHbCpf.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/39K37T4DXR63EwaCgLV8xWb9QlE.jpg\">https://image.tmdb.org/t/p/original/39K37T4DXR63EwaCgLV8xWb9QlE.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/68z17oANEG7t2OextIy0l7nfgVt.jpg\">https://image.tmdb.org/t/p/original/68z17oANEG7t2OextIy0l7nfgVt.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/7BD44Vmpi7WsMZZAdZP0U5ao3vI.jpg\">https://image.tmdb.org/t/p/original/7BD44Vmpi7WsMZZAdZP0U5ao3vI.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/eyFBWepNXgCe69gO3EhQ6UX5UbB.jpg\">https://image.tmdb.org/t/p/original/eyFBWepNXgCe69gO3EhQ6UX5UbB.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/7csAdmybfz0FpTkVCioWQWpAsDC.jpg\">https://image.tmdb.org/t/p/original/7csAdmybfz0FpTkVCioWQWpAsDC.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/4DlCXdCix04yOREAsHUEV98BAS4.jpg\">https://image.tmdb.org/t/p/original/4DlCXdCix04yOREAsHUEV98BAS4.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/gKzst2OxoxHoKEWyi34qUfY9jka.jpg\">https://image.tmdb.org/t/p/original/gKzst2OxoxHoKEWyi34qUfY9jka.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/mOCclhQLP1AEWPxgt3zMPzOYkZm.jpg\">https://image.tmdb.org/t/p/original/mOCclhQLP1AEWPxgt3zMPzOYkZm.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/xsnuGsQxhYABrCvMeNY52UQhwuI.jpg\">https://image.tmdb.org/t/p/original/xsnuGsQxhYABrCvMeNY52UQhwuI.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/xthUZ9cIDkcCR2ia8PcA3RhfntZ.jpg\">https://image.tmdb.org/t/p/original/xthUZ9cIDkcCR2ia8PcA3RhfntZ.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/2jeOoWdJHFHuBGlQ4zCNY6s62X0.jpg\">https://image.tmdb.org/t/p/original/2jeOoWdJHFHuBGlQ4zCNY6s62X0.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/qcva0dyKtzu6kxNi4Fa2u9l1l8L.jpg\">https://image.tmdb.org/t/p/original/qcva0dyKtzu6kxNi4Fa2u9l1l8L.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/lLOuL7CbqF5x6o4SnUGVZ3arkaJ.jpg\">https://image.tmdb.org/t/p/original/lLOuL7CbqF5x6o4SnUGVZ3arkaJ.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/pesDNbxTG7NE3KrtXtEK4lAhqkg.jpg\">https://image.tmdb.org/t/p/original/pesDNbxTG7NE3KrtXtEK4lAhqkg.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/2alzm93syz6cLesC0EtvAHxnvLZ.jpg\">https://image.tmdb.org/t/p/original/2alzm93syz6cLesC0EtvAHxnvLZ.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/doSJx75U7HTCBhKAUnVd14Z7gfA.jpg\">https://image.tmdb.org/t/p/original/doSJx75U7HTCBhKAUnVd14Z7gfA.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/rasOw28YdzdPywznFEaaUdoCLkO.jpg\">https://image.tmdb.org/t/p/original/rasOw28YdzdPywznFEaaUdoCLkO.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/yxVa9Uo6cguW5NuxcbPCQnPaOhC.jpg\">https://image.tmdb.org/t/p/original/yxVa9Uo6cguW5NuxcbPCQnPaOhC.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/2J71N4rydw5KnXP059XgGcuhyCv.jpg\">https://image.tmdb.org/t/p/original/2J71N4rydw5KnXP059XgGcuhyCv.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/uCeHDn4BM6WerSmWi4Z8dyhmaDX.jpg\">https://image.tmdb.org/t/p/original/uCeHDn4BM6WerSmWi4Z8dyhmaDX.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/gqBFRDmff5s5RncygsXF0D4d4ha.jpg\">https://image.tmdb.org/t/p/original/gqBFRDmff5s5RncygsXF0D4d4ha.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/mhSpCA6Y19nQFVZl7s4O4V1ppVY.jpg\">https://image.tmdb.org/t/p/original/mhSpCA6Y19nQFVZl7s4O4V1ppVY.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/l1DIoJjdnuNtANf0HNJvotXm5sD.jpg\">https://image.tmdb.org/t/p/original/l1DIoJjdnuNtANf0HNJvotXm5sD.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/iXO61jbAS8qNWjBIHNJzuaiPJlG.jpg\">https://image.tmdb.org/t/p/original/iXO61jbAS8qNWjBIHNJzuaiPJlG.jpg</thumb><thumb aspect=\"set.poster\" preview=\"https://image.tmdb.org/t/p/w500/g492BzKolXGlFFx8elAxoa38Slk.jpg\">https://image.tmdb.org/t/p/original/g492BzKolXGlFFx8elAxoa38Slk.jpg</thumb><thumb aspect=\"set.pos
2020-11-16 19:45:45.317 T:140618160400128 ERROR: SetDetailsForMovie (smb://192.168.2.230/media/Movies/Halloween (1978).mkv) failed
2020-11-16 19:45:45.347 T:140618160400128 WARNING: VideoInfoScanner: Error 1 occurred while retrievinginformation for smb://192.168.2.230/media/Movies/Halloween (1978).mkv.
2020-11-16 19:45:48.808 T:140618160400128 NOTICE: VideoInfoScanner: Finished scan. Scanning for video info took 00:12
Removing the movie prevents the error from occurring. Using default tmdb.
RE: MySQL Error for movie "Halloween (1978)" - fishbulb - 2020-11-17
Forgot to mention Kodi v18.8
RE: MySQL Error for movie "Halloween (1978)" - El_Guero - 2020-11-17
You have a data entry that is too long for the column (field) it is going into.
I am not familiar with MySql, but I believe your ‘description field’ is the offending data.
Wayne
RE: MySQL Error for movie "Halloween (1978)" - pkscout - 2020-11-17
It's probably the posters, but please don't post log snippets in the forum. Get a full debug log, upload that somewhere (like pastebin), and then provide the URL. If you switch to the Python version of the TMDb movie scraper, that one limits the number of posters to get around that. And on the TV side, the Python version of the scraper (TMDb TV Shows), which I maintain, also has some logic to limit the number of artwork entries that are added.
The alternative is to change the database so that the field in question accepts more text. There's a forum post around here somewhere on this, I just haven't had a chance to look for it.
RE: MySQL Error for movie "Halloween (1978)" - Karellen - 2020-11-17
Check your log for this error MySQL error: Code (1406)
If you find it, the explanation and fix are here... https://github.com/xbmc/xbmc/issues/15768
RE: MySQL Error for movie "Halloween (1978)" - fishbulb - 2020-11-17
(2020-11-17, 04:12)Karellen Wrote: Check your log for this error MySQL error: Code (1406)Ok, thanks. I fixed it by updating field Movie.c08 to mediumtext.
If you find it, the explanation and fix are here... https://github.com/xbmc/xbmc/issues/15768
And I installed the movie database python addon.
And another option I found, if you disable 'strict' for sql mode in mysql or mariadb (in my.conf), data that is longer than the field is simply truncated instead of throwing a 1406 error: https://stackoverflow.com/questions/15949038/error-code-1406-data-too-long-for-column-mysql
I think, ideally, a mysql error like this should be ignored instead of stopping the scraping. I believe you could just make the statement "UPDATE IGNORE movie SET c00=..." and it wouldn't break the process.
RE: MySQL Error for movie "Halloween (1978)" - Klojum - 2020-11-17
(2020-11-17, 03:13)fishbulb Wrote: Forgot to mention Kodi v18.8
Hence why we prefer the full log file all the time.
(2020-11-17, 04:33)fishbulb Wrote: I think, ideally, a mysql error like this should be ignored instead of stopping the scraping.
That's not always possible. Ever tried stopping when you were running down a steep hill?
A relational database needs all data, otherwise you get database corruption. Which basically results in having to repopulate the database entirely.
Also, don't paste that full pages of log/text directly into our forum. Use a pastebin website instead, as suggested in bold red letters above the forum's Post button.
RE: MySQL Error for movie "Halloween (1978)" - fishbulb - 2020-11-17
(2020-11-17, 11:20)Klojum Wrote:The way the kodi handled the sql error was a bit odd... It just populated half the videos with no indication of a problem, then there seemed to be some stability issues with some screens not responding (perhaps unrelated, but they seemed to go away after it was fixed).(2020-11-17, 03:13)fishbulb Wrote: Forgot to mention Kodi v18.8
Hence why we prefer the full log file all the time.
(2020-11-17, 04:33)fishbulb Wrote: I think, ideally, a mysql error like this should be ignored instead of stopping the scraping.
That's not always possible. Ever tried stopping when you were running down a steep hill?
A relational database needs all data, otherwise you get database corruption. Which basically results in having to repopulate the database entirely.
Also, don't paste that full pages of log/text directly into our forum. Use a pastebin website instead, as suggested in bold red letters above the forum's Post button.
Unless kodi can handle these sql errors cleanly, it may be best to reduce them by ignoring them when possible. Or in the documentation, recommend configuring the database by forcing text fields to be truncated to match the maximum size. Or add a function to ensure fields do not exceed 65,535 characters prior to inserting or updating.
The error will persist perpetually on every reboot if you have 'update library on startup' enabled. And it is repeatable with Halloween (1978) from tmdb on a mysql database using the built-in movie scraper.