Mailing List Archive

metadata
Hi

Browsing the forum I found

<paraphrase>
Some videos have meta data and artwork but some do not
</paraphrase>

This exactly describes what I am trying to figure.

1) does metadata lookup and populate work properly for anyone

2) does metadata lookup and populate NOT work properly for anyone

On my main backend the movie grabber does work but the TV grabber does not:

[sandypit] /home/jam [603]% /usr/local/share/mythtv/metadata/Television/ttvdb.py -t

The modules tvdb_api.py (v2.0 or greater).
They should have been installed along with the MythTV python bindings.
Error:(No module named requests_cache)

(Which rather highlights the disadvantages of using say python it’s easy and works well if your machine is the same as the dev machine else you are on your own like here (SuSE Leap 42.1))

Because of above error mythmetadatalookup Aborts yet this machine has SOME artwork (!?)

I setup another front/backend test machine using ubuntu 18.04 and installing mythbuntu.
Every command works, I even get a sensible reply when running the grabber by hand.
But there is no artwork even after mythmetadatalookup —refresh-all-artwork

I carefully followed https://www.mythtv.org/wiki/Enhancing_Recordings_with_Metadata_Lookup

3) Am I doing something wrong, or is this whole area rather iffy

James
_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org
Re: metadata [ In reply to ]
Hi,

Can you please specify the mythtv version you are using? Is your movie metadata lookup working properly?


Secondly, go to your myth backend and configure the storage directories for artwork and banners.


There is some clean up that mythtv does when using the tvdb api and searches for result using the filename.

So let’s say you have a series called big bang theory, python ttvdb.py -M “Big bang theory”


This will give results in XML format, so to check if it’s working, go to /usr/share/mythtv/metadata/Television/ and then run the above command, check if its working, if not then check , /usr/share/mythtv/metadata/Movies/ and run python tmdb3.py “ Intern”, if that works then fine, then there might be some problem with the name of the recordings that are being saved.


Lastly I had some issues regarding cache, which was not working properly, so what I did was went to /home/mythtv and created a folder called cache.


I also gave 777 permission to /usr/local/share/mythtv/ and /home/kalim/.mythtv as well.

(Be careful with the permissions, sudo chmod -R 777 /usr/local/share/mythtv)






Sent from Windows Mail





From: jam@tigger.ws
Sent: ?Sunday?, ?December? ?9?, ?2018 ?11?:?32? ?AM
To: mythtv-users@mythtv.org





Hi

Browsing the forum I found

<paraphrase>
Some videos have meta data and artwork but some do not
</paraphrase>

This exactly describes what I am trying to figure.

1) does metadata lookup and populate work properly for anyone

2) does metadata lookup and populate NOT work properly for anyone

On my main backend the movie grabber does work but the TV grabber does not:

[sandypit] /home/jam [603]% /usr/local/share/mythtv/metadata/Television/ttvdb.py -t

The modules tvdb_api.py (v2.0 or greater).
They should have been installed along with the MythTV python bindings.
Error:(No module named requests_cache)

(Which rather highlights the disadvantages of using say python it’s easy and works well if your machine is the same as the dev machine else you are on your own like here (SuSE Leap 42.1))

Because of above error mythmetadatalookup Aborts yet this machine has SOME artwork (!?)

I setup another front/backend test machine using ubuntu 18.04 and installing mythbuntu.
Every command works, I even get a sensible reply when running the grabber by hand.
But there is no artwork even after mythmetadatalookup —refresh-all-artwork

I carefully followed https://www.mythtv.org/wiki/Enhancing_Recordings_with_Metadata_Lookup

3) Am I doing something wrong, or is this whole area rather iffy

James
_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org
Re: metadata [ In reply to ]
On Sun, 9 Dec 2018 at 06:03, jam@tigger.ws <jam@tigger.ws> wrote:


> 1) does metadata lookup and populate work properly for anyone
>


It's working fine for me (29.1-fixes on Ubuntu 16.04)
Are you seeing any entries like this in your mythbackend.log file? .....

As a TV recording ends:

Dec 8 22:00:05 tvbox mythbackend: mythbackend[31507]: I Metadata_4259
jobqueue.cpp:2157 (DoMetadataLookupThread) JobQueue: Metadata Lookup
Starting for Casualty recorded from channel 7941 at 2018-12-08T21:08:00Z

and a few minutes later..

Dec 8 22:04:00 tvbox mythbackend: mythbackend[31507]: I Scheduler
scheduler.cpp:2356 (HandleReschedule) Reschedule requested for CHECK -3 432
0 UpdateRecStatus2 | Casualty | | Tension runs high when Bill is admitted
to the ED - will Charlie find out about Duffy's affair? Alicia learns to
trust her instincts. | fp.bbc.co.uk/1fh5pu

George
Re: metadata [ In reply to ]
On Sun, 9 Dec 2018 at 06:03, jam@tigger.ws <jam@tigger.ws> wrote:
>
> On my main backend the movie grabber does work but the TV grabber does not:
>
> [sandypit] /home/jam [603]% /usr/local/share/mythtv/metadata/Television/ttvdb.py -t
>
> The modules tvdb_api.py (v2.0 or greater).
> They should have been installed along with the MythTV python bindings.
> Error:(No module named requests_cache)

Do you have the requests-cache Python library installed?
_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org
Re: metadata [ In reply to ]
On 12/9/18 2:40 AM, Nick Morrott wrote:
> On Sun, 9 Dec 2018 at 06:03, jam@tigger.ws <jam@tigger.ws> wrote:
>>
>> On my main backend the movie grabber does work but the TV grabber does not:
>>
>> [sandypit] /home/jam [603]% /usr/local/share/mythtv/metadata/Television/ttvdb.py -t
>>
>> The modules tvdb_api.py (v2.0 or greater).
>> They should have been installed along with the MythTV python bindings.
>> Error:(No module named requests_cache)
>
> Do you have the requests-cache Python library installed?

The MythTV ansible playbook for Suse only includes the following
for Python:

- name: add mythtv essential python modules
set_fact:
zypper_pkg_lst:
- '{{ zypper_pkg_lst }}'
- python-MySQL-python
- python-lxml
- python-urlgrabber
- python-future
- python-requests
- python-oauth

If requests-cache is another package (likely) please add its name here and it
will get added. I'm guessing that the requests_cache module is the
requests-cache package.

--
Bill
_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org
Re: metadata [ In reply to ]
Hi

Before I bug the dev list will try here to see if anyone here can help …

I run mythmetdatalookup in debug mode:

2018-12-10 11:01:46.753301 I All grabbers tested and working. Continuing...
2018-12-10 11:01:46.757768 I MythCoreContext::ConnectCommandSocket(): Connecting to backend server: 127.0.0.1:6543 (try 1 of 1)
2018-12-10 11:01:46.759350 I MythCoreContext::CheckProtoVersion(): Using protocol version 91 BuzzOff
2018-12-10 11:01:46.762151 I Looking up artwork for recording rule: Default (Template)
2018-12-10 11:01:46.853772 I Running Grabber: /usr/share/mythtv/metadata/Movie/tmdb3.py -l en -a US -M Default (Template)
2018-12-10 11:01:48.558200 I Running Grabber: /usr/share/mythtv/metadata/Television/ttvdb.py -l en -a US -M Default (Template)
2018-12-10 11:01:50.512894 I Metadata Lookup Failed: No Results Default (Template) 0 0
2018-12-10 11:01:51.774389 N MythMetadataLookup run complete.

I don’t have, and don’t understand why I would have metadata enabled in a recording rule.
From the source it is clear (and the log shows this) that if recording rule lookup fails then the run terminates before the lookup on videos starts.
What dummy record rule can I try that will proceed beyond this point.

I see the grabbers produce xml output that seems good.

James
_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org
Re: metadata [ In reply to ]
It's failing because the name of the file that is being saved is incorrect, as per as your xml:

"Grabber: /usr/share/mythtv/metadata/Television/ttvdb.py -l en -a US -M Default (Template)"


The name of the file currently is : Default(Template) ,

It should be something like : "Sherlock" or "Big bang theory",etc.

Please update the database listing of all shows.


Refer to this link : https://www.mythtv.org/wiki/Mythfilldatabase



I hope that helps!.

Enjoy using Mythtv.








Sent from Windows Mail





From: jam@tigger.ws
Sent: ?Monday?, ?December? ?10?, ?2018 ?9?:?14? ?AM
To: mythtv-users@mythtv.org





Hi

Before I bug the dev list will try here to see if anyone here can help …

I run mythmetdatalookup in debug mode:

2018-12-10 11:01:46.753301 I All grabbers tested and working. Continuing...
2018-12-10 11:01:46.757768 I MythCoreContext::ConnectCommandSocket(): Connecting to backend server: 127.0.0.1:6543 (try 1 of 1)
2018-12-10 11:01:46.759350 I MythCoreContext::CheckProtoVersion(): Using protocol version 91 BuzzOff
2018-12-10 11:01:46.762151 I Looking up artwork for recording rule: Default (Template)
2018-12-10 11:01:46.853772 I Running Grabber: /usr/share/mythtv/metadata/Movie/tmdb3.py -l en -a US -M Default (Template)
2018-12-10 11:01:48.558200 I Running Grabber: /usr/share/mythtv/metadata/Television/ttvdb.py -l en -a US -M Default (Template)
2018-12-10 11:01:50.512894 I Metadata Lookup Failed: No Results Default (Template) 0 0
2018-12-10 11:01:51.774389 N MythMetadataLookup run complete.

I don’t have, and don’t understand why I would have metadata enabled in a recording rule.
From the source it is clear (and the log shows this) that if recording rule lookup fails then the run terminates before the lookup on videos starts.
What dummy record rule can I try that will proceed beyond this point.

I see the grabbers produce xml output that seems good.

James
_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org
Re: metadata [ In reply to ]
On Sun, Dec 9, 2018 at 9:45 PM <jam@tigger.ws> wrote:

> Hi
>
> Before I bug the dev list will try here to see if anyone here can help …
>
> I run mythmetdatalookup in debug mode:
>
> 2018-12-10 11:01:46.753301 I All grabbers tested and working.
> Continuing...
> 2018-12-10 11:01:46.757768 I MythCoreContext::ConnectCommandSocket():
> Connecting to backend server: 127.0.0.1:6543 (try 1 of 1)
> 2018-12-10 11:01:46.759350 I MythCoreContext::CheckProtoVersion(): Using
> protocol version 91 BuzzOff
> 2018-12-10 11:01:46.762151 I Looking up artwork for recording rule:
> Default (Template)
> 2018-12-10 11:01:46.853772 I Running Grabber:
> /usr/share/mythtv/metadata/Movie/tmdb3.py -l en -a US -M Default (Template)
> 2018-12-10 11:01:48.558200 I Running Grabber:
> /usr/share/mythtv/metadata/Television/ttvdb.py -l en -a US -M Default
> (Template)
> 2018-12-10 11:01:50.512894 I Metadata Lookup Failed: No Results Default
> (Template) 0 0
> 2018-12-10 11:01:51.774389 N MythMetadataLookup run complete.
>
> I don’t have, and don’t understand why I would have metadata enabled in a
> recording rule.
> From the source it is clear (and the log shows this) that if recording
> rule lookup fails then the run terminates before the lookup on videos
> starts.
> What dummy record rule can I try that will proceed beyond this point.
>
> I see the grabbers produce xml output that seems good.
>
> James
>

I had a similar issue if not the same - see if this fixes it for you ::

https://lists.gt.net/mythtv/users/618397

-Greg
Re: metadata [ In reply to ]
> On 11 Dec 2018, at 6:28 pm, mythtv-users-request@mythtv.org wrote:
>
>> Hi
>>
>> Before I bug the dev list will try here to see if anyone here can help ?
>>
>> I run mythmetdatalookup in debug mode:
>>
>> 2018-12-10 11:01:46.753301 I All grabbers tested and working.
>> Continuing…

snip

>
> I had a similar issue if not the same - see if this fixes it for you ::
>
> https://lists.gt.net/mythtv/users/618397

My results are so iffy it is hard to tell if “it works”

By running M->retrieve all details

lots happens, including a selection of art/metada

Despite extensive searching INFO->Change Video Details->Retrive Details is not mentioned anywhere.
What keys are used?
What operations can be done

Thanks
James
_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org
Re: metadata [ In reply to ]
On Tue, Dec 11, 2018 at 6:03 AM jam@tigger.ws <jam@tigger.ws> wrote:

>
>
> > On 11 Dec 2018, at 6:28 pm, mythtv-users-request@mythtv.org wrote:
> >
> >> Hi
> >>
> >> Before I bug the dev list will try here to see if anyone here can help ?
> >>
> >> I run mythmetdatalookup in debug mode:
> >>
> >> 2018-12-10 11:01:46.753301 I All grabbers tested and working.
> >> Continuing…
>
> snip
>
> >
> > I had a similar issue if not the same - see if this fixes it for you ::
> >
> > https://lists.gt.net/mythtv/users/618397
>
> My results are so iffy it is hard to tell if “it works”
>
> By running M->retrieve all details
>
> lots happens, including a selection of art/metada
>
> Despite extensive searching INFO->Change Video Details->Retrive Details is
> not mentioned anywhere.
> What keys are used?
> What operations can be done
>
> Thanks
> James
>

I did it all from bash (this is a single line)
"""

IFS=$'\n'; for i in $(echo "select chanid, starttime from recorded where
starttime > '*2018-01-01 00:00:00*' ;"|mysql -u *mythtv* -p*mythtv*
mythconverg) ; do c=$(echo $i|awk '{print $1}') ; d=$(echo $i |awk '{print
$2}'); t=$(echo $i|awk '{print $3}') ; fd=$(echo ${d}${t} |sed 's/ //g'|sed
's/\://g'|sed 's/-//g'); mythmetadatalookup --chanid=$c --starttime=$fd ;
done

"""
The user/pass and starttime need to be adjusted to suit your needs.

You did delete the cache directory entries I referenced right? ::

rm -rf
/home/<mythUser>/.mythtv/cacher/{pytmdb3.cache,mythfilldatabase*,tvdb_api}

The 'Menu -> Job Options -> Begin Metadata Lookup' should also work if your
issue was the same as mine..

-Greg
Re: metadata [ In reply to ]
> On 10 May 2020, at 6:03 pm, Mike Perkins <mikep@randomtraveller.org.uk> wrote:
>
> On 10/05/2020 10:42, Blue wrote:
>> Does anybody here know the gritty detail of meta data lookup
>> Checking the grabbler
>> [sandypit] /home/jam [1000]% /usr/local/share/mythtv/metadata/Movie/tmdb3.py -t
>> Everything appears in order.
>> but
>> [Choose Video]->i->Change Video Details->Retrive Details
>> immediately returns “Failed to retrive details …”
>> looking at the logs I see
>> MetadataDownload metadatagrabber.cpp:443 (RunGrabber) - Running Grabber: /usr/local/share/mythtv/metadata/Television/ttvdb.py -l en -a AU -N Coming To America (1988) Coming To America
>> When I run the grabber with title “Coming To America” (without the date)
>> ie /usr/local/share/mythtv/metadata/Movie/tmdb3.py -M "Coming To America" -D
>> I get a xml dump that looks correct, including url to artwork.
>> My file is named “Coming To America.avi”
>> Who puts the date there?
>> This is a new install, so there is no history of it working, but I have used the grabber successfully in the past.
>> I just ran the ‘retrive details’ but nothing is logged today
>> I ran the exact command logged:
>> [sandypit] /home/jam [1003]% /usr/local/share/mythtv/metadata/Television/ttvdb.py -l en -a AU -N 'Coming To America (1988) Coming To America'
>> Usage: ttvdb.py usage: ttvdb -hdruviomMPFBDS [parameters]
>> <series name or 'series and season number' or 'series and season number and episode number'>
>> For details on using ttvdb with Mythvideo see the ttvdb wiki page at:
>> http://www.mythtv.org/wiki/Ttvdb.py
>> ttvdb.py: error: ! An Episode name must be included
>> Before I grovel in mythmetadatalookup
>> Any help appreciated lots
> Your first check involved "Movie" but the others reference "Television". That is the difference. Movies in general don't require series/episode numbers.

Mike clod of earth on my brain:

This (cli) works

/usr/local/share/mythtv/metadata/Movie/tmdb3.py -l en -a AU -M 'Coming To America’

this does not

/usr/local/share/mythtv/metadata/Movie/tmdb3.py -l en -a AU -M 'Coming To America (1988)’

So as before where does the date come from?
I have deleted all meta data

James
_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org
Re: metadata [ In reply to ]
On 11/05/2020 03:55, Blue wrote:

>
>> On 10 May 2020, at 6:03 pm, Mike Perkins <mikep@randomtraveller.org.uk> wrote:
>>
>> On 10/05/2020 10:42, Blue wrote:
>>> Does anybody here know the gritty detail of meta data lookup
>>> Checking the grabbler
>>> [sandypit] /home/jam [1000]% /usr/local/share/mythtv/metadata/Movie/tmdb3.py -t
>>> Everything appears in order.
>>> but
>>> [Choose Video]->i->Change Video Details->Retrive Details
>>> immediately returns “Failed to retrive details …”
>>> looking at the logs I see
>>> MetadataDownload metadatagrabber.cpp:443 (RunGrabber) - Running Grabber: /usr/local/share/mythtv/metadata/Television/ttvdb.py -l en -a AU -N Coming To America (1988) Coming To America
>>> When I run the grabber with title “Coming To America” (without the date)
>>> ie /usr/local/share/mythtv/metadata/Movie/tmdb3.py -M "Coming To America" -D
>>> I get a xml dump that looks correct, including url to artwork.
>>> My file is named “Coming To America.avi”
>>> Who puts the date there?
>>> This is a new install, so there is no history of it working, but I have used the grabber successfully in the past.
>>> I just ran the ‘retrive details’ but nothing is logged today
>>> I ran the exact command logged:
>>> [sandypit] /home/jam [1003]% /usr/local/share/mythtv/metadata/Television/ttvdb.py -l en -a AU -N 'Coming To America (1988) Coming To America'
>>> Usage: ttvdb.py usage: ttvdb -hdruviomMPFBDS [parameters]
>>> <series name or 'series and season number' or 'series and season number and episode number'>
>>> For details on using ttvdb with Mythvideo see the ttvdb wiki page at:
>>> http://www.mythtv.org/wiki/Ttvdb.py
>>> ttvdb.py: error: ! An Episode name must be included
>>> Before I grovel in mythmetadatalookup
>>> Any help appreciated lots
>> Your first check involved "Movie" but the others reference "Television". That is the difference. Movies in general don't require series/episode numbers.
> Mike clod of earth on my brain:
>
> This (cli) works
>
> /usr/local/share/mythtv/metadata/Movie/tmdb3.py -l en -a AU -M 'Coming To America’
>
> this does not
>
> /usr/local/share/mythtv/metadata/Movie/tmdb3.py -l en -a AU -M 'Coming To America (1988)’
>
> So as before where does the date come from?
> I have deleted all meta data
>
> James


There is a pull request related to this here :-

https://github.com/MythTV/mythtv/pull/103

I already have this patch in my fork because I think it does work better
than the official MythTV code but as dekarl suggests it's not perfect.

You could help test the patch and report if it improves things for you
or not.

Paul H.

_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org