Mailing List Archive

Did you follow the process in the wiki?
(https://www.mythtv.org/wiki/XMLTV#Converting_from_DataDirect_to_XMLTV)
You need to either manually update the xmltvids in each channel or
delete the channels and add them back with mythfilldatabase.


On 3/26/20 2:12 PM, Jack McGee wrote:
> I tried to convert to xmltv a week or two ago.  This is US,
> SchedulesDirect, all ATSC with HDHomerun. Mythv .29
>
>
> Mythfilldatabase is having problems.
>
>
> mythuser@amethi:/var/log/mythtv$ mythfilldatabase
> 2020-03-26 13:04:51.681660 C  mythfilldatabase version:  [v29.1]
> www.mythtv.org
> 2020-03-26 13:04:51.681673 C  Qt version: compile: 5.9.5, runtime: 5.9.5
> 2020-03-26 13:04:51.681675 N  Enabled verbose msgs:  general
> 2020-03-26 13:04:51.681682 N  Setting Log Level to LOG_INFO
> 2020-03-26 13:04:51.692051 I  Added logging to the console
> 2020-03-26 13:04:51.692280 I  Setup Interrupt handler
> 2020-03-26 13:04:51.692284 I  Setup Terminated handler
> 2020-03-26 13:04:51.692289 I  Setup Segmentation fault handler
> 2020-03-26 13:04:51.692292 I  Setup Aborted handler
> 2020-03-26 13:04:51.692297 I  Setup Bus error handler
> 2020-03-26 13:04:51.692300 I  Setup Floating point exception handler
> 2020-03-26 13:04:51.692305 I  Setup Illegal instruction handler
> 2020-03-26 13:04:51.692309 I  Setup Real-time signal 0 handler
> 2020-03-26 13:04:51.692314 I  Setup Hangup handler
> 2020-03-26 13:04:51.692370 N  Using runtime prefix = /usr
> 2020-03-26 13:04:51.692371 N  Using configuration directory =
> /home/mythuser/.mythtv
> 2020-03-26 13:04:51.692407 I  Assumed character encoding: en_US.UTF-8
> 2020-03-26 13:04:51.692561 N  Empty LocalHostName.
> 2020-03-26 13:04:51.692569 I  Using localhost value of amethi
> 2020-03-26 13:04:51.692593 I  Start up testing connections. DB
> 192.168.1.105, BE , attempt 0, status dbAwake
> 2020-03-26 13:04:52.210324 N  Setting QT default locale to EN_US
> 2020-03-26 13:04:52.210334 I  Current locale EN_US
> 2020-03-26 13:04:52.210375 N  Reading locale defaults from
> /usr/share/mythtv//locales/en_us.xml
> 2020-03-26 13:04:52.217276 I  Loading en_us translation for module
> mythfrontend
> 2020-03-26 13:04:52.218314 I  Current MythTV Schema Version
> (DBSchemaVer): 1348
> 2020-03-26 13:04:52.220220 I MythCoreContext::ConnectCommandSocket():
> Connecting to backend server: 192.168.1.105:6543 (try 1 of 1)
> 2020-03-26 13:04:52.221092 I MythCoreContext::CheckProtoVersion():
> Using protocol version 91 BuzzOff
> 2020-03-26 13:04:52.221312 I  Opening blocking connection to master
> backend
> 2020-03-26 13:04:52.395982 I  Updating source #1 (antenna_xmltv) with
> grabber tv_grab_zz_sdjson
> 2020-03-26 13:04:52.396432 I  Found 73 channels for source 1 which use
> grabber
> 2020-03-26 13:04:52.396893 I  Starting process signal handler
> 2020-03-26 13:04:52.396905 I  Starting process manager
> 2020-03-26 13:04:52.397833 I  Starting IO manager (write)
> 2020-03-26 13:04:52.397847 I  Starting IO manager (read)
> 2020-03-26 13:04:52.747539 I  Grabber has capabilities: baseline
> manualconfig preferredmethod
> 2020-03-26 13:04:53.098070 I  Grabber prefers method: allatonce
> 2020-03-26 13:04:53.098815 I  XMLTV config file is:
> /home/mythuser/.mythtv/antenna_xmltv.xmltv
> 2020-03-26 13:05:45.650509 N  Unknown xmltv channel identifier:
> I100561.json.schedulesdirect.org - Skipping channel.
> 2020-03-26 13:05:45.650756 N  Unknown xmltv channel identifier:
> I100815.json.schedulesdirect.org - Skipping channel.
> 2020-03-26 13:05:45.650958 N  Unknown xmltv channel identifier:
> I103658.json.schedulesdirect.org - Skipping channel.
>
> then a whole bunch of these and nothing done at end.
>
>
> _______________________________________________
> mythtv-users mailing list
> mythtv-users@mythtv.org
> http://lists.mythtv.org/mailman/listinfo/mythtv-users
> http://wiki.mythtv.org/Mailing_List_etiquette
> MythTV Forums: https://forum.mythtv.org

_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org

Thanks, a lot has transpired during this process.  I think I did delete
the channels and add back with mythfilldatabase, but I will try that again.

On 3/26/20 1:36 PM, Peter Bennett wrote:
> Did you follow the process in the wiki?
> (https://www.mythtv.org/wiki/XMLTV#Converting_from_DataDirect_to_XMLTV)
> You need to either manually update the xmltvids in each channel or
> delete the channels and add them back with mythfilldatabase.
>
>
> On 3/26/20 2:12 PM, Jack McGee wrote:
>> I tried to convert to xmltv a week or two ago.  This is US,
>> SchedulesDirect, all ATSC with HDHomerun. Mythv .29
>>
>>
>> Mythfilldatabase is having problems.
>>
>>
>> mythuser@amethi:/var/log/mythtv$ mythfilldatabase
>> 2020-03-26 13:04:51.681660 C  mythfilldatabase version:  [v29.1]
>> www.mythtv.org
>> 2020-03-26 13:04:51.681673 C  Qt version: compile: 5.9.5, runtime: 5.9.5
>> 2020-03-26 13:04:51.681675 N  Enabled verbose msgs:  general
>> 2020-03-26 13:04:51.681682 N  Setting Log Level to LOG_INFO
>> 2020-03-26 13:04:51.692051 I  Added logging to the console
>> 2020-03-26 13:04:51.692280 I  Setup Interrupt handler
>> 2020-03-26 13:04:51.692284 I  Setup Terminated handler
>> 2020-03-26 13:04:51.692289 I  Setup Segmentation fault handler
>> 2020-03-26 13:04:51.692292 I  Setup Aborted handler
>> 2020-03-26 13:04:51.692297 I  Setup Bus error handler
>> 2020-03-26 13:04:51.692300 I  Setup Floating point exception handler
>> 2020-03-26 13:04:51.692305 I  Setup Illegal instruction handler
>> 2020-03-26 13:04:51.692309 I  Setup Real-time signal 0 handler
>> 2020-03-26 13:04:51.692314 I  Setup Hangup handler
>> 2020-03-26 13:04:51.692370 N  Using runtime prefix = /usr
>> 2020-03-26 13:04:51.692371 N  Using configuration directory =
>> /home/mythuser/.mythtv
>> 2020-03-26 13:04:51.692407 I  Assumed character encoding: en_US.UTF-8
>> 2020-03-26 13:04:51.692561 N  Empty LocalHostName.
>> 2020-03-26 13:04:51.692569 I  Using localhost value of amethi
>> 2020-03-26 13:04:51.692593 I  Start up testing connections. DB
>> 192.168.1.105, BE , attempt 0, status dbAwake
>> 2020-03-26 13:04:52.210324 N  Setting QT default locale to EN_US
>> 2020-03-26 13:04:52.210334 I  Current locale EN_US
>> 2020-03-26 13:04:52.210375 N  Reading locale defaults from
>> /usr/share/mythtv//locales/en_us.xml
>> 2020-03-26 13:04:52.217276 I  Loading en_us translation for module
>> mythfrontend
>> 2020-03-26 13:04:52.218314 I  Current MythTV Schema Version
>> (DBSchemaVer): 1348
>> 2020-03-26 13:04:52.220220 I MythCoreContext::ConnectCommandSocket():
>> Connecting to backend server: 192.168.1.105:6543 (try 1 of 1)
>> 2020-03-26 13:04:52.221092 I MythCoreContext::CheckProtoVersion():
>> Using protocol version 91 BuzzOff
>> 2020-03-26 13:04:52.221312 I  Opening blocking connection to master
>> backend
>> 2020-03-26 13:04:52.395982 I  Updating source #1 (antenna_xmltv) with
>> grabber tv_grab_zz_sdjson
>> 2020-03-26 13:04:52.396432 I  Found 73 channels for source 1 which
>> use grabber
>> 2020-03-26 13:04:52.396893 I  Starting process signal handler
>> 2020-03-26 13:04:52.396905 I  Starting process manager
>> 2020-03-26 13:04:52.397833 I  Starting IO manager (write)
>> 2020-03-26 13:04:52.397847 I  Starting IO manager (read)
>> 2020-03-26 13:04:52.747539 I  Grabber has capabilities: baseline
>> manualconfig preferredmethod
>> 2020-03-26 13:04:53.098070 I  Grabber prefers method: allatonce
>> 2020-03-26 13:04:53.098815 I  XMLTV config file is:
>> /home/mythuser/.mythtv/antenna_xmltv.xmltv
>> 2020-03-26 13:05:45.650509 N  Unknown xmltv channel identifier:
>> I100561.json.schedulesdirect.org - Skipping channel.
>> 2020-03-26 13:05:45.650756 N  Unknown xmltv channel identifier:
>> I100815.json.schedulesdirect.org - Skipping channel.
>> 2020-03-26 13:05:45.650958 N  Unknown xmltv channel identifier:
>> I103658.json.schedulesdirect.org - Skipping channel.
>>
>> then a whole bunch of these and nothing done at end.
>>
>>
>> _______________________________________________
>> mythtv-users mailing list
>> mythtv-users@mythtv.org
>> http://lists.mythtv.org/mailman/listinfo/mythtv-users
>> http://wiki.mythtv.org/Mailing_List_etiquette
>> MythTV Forums: https://forum.mythtv.org
>
> _______________________________________________
> mythtv-users mailing list
> mythtv-users@mythtv.org
> http://lists.mythtv.org/mailman/listinfo/mythtv-users
> http://wiki.mythtv.org/Mailing_List_etiquette
> MythTV Forums: https://forum.mythtv.org
_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org

OK, I don't understand.

mythtvsetup on backend:

I deleted the VideoSource. Created a new one.

I go into Input connections, set each to that new source, and click
fetch listings from lisitings source.

Says it may take a long time. how much time.  I never see any changes in
that screen after I click that.


On 3/26/20 1:36 PM, Peter Bennett wrote:
> Did you follow the process in the wiki?
> (https://www.mythtv.org/wiki/XMLTV#Converting_from_DataDirect_to_XMLTV)
> You need to either manually update the xmltvids in each channel or
> delete the channels and add them back with mythfilldatabase.
>
>
> On 3/26/20 2:12 PM, Jack McGee wrote:
>> I tried to convert to xmltv a week or two ago.  This is US,
>> SchedulesDirect, all ATSC with HDHomerun. Mythv .29
>>
>>
>> Mythfilldatabase is having problems.
>>
>>
>> mythuser@amethi:/var/log/mythtv$ mythfilldatabase
>> 2020-03-26 13:04:51.681660 C  mythfilldatabase version:  [v29.1]
>> www.mythtv.org
>> 2020-03-26 13:04:51.681673 C  Qt version: compile: 5.9.5, runtime: 5.9.5
>> 2020-03-26 13:04:51.681675 N  Enabled verbose msgs:  general
>> 2020-03-26 13:04:51.681682 N  Setting Log Level to LOG_INFO
>> 2020-03-26 13:04:51.692051 I  Added logging to the console
>> 2020-03-26 13:04:51.692280 I  Setup Interrupt handler
>> 2020-03-26 13:04:51.692284 I  Setup Terminated handler
>> 2020-03-26 13:04:51.692289 I  Setup Segmentation fault handler
>> 2020-03-26 13:04:51.692292 I  Setup Aborted handler
>> 2020-03-26 13:04:51.692297 I  Setup Bus error handler
>> 2020-03-26 13:04:51.692300 I  Setup Floating point exception handler
>> 2020-03-26 13:04:51.692305 I  Setup Illegal instruction handler
>> 2020-03-26 13:04:51.692309 I  Setup Real-time signal 0 handler
>> 2020-03-26 13:04:51.692314 I  Setup Hangup handler
>> 2020-03-26 13:04:51.692370 N  Using runtime prefix = /usr
>> 2020-03-26 13:04:51.692371 N  Using configuration directory =
>> /home/mythuser/.mythtv
>> 2020-03-26 13:04:51.692407 I  Assumed character encoding: en_US.UTF-8
>> 2020-03-26 13:04:51.692561 N  Empty LocalHostName.
>> 2020-03-26 13:04:51.692569 I  Using localhost value of amethi
>> 2020-03-26 13:04:51.692593 I  Start up testing connections. DB
>> 192.168.1.105, BE , attempt 0, status dbAwake
>> 2020-03-26 13:04:52.210324 N  Setting QT default locale to EN_US
>> 2020-03-26 13:04:52.210334 I  Current locale EN_US
>> 2020-03-26 13:04:52.210375 N  Reading locale defaults from
>> /usr/share/mythtv//locales/en_us.xml
>> 2020-03-26 13:04:52.217276 I  Loading en_us translation for module
>> mythfrontend
>> 2020-03-26 13:04:52.218314 I  Current MythTV Schema Version
>> (DBSchemaVer): 1348
>> 2020-03-26 13:04:52.220220 I MythCoreContext::ConnectCommandSocket():
>> Connecting to backend server: 192.168.1.105:6543 (try 1 of 1)
>> 2020-03-26 13:04:52.221092 I MythCoreContext::CheckProtoVersion():
>> Using protocol version 91 BuzzOff
>> 2020-03-26 13:04:52.221312 I  Opening blocking connection to master
>> backend
>> 2020-03-26 13:04:52.395982 I  Updating source #1 (antenna_xmltv) with
>> grabber tv_grab_zz_sdjson
>> 2020-03-26 13:04:52.396432 I  Found 73 channels for source 1 which
>> use grabber
>> 2020-03-26 13:04:52.396893 I  Starting process signal handler
>> 2020-03-26 13:04:52.396905 I  Starting process manager
>> 2020-03-26 13:04:52.397833 I  Starting IO manager (write)
>> 2020-03-26 13:04:52.397847 I  Starting IO manager (read)
>> 2020-03-26 13:04:52.747539 I  Grabber has capabilities: baseline
>> manualconfig preferredmethod
>> 2020-03-26 13:04:53.098070 I  Grabber prefers method: allatonce
>> 2020-03-26 13:04:53.098815 I  XMLTV config file is:
>> /home/mythuser/.mythtv/antenna_xmltv.xmltv
>> 2020-03-26 13:05:45.650509 N  Unknown xmltv channel identifier:
>> I100561.json.schedulesdirect.org - Skipping channel.
>> 2020-03-26 13:05:45.650756 N  Unknown xmltv channel identifier:
>> I100815.json.schedulesdirect.org - Skipping channel.
>> 2020-03-26 13:05:45.650958 N  Unknown xmltv channel identifier:
>> I103658.json.schedulesdirect.org - Skipping channel.
>>
>> then a whole bunch of these and nothing done at end.
>>
>>
>> _______________________________________________
>> mythtv-users mailing list
>> mythtv-users@mythtv.org
>> http://lists.mythtv.org/mailman/listinfo/mythtv-users
>> http://wiki.mythtv.org/Mailing_List_etiquette
>> MythTV Forums: https://forum.mythtv.org
>
> _______________________________________________
> mythtv-users mailing list
> mythtv-users@mythtv.org
> http://lists.mythtv.org/mailman/listinfo/mythtv-users
> http://wiki.mythtv.org/Mailing_List_etiquette
> MythTV Forums: https://forum.mythtv.org
_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org

On Thu, Mar 26, 2020 at 2:59 PM Jack McGee <jack@greendesk.net> wrote:

> OK, I don't understand.
>
> mythtvsetup on backend:
>
> I deleted the VideoSource. Created a new one.
>
> I go into Input connections, set each to that new source, and click
> fetch listings from lisitings source.
>
> Says it may take a long time. how much time. I never see any changes in
> that screen after I click that.
>
>
> On 3/26/20 1:36 PM, Peter Bennett wrote:
> > Did you follow the process in the wiki?
> > (https://www.mythtv.org/wiki/XMLTV#Converting_from_DataDirect_to_XMLTV)
> > You need to either manually update the xmltvids in each channel or
> > delete the channels and add them back with mythfilldatabase.
> >
> >
> > On 3/26/20 2:12 PM, Jack McGee wrote:
> >> I tried to convert to xmltv a week or two ago. This is US,
> >> SchedulesDirect, all ATSC with HDHomerun. Mythv .29
> >>
> >>
> >> Mythfilldatabase is having problems.
> >>
> >>
>
> Let me give you the steps I follow:

Switch to user 'mythtv' by: sudo su mythtv

Follow the help on the mythtv xmltv wiki page at
https://www.mythtv.org/wiki/XMLTV#Setup_with_tv_grab_zz_sdjson_sqlite

Run the commands:
tv_grab_zz_sdjson_sqlite --manage-lineups --config-file
$HOME/.mythtv/SD.xmltv
Enter login info for Schedules Direct
Enter 4 to initialize the database
Take the defaults and exit.
Run the command:
tv_grab_zz_sdjson_sqlite --configure --config-file $HOME/.mythtv/SD.xmltv
Answer yes to the lineup you want to use and no to the others, then take
the defaults and exit
Run the commands:
tv_grab_zz_sdjson_sqlite --days 0 --config-file $HOME/.mythtv/SD.xmltv
tv_grab_zz_sdjson_sqlite --manage-lineups --config-file
$HOME/.mythtv/SD.xmltv
Accept the default for my lineup and select option 5, 1, then 5.
Now go through and pick yes or no on the channels you want data on.
You may have to do the option 5 again if you missed a channel or selected
wrong,
exit
Switch back to user '<user>' by :exit
Stop Mythtv backend by: sudo systemctl stop mythtv-backend
Run the mythtv-setup from the Applications Menu
In General -> Job Queue (Backend-Specific) -> I deselected Allow commercial
Jobs and Allow transcoding jobs. (not needed for me)
In General -> Program Schedule Downloading Options -> Automatically update
program listings -> Guide Data Program execution start/end I set them to 2
and 5
In General -> Program Schedule Downloading Options -> Automatically update
program listings -> Run guide data program at time suggested by the grabber
I deselected.
On Capture cards deselect the "Use HD HomeRun for Active EIT scan" in
Recording Options for any tuner you had it enabled on.
In Video Sources Delete all video sources. Then add a New video source.
In the Video Source make the Video source name match what was done in XMLTV
setup which is "SD"
Select Listing grabber to be Multinational (Schedules Direct JSON web
services with SQLite...
Save and exit.
In Input Connections go through each and select Video Source "SD" and only
do the scan in the first Input Connection.
In Channel Editor you may need to revisit any changes done before as the
rescan will have undone them.
Exit
Restart mythtv-backend with: sudo systemctl start mythtv-backend
Switch back to user 'mythtv' and run "mythfilldatabase"
Once mythfilldatabase completes, exit back to user '<user>'

These work for me everytime. I have a better formated version on a blog
for doing this on a Rpi4. Skip to the part for XMLTV.
https://mythtv-rp4.blogspot.com/2019/12/installing-mythtv-on-raspberry-pi-4.html

Jim A

On 3/26/20 1:57 PM, Jack McGee wrote:
> OK, I don't understand.
>
> mythtvsetup on backend:
>
> I deleted the VideoSource. Created a new one.
>
> I go into Input connections, set each to that new source, and click fetch listings from lisitings source.
>
> Says it may take a long time. how much time.  I never see any changes in that screen after I click that.

You can type: watch ls -l /tmp/myth??????. It should be growing. Control-c to exit.

I don't remember how long my 1st download lasted.

--
Bill
_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org

On Thu, Mar 26, 2020, 3:19 PM Bill Meek <keemllib@gmail.com> wrote:

> On 3/26/20 1:57 PM, Jack McGee wrote:
> > OK, I don't understand.
> >
> > mythtvsetup on backend:
> >
> > I deleted the VideoSource. Created a new one.
> >
> > I go into Input connections, set each to that new source, and click
> fetch listings from lisitings source.
> >
> > Says it may take a long time. how much time. I never see any changes in
> that screen after I click that.
>
> You can type: watch ls -l /tmp/myth??????. It should be growing. Control-c
> to exit.
>
> I don't remember how long my 1st download lasted.
>
> --
> Bill
>
For me mythfilldatabase took 4 minutes the first time.

Jim A

TL;DR: Your xmltvid file is using the wrong format. Should be:
channel=31507
channel=24051
And it does seem to take FOREVER to run!

Long version
The process set out in the wiki can be confusing.

You have the correct grabber set in mythtv-setup -> General, (in this
case, the tv_grabber_zz_sdjson grabber)

We can see this, as you get:
2020-03-26 13:04:52.395982 I Updating source #1 (antenna_xmltv) with
grabber tv_grab_zz_sdjson
2020-03-26 13:04:52.396432 I Found 73 channels for source 1 which use
grabber
2020-03-26 13:04:52.396893 I Starting process signal handler
2020-03-26 13:04:52.396905 I Starting process manager
2020-03-26 13:04:52.397833 I Starting IO manager (write)
2020-03-26 13:04:52.397847 I Starting IO manager (read)
2020-03-26 13:04:52.747539 I Grabber has capabilities: baseline
manualconfig preferredmethod
2020-03-26 13:04:53.098070 I Grabber prefers method: allatonce
2020-03-26 13:04:53.098815 I XMLTV config file is:
/home/mythuser/.mythtv/antenna_xmltv.xmltv

The problem is format of your file:
/home/mythtv/.mythtv/antenna_xmltv.xmltv.

This is where it gets confusing. If you run tv_grabber_zz_sdjson
--configure, one of the choices is for the xmltvid format. You clearly
selected the sdjson format: I12345.json.schedulesdirect.org
It looks like that format is used in your antenna_xmltv.xmltv file.

On my system the OTA.xmltv file looks like:
...
channel=31507
channel=24051

Even though the xmltvid entry in the Channel Editor shows the long form
Ixxxxxx.json.schedulesdirect.org. (And even more confusing, the cable
channels listings in the Channel Editor are the short form: the OTA
channels are the long form, but ONLY in the Channel Editor.)

And yes there is a LONG gap, when nothing appears to be happening when
you run the /usr/bin/mythfilldatabase program.

Geoff


On 2020-03-26 2:57 p.m., Jack McGee wrote:
> OK, I don't understand.
>
> mythtvsetup on backend:
>
> I deleted the VideoSource. Created a new one.
>
> I go into Input connections, set each to that new source, and click
> fetch listings from lisitings source.
>
> Says it may take a long time. how much time.  I never see any changes in
> that screen after I click that.
>
>
> On 3/26/20 1:36 PM, Peter Bennett wrote:
>> Did you follow the process in the wiki?
>> (https://www.mythtv.org/wiki/XMLTV#Converting_from_DataDirect_to_XMLTV)
>> You need to either manually update the xmltvids in each channel or
>> delete the channels and add them back with mythfilldatabase.
>>

-

_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org

On Thu, Mar 26, 2020 at 7:18 PM Bill Meek <keemllib@gmail.com> wrote:

> I don't remember how long my 1st download lasted.

As I recall, with ticket #12727 (AFAIK not yet reviewed or
applied by any developer) that first run for fetching
channels would likely have been much faster for at
least some (more advanced) grabbers. That would not
have reduced the time to populate the entire EPG
listing at a later time, but getting the channels during
mythtv-setup should have been faster. Que sera sera.
_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org

On 3/26/20 2:18 PM, Bill Meek wrote:
> On 3/26/20 1:57 PM, Jack McGee wrote:
>> OK, I don't understand.
>>
>> mythtvsetup on backend:
>>
>> I deleted the VideoSource. Created a new one.
>>
>> I go into Input connections, set each to that new source, and click
>> fetch listings from lisitings source.
>>
>> Says it may take a long time. how much time.  I never see any changes
>> in that screen after I click that.
>
> You can type: watch ls -l /tmp/myth??????. It should be growing.
> Control-c to exit.
>
> I don't remember how long my 1st download lasted.
>

that maybe a clue. I don't have that directory:

mythuser@amethi:~$ ls /tmp
config-err-9vMImx
systemd-private-e632ac62d2484e7d9f4abeb2d60afd8c-colord.service-k3g1DV
dropbox-antifreeze-91yJmD
systemd-private-e632ac62d2484e7d9f4abeb2d60afd8c-ModemManager.service-05GD6i
launchpadlib.cache.fvnehcp3
systemd-private-e632ac62d2484e7d9f4abeb2d60afd8c-rtkit-daemon.service-62Gmlr
qipc_sharedmemory_optpiavpnbinpiaclient0acb86517b0d6141eff2e9cd66fc32861973fb88
systemd-private-e632ac62d2484e7d9f4abeb2d60afd8c-systemd-resolved.service-EnVKKJ
qipc_systemsem_optpiavpnbinpiaclient0acb86517b0d6141eff2e9cd66fc32861973fb88
systemd-private-e632ac62d2484e7d9f4abeb2d60afd8c-systemd-timesyncd.service-SlmUsb
snap.canonical-livepatch Temp-4653adae-b358-4d93-a77b-5e867df634bf
ssh-MghTGutRho2Y Temp-586ec6aa-e0e6-40d6-a04e-a0b1331d2457
ssh-VOh4WFmgkJna tmp-uvz.xpi
systemd-private-e632ac62d2484e7d9f4abeb2d60afd8c-apache2.service-SOWXti
unity_support_test.0
systemd-private-e632ac62d2484e7d9f4abeb2d60afd8c-bolt.service-tJz7Ma



_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org

On 3/26/20 5:57 PM, Jack McGee wrote:
>
> On 3/26/20 2:18 PM, Bill Meek wrote:
>> On 3/26/20 1:57 PM, Jack McGee wrote:
>>> OK, I don't understand.
>>>
>>> mythtvsetup on backend:
>>>
>>> I deleted the VideoSource. Created a new one.
>>>
>>> I go into Input connections, set each to that new source, and click fetch listings from lisitings source.
>>>
>>> Says it may take a long time. how much time.  I never see any changes in that screen after I click that.
>>
>> You can type: watch ls -l /tmp/myth??????. It should be growing. Control-c to exit.
>>
>> I don't remember how long my 1st download lasted.
>>
>
> that maybe a clue. I don't have that directory:

To be clear, the file, not directory, only exists while the grabber is running.

Don't know if you mean that the original command is still running, which would
seem too long.

You could run mythfilldatabase with -v system . You'll see the actual command that's run
(and you can run that command directly from the command line.)

An example would be:

tv_grab_zz_sdjson_sqlite --config-file '/home/mythuser/.mythtv/antenna_xmltv.xmltv' --output /tmp/myth123456

In the above, I dropped the --quiet option. The output may yield a clue.

--
Bill
_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org

On 3/26/20 6:41 PM, Bill Meek wrote:
> On 3/26/20 5:57 PM, Jack McGee wrote:
>>
>> On 3/26/20 2:18 PM, Bill Meek wrote:
>>> On 3/26/20 1:57 PM, Jack McGee wrote:
>>>> OK, I don't understand.
>>>>
>>>> mythtvsetup on backend:
>>>>
>>>> I deleted the VideoSource. Created a new one.
>>>>
>>>> I go into Input connections, set each to that new source, and click
>>>> fetch listings from lisitings source.
>>>>
>>>> Says it may take a long time. how much time.  I never see any
>>>> changes in that screen after I click that.
>>>
>>> You can type: watch ls -l /tmp/myth??????. It should be growing.
>>> Control-c to exit.
>>>
>>> I don't remember how long my 1st download lasted.
>>>
>>
>> that maybe a clue. I don't have that directory:
>
> To be clear, the file, not directory, only exists while the grabber is
> running.
>
> Don't know if you mean that the original command is still running,
> which would
> seem too long.
>
> You could run mythfilldatabase with -v system . You'll see the actual
> command that's run
> (and you can run that command directly from the command line.)
>
> An example would be:
>
>    tv_grab_zz_sdjson_sqlite --config-file
> '/home/mythuser/.mythtv/antenna_xmltv.xmltv' --output /tmp/myth123456
>
> In the above, I dropped the --quiet option. The output may yield a clue.
>

I used Jim Abernathy's guide:

https://mythtv-rp4.blogspot.com/2019/12/installing-mythtv-on-raspberry-pi-4.html

which moved me to sqlite version, but that is fine.

I never got the fetch listings from listings source to do anything.

I did see the file when I ran

mythuser@amethi:~/.mythtv$ ls -l /tmp/myth??????
-rw-rw-r-- 1 mythuser mythuser 0 Mar 26 21:01 /tmp/myth123456

but it never changed in file size.

If I run

mythuser@amethi:~/.mythtv$ tv_grab_zz_sdjson_sqlite --config-file
'/home/mythuser/.mythtv/antenna_xmltv.xmltv' --output /tmp/myth123456
Database not defined in config file
/home/mythuser/.mythtv/antenna_xmltv.xmltv.
Please run 'tv_grab_zz_sdjson_sqlite --configure'


In the above writeup, he says:

In Input Connections go through each and select Video Source "SD" and
only do the scan in the first Input Connection

Should I be doing "scan for channels"  or "fetch listings from listings
source"

I think originally, I did scan for channels because I could not get
fetch listings to work.





_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org

On 3/26/20 10:08 PM, Jack McGee wrote:
>
> On 3/26/20 6:41 PM, Bill Meek wrote:
>> On 3/26/20 5:57 PM, Jack McGee wrote:
>>>
>>> On 3/26/20 2:18 PM, Bill Meek wrote:
>>>> On 3/26/20 1:57 PM, Jack McGee wrote:
>>>>> OK, I don't understand.
>>>>>
>>>>> mythtvsetup on backend:
>>>>>
>>>>> I deleted the VideoSource. Created a new one.
>>>>>
>>>>> I go into Input connections, set each to that new source, and
>>>>> click fetch listings from lisitings source.
>>>>>
>>>>> Says it may take a long time. how much time.  I never see any
>>>>> changes in that screen after I click that.
>>>>
>>>> You can type: watch ls -l /tmp/myth??????. It should be growing.
>>>> Control-c to exit.
>>>>
>>>> I don't remember how long my 1st download lasted.
>>>>
>>>
>>> that maybe a clue. I don't have that directory:
>>
>> To be clear, the file, not directory, only exists while the grabber
>> is running.
>>
>> Don't know if you mean that the original command is still running,
>> which would
>> seem too long.
>>
>> You could run mythfilldatabase with -v system . You'll see the actual
>> command that's run
>> (and you can run that command directly from the command line.)
>>
>> An example would be:
>>
>>    tv_grab_zz_sdjson_sqlite --config-file
>> '/home/mythuser/.mythtv/antenna_xmltv.xmltv' --output /tmp/myth123456
>>
>> In the above, I dropped the --quiet option. The output may yield a clue.
>>
>
> I used Jim Abernathy's guide:
>
> https://mythtv-rp4.blogspot.com/2019/12/installing-mythtv-on-raspberry-pi-4.html
>
>
> which moved me to sqlite version, but that is fine.
>
> I never got the fetch listings from listings source to do anything.
>
> I did see the file when I ran
>
> mythuser@amethi:~/.mythtv$ ls -l /tmp/myth??????
> -rw-rw-r-- 1 mythuser mythuser 0 Mar 26 21:01 /tmp/myth123456
>
> but it never changed in file size.
>
> If I run
>
> mythuser@amethi:~/.mythtv$ tv_grab_zz_sdjson_sqlite --config-file
> '/home/mythuser/.mythtv/antenna_xmltv.xmltv' --output /tmp/myth123456
> Database not defined in config file
> /home/mythuser/.mythtv/antenna_xmltv.xmltv.
> Please run 'tv_grab_zz_sdjson_sqlite --configure'
>
>
> In the above writeup, he says:
>
> In Input Connections go through each and select Video Source "SD" and
> only do the scan in the first Input Connection
>
> Should I be doing "scan for channels"  or "fetch listings from
> listings source"
>
> I think originally, I did scan for channels because I could not get
> fetch listings to work.
>
For me using either networked tuners or PCIe tuners I would setup the
first Input Connection by entering the Video Source name to match and
make sure it also matched what I did external from mythtv-setup. In my
case 'SD'. The Scan for channels was uses as is, sometimes I'd set the
channel scan range to eliminate the scan of the channels above which I
know I won't find any.

Jim A


_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org

On 3/27/20 4:20 AM, Jim Abernathy wrote:
>
> For me using either networked tuners or PCIe tuners I would setup the
> first Input Connection by entering the Video Source name to match and
> make sure it also matched what I did external from mythtv-setup. In my
> case 'SD'. The Scan for channels was uses as is, sometimes I'd set the
> channel scan range to eliminate the scan of the channels above which I
> know I won't find any.
>
>
Thanks Jim.


I ran scan for channels, inserted all.

Then per you guide, started mythtv backend, and ran mythfilldatabase:

It starts normally:

mythuser@amethi:~/.mythtv$ sudo su mythtv
$ mythfilldatabase
2020-03-27 06:19:25.597409 C  mythfilldatabase version:  [v29.1]
www.mythtv.org
2020-03-27 06:19:25.597424 C  Qt version: compile: 5.9.5, runtime: 5.9.5
2020-03-27 06:19:25.597425 N  Enabled verbose msgs:  general
2020-03-27 06:19:25.597432 N  Setting Log Level to LOG_INFO
2020-03-27 06:19:25.607799 I  Added logging to the console
2020-03-27 06:19:25.608070 I  Setup Interrupt handler
2020-03-27 06:19:25.608075 I  Setup Terminated handler
2020-03-27 06:19:25.608081 I  Setup Segmentation fault handler
2020-03-27 06:19:25.608084 I  Setup Aborted handler
2020-03-27 06:19:25.608089 I  Setup Bus error handler
2020-03-27 06:19:25.608092 I  Setup Floating point exception handler
2020-03-27 06:19:25.608097 I  Setup Illegal instruction handler
2020-03-27 06:19:25.608107 I  Setup Real-time signal 0 handler
2020-03-27 06:19:25.608112 I  Setup Hangup handler
2020-03-27 06:19:25.608189 N  Using runtime prefix = /usr
2020-03-27 06:19:25.608191 N  Using configuration directory =
/home/mythtv/.mythtv
2020-03-27 06:19:25.608233 I  Assumed character encoding: en_US.UTF-8
2020-03-27 06:19:25.608439 N  Empty LocalHostName.
2020-03-27 06:19:25.608443 I  Using localhost value of amethi
2020-03-27 06:19:25.608476 I  Start up testing connections. DB
192.168.1.105, BE , attempt 0, status dbAwake
2020-03-27 06:19:26.120815 N  Setting QT default locale to EN_US
2020-03-27 06:19:26.120822 I  Current locale EN_US
2020-03-27 06:19:26.120852 N  Reading locale defaults from
/usr/share/mythtv//locales/en_us.xml
2020-03-27 06:19:26.125965 I  Loading en_us translation for module
mythfrontend
2020-03-27 06:19:26.127385 I  Current MythTV Schema Version
(DBSchemaVer): 1348
2020-03-27 06:19:26.129779 I MythCoreContext::ConnectCommandSocket():
Connecting to backend server: 192.168.1.105:6543 (try 1 of 1)
2020-03-27 06:19:26.130703 I MythCoreContext::CheckProtoVersion(): Using
protocol version 91 BuzzOff
2020-03-27 06:19:26.130902 I  Opening blocking connection to master backend
2020-03-27 06:19:26.138610 I  Updating source #1 (SD) with grabber
tv_grab_zz_sdjson_sqlite
2020-03-27 06:19:26.139047 I  No channels are configured to use grabber.
2020-03-27 06:19:26.139319 I  Starting process manager
2020-03-27 06:19:26.140076 I  Starting IO manager (read)
2020-03-27 06:19:26.140126 I  Starting process signal handler
2020-03-27 06:19:26.140245 I  Starting IO manager (write)
2020-03-27 06:19:26.741158 I  Grabber has capabilities: baseline
manualconfig preferredmethod lineups apiconfig
2020-03-27 06:19:27.241881 I  Grabber prefers method: allatonce
2020-03-27 06:19:27.242539 I  XMLTV config file is:
/home/mythtv/.mythtv/SD.xmltv
2020-03-27 06:20:48.346124 N  Unknown xmltv channel identifier:
I100147.json.schedulesdirect.org - Skipping channel.
2020-03-27 06:20:48.346434 N  Unknown xmltv channel identifier:
I100561.json.schedulesdirect.org - Skipping channel.
(snip)

whole bunch of these


2020-03-27 06:24:21.006700 N  Unknown xmltv channel identifier:
I99986.json.schedulesdirect.org - Skipping channel.
2020-03-27 06:24:21.006710 I  Updated programs: 33938 Unchanged programs: 0
2020-03-27 06:24:21.397597 N  Data fetching complete.
2020-03-27 06:24:21.397618 I  Adjusting program database end times.
2020-03-27 06:24:21.397825 I      0 replacements made
2020-03-27 06:24:21.397858 I  Marking generic episodes.
2020-03-27 06:24:21.552867 I      Found 9312
2020-03-27 06:24:21.552873 I  Extending non-unique programids with
multiple parts.
2020-03-27 06:24:21.567857 I      Found 0
2020-03-27 06:24:21.567862 I  Fixing missing original airdates.
2020-03-27 06:24:21.731860 I      Found 588 with programids
2020-03-27 06:24:21.732823 I      Found 0 without programids
2020-03-27 06:24:21.732827 I  Marking repeats.
2020-03-27 06:24:21.749906 I      Found 407
2020-03-27 06:24:21.749912 I  Unmarking new episode rebroadcast repeats.
2020-03-27 06:24:21.846357 I      Found 587
2020-03-27 06:24:22.013319 I  Marking episode first showings.
2020-03-27 06:24:22.326818 I      Found 14986
2020-03-27 06:24:22.326825 I  Marking episode last showings.
2020-03-27 06:24:22.746125 I      Found 14948


_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org

On 3/27/20 7:27 AM, Jack McGee wrote:
>
> On 3/27/20 4:20 AM, Jim Abernathy wrote:
>>
>> For me using either networked tuners or PCIe tuners I would setup the
>> first Input Connection by entering the Video Source name to match and
>> make sure it also matched what I did external from mythtv-setup. In
>> my case 'SD'. The Scan for channels was uses as is, sometimes I'd set
>> the channel scan range to eliminate the scan of the channels above
>> which I know I won't find any.
>>
>>
> Thanks Jim.
>
>
> I ran scan for channels, inserted all.
>
> Then per you guide, started mythtv backend, and ran mythfilldatabase:
>
> It starts normally:
>
> mythuser@amethi:~/.mythtv$ sudo su mythtv
> $ mythfilldatabase
> 2020-03-27 06:19:25.597409 C  mythfilldatabase version:  [v29.1]
> www.mythtv.org
> 2020-03-27 06:19:25.597424 C  Qt version: compile: 5.9.5, runtime: 5.9.5
> 2020-03-27 06:19:25.597425 N  Enabled verbose msgs:  general
> 2020-03-27 06:19:25.597432 N  Setting Log Level to LOG_INFO
> 2020-03-27 06:19:25.607799 I  Added logging to the console
> 2020-03-27 06:19:25.608070 I  Setup Interrupt handler
> 2020-03-27 06:19:25.608075 I  Setup Terminated handler
> 2020-03-27 06:19:25.608081 I  Setup Segmentation fault handler
> 2020-03-27 06:19:25.608084 I  Setup Aborted handler
> 2020-03-27 06:19:25.608089 I  Setup Bus error handler
> 2020-03-27 06:19:25.608092 I  Setup Floating point exception handler
> 2020-03-27 06:19:25.608097 I  Setup Illegal instruction handler
> 2020-03-27 06:19:25.608107 I  Setup Real-time signal 0 handler
> 2020-03-27 06:19:25.608112 I  Setup Hangup handler
> 2020-03-27 06:19:25.608189 N  Using runtime prefix = /usr
> 2020-03-27 06:19:25.608191 N  Using configuration directory =
> /home/mythtv/.mythtv
> 2020-03-27 06:19:25.608233 I  Assumed character encoding: en_US.UTF-8
> 2020-03-27 06:19:25.608439 N  Empty LocalHostName.
> 2020-03-27 06:19:25.608443 I  Using localhost value of amethi
> 2020-03-27 06:19:25.608476 I  Start up testing connections. DB
> 192.168.1.105, BE , attempt 0, status dbAwake
> 2020-03-27 06:19:26.120815 N  Setting QT default locale to EN_US
> 2020-03-27 06:19:26.120822 I  Current locale EN_US
> 2020-03-27 06:19:26.120852 N  Reading locale defaults from
> /usr/share/mythtv//locales/en_us.xml
> 2020-03-27 06:19:26.125965 I  Loading en_us translation for module
> mythfrontend
> 2020-03-27 06:19:26.127385 I  Current MythTV Schema Version
> (DBSchemaVer): 1348
> 2020-03-27 06:19:26.129779 I MythCoreContext::ConnectCommandSocket():
> Connecting to backend server: 192.168.1.105:6543 (try 1 of 1)
> 2020-03-27 06:19:26.130703 I MythCoreContext::CheckProtoVersion():
> Using protocol version 91 BuzzOff
> 2020-03-27 06:19:26.130902 I  Opening blocking connection to master
> backend
> 2020-03-27 06:19:26.138610 I  Updating source #1 (SD) with grabber
> tv_grab_zz_sdjson_sqlite
> 2020-03-27 06:19:26.139047 I  No channels are configured to use grabber.
> 2020-03-27 06:19:26.139319 I  Starting process manager
> 2020-03-27 06:19:26.140076 I  Starting IO manager (read)
> 2020-03-27 06:19:26.140126 I  Starting process signal handler
> 2020-03-27 06:19:26.140245 I  Starting IO manager (write)
> 2020-03-27 06:19:26.741158 I  Grabber has capabilities: baseline
> manualconfig preferredmethod lineups apiconfig
> 2020-03-27 06:19:27.241881 I  Grabber prefers method: allatonce
> 2020-03-27 06:19:27.242539 I  XMLTV config file is:
> /home/mythtv/.mythtv/SD.xmltv
> 2020-03-27 06:20:48.346124 N  Unknown xmltv channel identifier:
> I100147.json.schedulesdirect.org - Skipping channel.
> 2020-03-27 06:20:48.346434 N  Unknown xmltv channel identifier:
> I100561.json.schedulesdirect.org - Skipping channel.
> (snip)
>
> whole bunch of these
>
>
> 2020-03-27 06:24:21.006700 N  Unknown xmltv channel identifier:
> I99986.json.schedulesdirect.org - Skipping channel.
> 2020-03-27 06:24:21.006710 I  Updated programs: 33938 Unchanged
> programs: 0
> 2020-03-27 06:24:21.397597 N  Data fetching complete.
> 2020-03-27 06:24:21.397618 I  Adjusting program database end times.
> 2020-03-27 06:24:21.397825 I      0 replacements made
> 2020-03-27 06:24:21.397858 I  Marking generic episodes.
> 2020-03-27 06:24:21.552867 I      Found 9312
> 2020-03-27 06:24:21.552873 I  Extending non-unique programids with
> multiple parts.
> 2020-03-27 06:24:21.567857 I      Found 0
> 2020-03-27 06:24:21.567862 I  Fixing missing original airdates.
> 2020-03-27 06:24:21.731860 I      Found 588 with programids
> 2020-03-27 06:24:21.732823 I      Found 0 without programids
> 2020-03-27 06:24:21.732827 I  Marking repeats.
> 2020-03-27 06:24:21.749906 I      Found 407
> 2020-03-27 06:24:21.749912 I  Unmarking new episode rebroadcast repeats.
> 2020-03-27 06:24:21.846357 I      Found 587
> 2020-03-27 06:24:22.013319 I  Marking episode first showings.
> 2020-03-27 06:24:22.326818 I      Found 14986
> 2020-03-27 06:24:22.326825 I  Marking episode last showings.
> 2020-03-27 06:24:22.746125 I      Found 14948
>
Yeap, looks like one of my runs but I only have 8 unknown xmltv channel
identifiers. When I do the option 5 in --manage-lineups I select only
the channels I care about. I leave out foreign language and religious
channels. Those channels are also tagged as not visible in the Channel
Editor.  Not sure if those are the ones that cause the skipping channel
messages.  Either way. I get the 33 channels I care about with their EPG
listed for 18 days.

Jim A


_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org

On 3/27/20 7:00 AM, Jim Abernathy wrote:
>
> On 3/27/20 7:27 AM, Jack McGee wrote:
>>
>> On 3/27/20 4:20 AM, Jim Abernathy wrote:
>>>
>>> For me using either networked tuners or PCIe tuners I would setup
>>> the first Input Connection by entering the Video Source name to
>>> match and make sure it also matched what I did external from
>>> mythtv-setup. In my case 'SD'. The Scan for channels was uses as is,
>>> sometimes I'd set the channel scan range to eliminate the scan of
>>> the channels above which I know I won't find any.
>>>
>>>
>> Thanks Jim.
>>
>>
>> I ran scan for channels, inserted all.
>>
>> Then per you guide, started mythtv backend, and ran mythfilldatabase:
>>
>> It starts normally:
>>
>> mythuser@amethi:~/.mythtv$ sudo su mythtv
>> $ mythfilldatabase
>> 2020-03-27 06:19:25.597409 C  mythfilldatabase version:  [v29.1]
>> www.mythtv.org
>> 2020-03-27 06:19:25.597424 C  Qt version: compile: 5.9.5, runtime: 5.9.5
>> 2020-03-27 06:19:25.597425 N  Enabled verbose msgs:  general
>> 2020-03-27 06:19:25.597432 N  Setting Log Level to LOG_INFO
>> 2020-03-27 06:19:25.607799 I  Added logging to the console
>> 2020-03-27 06:19:25.608070 I  Setup Interrupt handler
>> 2020-03-27 06:19:25.608075 I  Setup Terminated handler
>> 2020-03-27 06:19:25.608081 I  Setup Segmentation fault handler
>> 2020-03-27 06:19:25.608084 I  Setup Aborted handler
>> 2020-03-27 06:19:25.608089 I  Setup Bus error handler
>> 2020-03-27 06:19:25.608092 I  Setup Floating point exception handler
>> 2020-03-27 06:19:25.608097 I  Setup Illegal instruction handler
>> 2020-03-27 06:19:25.608107 I  Setup Real-time signal 0 handler
>> 2020-03-27 06:19:25.608112 I  Setup Hangup handler
>> 2020-03-27 06:19:25.608189 N  Using runtime prefix = /usr
>> 2020-03-27 06:19:25.608191 N  Using configuration directory =
>> /home/mythtv/.mythtv
>> 2020-03-27 06:19:25.608233 I  Assumed character encoding: en_US.UTF-8
>> 2020-03-27 06:19:25.608439 N  Empty LocalHostName.
>> 2020-03-27 06:19:25.608443 I  Using localhost value of amethi
>> 2020-03-27 06:19:25.608476 I  Start up testing connections. DB
>> 192.168.1.105, BE , attempt 0, status dbAwake
>> 2020-03-27 06:19:26.120815 N  Setting QT default locale to EN_US
>> 2020-03-27 06:19:26.120822 I  Current locale EN_US
>> 2020-03-27 06:19:26.120852 N  Reading locale defaults from
>> /usr/share/mythtv//locales/en_us.xml
>> 2020-03-27 06:19:26.125965 I  Loading en_us translation for module
>> mythfrontend
>> 2020-03-27 06:19:26.127385 I  Current MythTV Schema Version
>> (DBSchemaVer): 1348
>> 2020-03-27 06:19:26.129779 I MythCoreContext::ConnectCommandSocket():
>> Connecting to backend server: 192.168.1.105:6543 (try 1 of 1)
>> 2020-03-27 06:19:26.130703 I MythCoreContext::CheckProtoVersion():
>> Using protocol version 91 BuzzOff
>> 2020-03-27 06:19:26.130902 I  Opening blocking connection to master
>> backend
>> 2020-03-27 06:19:26.138610 I  Updating source #1 (SD) with grabber
>> tv_grab_zz_sdjson_sqlite
>> 2020-03-27 06:19:26.139047 I  No channels are configured to use grabber.
>> 2020-03-27 06:19:26.139319 I  Starting process manager
>> 2020-03-27 06:19:26.140076 I  Starting IO manager (read)
>> 2020-03-27 06:19:26.140126 I  Starting process signal handler
>> 2020-03-27 06:19:26.140245 I  Starting IO manager (write)
>> 2020-03-27 06:19:26.741158 I  Grabber has capabilities: baseline
>> manualconfig preferredmethod lineups apiconfig
>> 2020-03-27 06:19:27.241881 I  Grabber prefers method: allatonce
>> 2020-03-27 06:19:27.242539 I  XMLTV config file is:
>> /home/mythtv/.mythtv/SD.xmltv
>> 2020-03-27 06:20:48.346124 N  Unknown xmltv channel identifier:
>> I100147.json.schedulesdirect.org - Skipping channel.
>> 2020-03-27 06:20:48.346434 N  Unknown xmltv channel identifier:
>> I100561.json.schedulesdirect.org - Skipping channel.
>> (snip)
>>
>> whole bunch of these
>>
>>
>> 2020-03-27 06:24:21.006700 N  Unknown xmltv channel identifier:
>> I99986.json.schedulesdirect.org - Skipping channel.
>> 2020-03-27 06:24:21.006710 I  Updated programs: 33938 Unchanged
>> programs: 0
>> 2020-03-27 06:24:21.397597 N  Data fetching complete.
>> 2020-03-27 06:24:21.397618 I  Adjusting program database end times.
>> 2020-03-27 06:24:21.397825 I      0 replacements made
>> 2020-03-27 06:24:21.397858 I  Marking generic episodes.
>> 2020-03-27 06:24:21.552867 I      Found 9312
>> 2020-03-27 06:24:21.552873 I  Extending non-unique programids with
>> multiple parts.
>> 2020-03-27 06:24:21.567857 I      Found 0
>> 2020-03-27 06:24:21.567862 I  Fixing missing original airdates.
>> 2020-03-27 06:24:21.731860 I      Found 588 with programids
>> 2020-03-27 06:24:21.732823 I      Found 0 without programids
>> 2020-03-27 06:24:21.732827 I  Marking repeats.
>> 2020-03-27 06:24:21.749906 I      Found 407
>> 2020-03-27 06:24:21.749912 I  Unmarking new episode rebroadcast repeats.
>> 2020-03-27 06:24:21.846357 I      Found 587
>> 2020-03-27 06:24:22.013319 I  Marking episode first showings.
>> 2020-03-27 06:24:22.326818 I      Found 14986
>> 2020-03-27 06:24:22.326825 I  Marking episode last showings.
>> 2020-03-27 06:24:22.746125 I      Found 14948
>>
> Yeap, looks like one of my runs but I only have 8 unknown xmltv
> channel identifiers. When I do the option 5 in --manage-lineups I
> select only the channels I care about. I leave out foreign language
> and religious channels. Those channels are also tagged as not visible
> in the Channel Editor.  Not sure if those are the ones that cause the
> skipping channel messages.  Either way. I get the 33 channels I care
> about with their EPG listed for 18 days.
>
> Jim A
>
>
Jim, thanks a bunch for the guide! That got me sorted.
_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org

On 2020-03-27 2:14 p.m., Jack McGee wrote:
>
>>> 2020-03-27 06:19:26.741158 I  Grabber has capabilities: baseline
>>> manualconfig preferredmethod lineups apiconfig
>>> 2020-03-27 06:19:27.241881 I  Grabber prefers method: allatonce
>>> 2020-03-27 06:19:27.242539 I  XMLTV config file is:
>>> /home/mythtv/.mythtv/SD.xmltv
>>> 2020-03-27 06:20:48.346124 N  Unknown xmltv channel identifier:
>>> I100147.json.schedulesdirect.org - Skipping channel.
>>> 2020-03-27 06:20:48.346434 N  Unknown xmltv channel identifier:
>>> I100561.json.schedulesdirect.org - Skipping channel.
>>> (snip)
>>>
>>> whole bunch of these
>>>
>>>
>>> 2020-03-27 06:24:21.006700 N  Unknown xmltv channel identifier:

My previous response seems to have been lost due to the detour into
whether the grabber was running. This output shows that it is running.

2020-03-27 06:19:27.242539 I XMLTV config file is:
/home/mythtv/.mythtv/SD.xmltv
2020-03-27 06:20:48.346124 N Unknown xmltv channel identifier:
I100147.json.schedulesdirect.org - Skipping channel.
2020-03-27 06:20:48.346434 N Unknown xmltv channel identifier:
I100561.json.schedulesdirect.org - Skipping channel.

THIS output shows where the error lies.

Edit your SD.xmltv file and try setting the wanted channel entries to
the format:
channel=100147
channel!100148 etc.

and re-run /usr/bin/mythfilldatabase.
Your setup is contacting the server, and downloading updates, but does
not know where to put them, as it does not recognize the channel format.
So, in the end, it deletes the updates.

Geoff


--
R. Geoffrey Newbury
954 Owenwood Drive
Mississauga, Ontario, L5H 3J2

416-854-8160 newbury@mandamus.org

_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org

On 3/28/20 10:51 AM, R. G. Newbury wrote:
> On 2020-03-27 2:14 p.m., Jack McGee wrote:
>>
>>>> 2020-03-27 06:19:26.741158 I  Grabber has capabilities: baseline
>>>> manualconfig preferredmethod lineups apiconfig
>>>> 2020-03-27 06:19:27.241881 I  Grabber prefers method: allatonce
>>>> 2020-03-27 06:19:27.242539 I  XMLTV config file is:
>>>> /home/mythtv/.mythtv/SD.xmltv
>>>> 2020-03-27 06:20:48.346124 N  Unknown xmltv channel identifier:
>>>> I100147.json.schedulesdirect.org - Skipping channel.
>>>> 2020-03-27 06:20:48.346434 N  Unknown xmltv channel identifier:
>>>> I100561.json.schedulesdirect.org - Skipping channel.
>>>> (snip)
>>>>
>>>> whole bunch of these
>>>>
>>>>
>>>> 2020-03-27 06:24:21.006700 N  Unknown xmltv channel identifier:
>
> My previous response seems to have been lost due to the detour into
> whether the grabber was running. This output shows that it is running.
>
> 2020-03-27 06:19:27.242539 I  XMLTV config file is:
> /home/mythtv/.mythtv/SD.xmltv
> 2020-03-27 06:20:48.346124 N  Unknown xmltv channel identifier:
> I100147.json.schedulesdirect.org - Skipping channel.
> 2020-03-27 06:20:48.346434 N  Unknown xmltv channel identifier:
> I100561.json.schedulesdirect.org - Skipping channel.
>
> THIS output shows where the error lies.
>
> Edit your SD.xmltv file and try setting the wanted channel entries to
> the format:
> channel=100147
> channel!100148 etc.
>
> and re-run /usr/bin/mythfilldatabase.
> Your setup is contacting the server, and downloading updates, but does
> not know where to put them, as it does not recognize the channel
> format. So, in the end, it deletes the updates.
>
>
thanks. How do I edit that?

mythuser@amethi:~/.mythtv$ cat SD.xmltv
database=/home/mythuser/.xmltv/SchedulesDirect.DB
lineup=USA-OTA-76111
3rdparty-metadata=disabled
mythtv-categories=enabled


mythuser@amethi:~/.xmltv$ ls
SchedulesDirect.DB  tv_grab_zz_sdjson.cache tv_grab_zz_sdjson_sqlite.conf




_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org

On 2020-03-28 1:28 p.m., Jack McGee wrote:
>
> On 3/28/20 10:51 AM, R. G. Newbury wrote:
>> On 2020-03-27 2:14 p.m., Jack McGee wrote:
>>>
>>>>> 2020-03-27 06:19:26.741158 I  Grabber has capabilities: baseline
>>>>> manualconfig preferredmethod lineups apiconfig
>>>>> 2020-03-27 06:19:27.241881 I  Grabber prefers method: allatonce
>>>>> 2020-03-27 06:19:27.242539 I  XMLTV config file is:
>>>>> /home/mythtv/.mythtv/SD.xmltv
>>>>> 2020-03-27 06:20:48.346124 N  Unknown xmltv channel identifier:
>>>>> I100147.json.schedulesdirect.org - Skipping channel.
>>>>> 2020-03-27 06:20:48.346434 N  Unknown xmltv channel identifier:
>>>>> I100561.json.schedulesdirect.org - Skipping channel.
>>>>> (snip)
>>>>>
>>>>> whole bunch of these
>>>>>
>>>>>
>>>>> 2020-03-27 06:24:21.006700 N  Unknown xmltv channel identifier:
>>
>> My previous response seems to have been lost due to the detour into
>> whether the grabber was running. This output shows that it is running.
>>
>> 2020-03-27 06:19:27.242539 I  XMLTV config file is:
>> /home/mythtv/.mythtv/SD.xmltv
>> 2020-03-27 06:20:48.346124 N  Unknown xmltv channel identifier:
>> I100147.json.schedulesdirect.org - Skipping channel.
>> 2020-03-27 06:20:48.346434 N  Unknown xmltv channel identifier:
>> I100561.json.schedulesdirect.org - Skipping channel.
>>
>> THIS output shows where the error lies.
>>
>> Edit your SD.xmltv file and try setting the wanted channel entries to
>> the format:
>> channel=100147
>> channel!100148 etc.
>>
>> and re-run /usr/bin/mythfilldatabase.
>> Your setup is contacting the server, and downloading updates, but does
>> not know where to put them, as it does not recognize the channel
>> format. So, in the end, it deletes the updates.
>>
>>
> thanks. How do I edit that?
>
> mythuser@amethi:~/.mythtv$ cat SD.xmltv
> database=/home/mythuser/.xmltv/SchedulesDirect.DB
> lineup=USA-OTA-76111
> 3rdparty-metadata=disabled
> mythtv-categories=enabled

Wow. My OTA.xmltv file looks like this:
cache=/home/mythtv/.xmltv/tv_grab_zz_sdjson.cache
channel-id-format=default
previously-shown-format=datetime
username=xxxxxxxx
password=xxxxxxxxxx
mode=channels
channels!CAN-0005580-X
channels!CAN-OTA-L5H3J2
channels=USA-OTA-14174
channel=31507
channel=24051 etc.
and a whack of
channel!12345 lines for the 20 odd I don't get or want.

> mythuser@amethi:~/.xmltv$ ls
> SchedulesDirect.DB  tv_grab_zz_sdjson.cache tv_grab_zz_sdjson_sqlite.conf

My conf file looks like thi:
cache=/home/mythtv/.xmltv/tv_grab_zz_sdjson.cache
channel-id-format=mythtv
previously-shown-format=datetime
username=xxxxxxxxxxxxxxx
password=xxxxxxxxxx
mode=lineup
lineup=CAN-0005580-X
lineup=CAN-OTA-L5H3J2
lineup=USA-OTA-14174

Your use of the sqlite grabber makes things slightly different.

The BIG thing is that you have no channels listd in the xmltv file.
There quick route is to run a channel scan from mythtv-setup and then
edit the xmltv file to allow/delete the channels you do not want. Then
run mythfilldatabase, which is supposed to fill in everything, but in my
experience (quite likely because I didn't do things in the correct
order) you may have to use the Channel Editor in mythtv-setup, to check
(and enter) details for each channel you want to receive. In my case,
the actual xmltv id was missed and some channels were set to receive EIT
(what??).

The foregoing paragraph MAY be entirely wrong because the sqlite grabber
puts everything in the database. I do not know as I do not use the
sqlite version. BUT in that case, run the grabber from a console, using
the --configure option, and follow the prompts *exactly*. It is clear
that you have a mismatch somewhere and the setup needs to be re-done.

In my setup, all three lineup's xmltvid files use the 'channel=31507'
format, but the format recorded in the xmltvid column of the 'channel'
table in mythconverg depends upon the 'channel-id-format' line of the
xmltvid file.
A 'channel-id-format=mythtv' setting has the channels listed with a bare
31507 in the channel table, while a channel-id-format=default' uses the
full I31507.json.schedulesdirect.org format. You MAY be able to fix
things by editing the xmltvid file to use the default format (but I
would not bet much on that..).

BTW, with three lineups and 72 channels, my cache file is 45MB, so it
does take a while to run an update.

Geoff









--
R. Geoffrey Newbury
954 Owenwood Drive
Mississauga, Ontario, L5H 3J2

416-854-8160 newbury@mandamus.org

_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org

On Thu, Apr 16, 2020 at 2:27 PM Simon Hobson <linux@thehobsons.co.uk> wrote:

> DaveD <mythtv@guiplot.com> wrote:
>
> > I have two lineups; OTA and Comcast cable. The OTA is no big deal, but
> the Comcast lineup sucks. It has almost 600 channels, many of which are
> wrong (don't come in at all or channels we DO get aren't listed), but for
> the most part, the ones we watch are ok. The problem lies in that fact
> that we had to go through all 500+ channels and manually disable the
> On-Demand, and premium channels and low def channels and FM radio channels,
> etc, etc. The way we did that was suggested in the Wiki where you take the
> SD.xml file with the channel!<ID> (ones you don't want) vs channel=<ID>
> (ones you do want) and edit that with a text editor (similar procedure for
> the sqlite DB) changing the "=" to a "!" on ones you don't want and vise
> verse on one you do want.
> >
> > That SD.xml file is used when you run mythfilldatabase to determine
> which channels it gets listing data for. Unfortunately, it still creates
> all the channels from the lineup in the mythconverg channel table, it just
> doesn't pull any data for the "deselected" channels. Since the channels
> table has a default "visible" value of 1, I ended up with all these "No
> Data" channels in my listings. YUCK!
> >
> > What I wound up doing was grep for all the "channel!" in the .xml file
> and output that to a file which I edited into an SQL query to set visible=0
> where xmltvid=xxxx and ORed the hundreds of channels I didn't want. I
> ended up with two files; one to set visible=1 on the channels with "=" and
> one to set visible=0 on the channels with "!". All the useless channels
> are still there, happily created by mithfilldatabase, they just have no
> data. After running my queries, at least the unused ones don't show up in
> the listings (except where the lineup has errors).
> >
> > Don't know if any of this helps, but it's what I've done and figured I'd
> share FWIW.
>
> have a look at https://www.mythtv.org/wiki/Database_editing_script
> It takes some setting up as you need to work through your channels working
> out the IDs for the channels you want to see, but once setup you can reset
> your channels quickly every time you rescan.
>
> Then, what I do is dynamically build the xmltv config file by querying the
> database for a list of channel IDs where visible=1. Doing it this way means
> only one place to maintain things - less work and automatically in-sync.
>
>
> #!/bin/bash
>
> base="/var/lib/mythtv/.xmltv"
> conf="${base}/tv_grab_sd_json.conf"
> xmlfile="${base}/listings.xml"
> xmlfile2="${base}/sd.xml"
>
> rm ${conf} ${xmlfile} ${xmlfile2} 2>/dev/null
>
> cp ${conf}.base ${conf}
>
> mysql --host=localhost --user=mythtv --database=mythconverg
> --password='*****' \
> -e "select distinct(xmltvid) from channel where visible=1 and
> useonairguide=0 order by xmltvid ;" |
> grep '[0-9][0-9][0-9][0-9][0-9]' |
> sed -e 's/^/channel=/' >> ${conf}
>
> /usr/bin/tv_grab_zz_sdjson --config-file ${conf} --output ${xmlfile}
> /usr/bin/tv_grep --output ${xmlfile2} --not --title 'To Be Announced'
> ${xmlfile}
>
> mythfilldatabase --only-update-guide --sourceid 1 --file --xmlfile
> ${xmlfile2} 2>&1 | grep -v 'Ignoring unknown timestamp format'
>
>
> As a quick hack, I get a list of channels and their IDs for my lineup with
> a short script. That gives me a relatively small file containing a list of
> channels that I can search to match up the names as found during the scan
> with the names as used by Schedules Direct.
>
> #!/bin/bash
> # Get full xml listing and extract channel-ids & names
>
> base="/var/lib/mythtv/.xmltv"
> conf="${base}/tv_grab_sd_json.conf"
> chan_file="${base}/channels"
>
> rm ${conf}.full ${chan_file}.txt ${chan_file}.xml 2>/dev/null
>
> sed -e 's/channels/lineup/' < ${conf}.base > ${conf}.full
>
> tv_grab_zz_sdjson --config-file ${conf}.full --days 0 --output
> ${chan_file}.xml
> grep 'channel id
> display-name' < ${chan_file}.xml > ${chan_file}.txt
>
>
> Simon
>
>
This thread may be relevant: https://lists.gt.net/mythtv/users/627930


_______________________________________________
> mythtv-users mailing list
> mythtv-users@mythtv.org
> http://lists.mythtv.org/mailman/listinfo/mythtv-users
> http://wiki.mythtv.org/Mailing_List_etiquette
> MythTV Forums: https://forum.mythtv.org
>