Mailing List Archive: Compiling EPG data

Compiling EPG data

Oct 31, 2006, 1:14 AM

Post #1 of 11 (3299 views)

Hi all,

With the hairy EPG ending and my DVB-S cards arriving I'm looking at grabbing
my own data.

I've been having a play with tv_grab_dvb and the epgsnoop.py script that was
posted recently (if anyone has a copy of the modified version of tv_grab_dvb
that Steve posted the other day I'd love to have a look at it).

They don't seem to hard to use, and I think I can put something together
relatively easily. The output that epgsnoop.py generates seems to be in a
different format (not XMLTV?). I like that script because it's python and I'm
happy hacking python to do what I want.

I'm guessing if I want to create a full listing like that on hairy then I need
to loop through and tune to each transponder and then use tv_grab_dvb or
epgsnoop? Then concatenate all the outputs together to create one master
file?

Any pointers would be great.

Cheers,

hads

--
http://nicegear.co.nz
New Zealand's VoIP Supplier

_______________________________________________
mythtvnz mailing list
mythtvnz@lists.linuxnut.co.nz
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

Re: Compiling EPG data [ In reply to ]

mythtvnz at hotblack

Oct 31, 2006, 3:41 AM

Post #2 of 11 (3214 views)

Permalink

>Hi all,
>
>With the hairy EPG ending and my DVB-S cards arriving I'm looking at grabbing
>my own data.
>
>I've been having a play with tv_grab_dvb and the epgsnoop.py script that was
>posted recently (if anyone has a copy of the modified version of tv_grab_dvb
>that Steve posted the other day I'd love to have a look at it).
>
>They don't seem to hard to use, and I think I can put something together
>relatively easily. The output that epgsnoop.py generates seems to be in a
>different format (not XMLTV?). I like that script because it's python and I'm
>happy hacking python to do what I want.
>
>I'm guessing if I want to create a full listing like that on hairy then I need
>to loop through and tune to each transponder and then use tv_grab_dvb or
>epgsnoop? Then concatenate all the outputs together to create one master
>file?
>
>Any pointers would be great.
>
>Cheers,
>
>hads
>
>--
>http://nicegear.co.nz
>New Zealand's VoIP Supplier

There used to be info on pvr.geek.nz on how to grab EPG. The basics
of it were something like:

NEWFILE=/tmp/listings-$$.xml
/usr/local/bin/dvbstream -s 22500 -o:/dev/null -f 1219 -p v -n 60 8192 &
/usr/local/bin/tv_grab_dvb -s -o 12 > $NEWFILE
killall dvbstream
mythfilldatabase --no-delete --file 2 -1 $NEWFILE

Or you can have a squiz at a copy of a script that I posted a while back:

http://www.gossamer-threads.com/lists/mythtv/mythtvnz/215004#215004

- Wade

_______________________________________________
mythtvnz mailing list
mythtvnz@lists.linuxnut.co.nz
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

Re: Compiling EPG data [ In reply to ]

mythtvnz at nice

Oct 31, 2006, 11:43 AM

Post #3 of 11 (3187 views)

Permalink

On Wednesday 01 November 2006 00:41, Wade Maxfield wrote:
> There used to be info on pvr.geek.nz on how to grab EPG. The basics
> of it were something like:
>
> NEWFILE=/tmp/listings-$$.xml
> /usr/local/bin/dvbstream -s 22500 -o:/dev/null -f 1219 -p v -n 60 8192 &
> /usr/local/bin/tv_grab_dvb -s -o 12 > $NEWFILE
> killall dvbstream
> mythfilldatabase --no-delete --file 2 -1 $NEWFILE
>
>
> Or you can have a squiz at a copy of a script that I posted a while back:
>
> http://www.gossamer-threads.com/lists/mythtv/mythtvnz/215004#215004

Thanks Wade,

I saw the page at pvr.geek but I assumed that each transponder would only
carry EPG for it's own channels. After comparing the output from the hairy
feed and my own grab from 12.671 (using tv_split) they appear to contain the
same number of channels (106 or so). I guess I just assumed wrong.

Cheers all,

hads

--
http://nicegear.co.nz
New Zealand's VoIP supplier

_______________________________________________
mythtvnz mailing list
mythtvnz@lists.linuxnut.co.nz
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

Re: Compiling EPG data [ In reply to ]

stevehodge at gmail

Nov 1, 2006, 10:02 PM

Post #4 of 11 (3195 views)

Permalink

On 10/31/06, Hadley Rich <mythtvnz@nice.net.nz> wrote:
> (if anyone has a copy of the modified version of tv_grab_dvb
> that Steve posted the other day I'd love to have a look at it).

I'll send you a copy once I'm back in NZ next week. Remind me if I
forget. Btw, if anyone wants to host a copy somewhere, let me know.

Cheers,
Steve

_______________________________________________
mythtvnz mailing list
mythtvnz@lists.linuxnut.co.nz
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

Re: Compiling EPG data [ In reply to ]

nick.read at engineer

Nov 1, 2006, 10:47 PM

Post #5 of 11 (3206 views)

Permalink

> Btw, if anyone wants to host a copy somewhere, let me know.

www.mythtv.co.nz?

--
No virus found in this outgoing message.
Checked by AVG Free Edition.
Version: 7.1.409 / Virus Database: 268.13.21/509 - Release Date: 31/10/2006

_______________________________________________
mythtvnz mailing list
mythtvnz@lists.linuxnut.co.nz
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

Re: Compiling EPG data [ In reply to ]

mythtvnz at hotblack

Nov 1, 2006, 10:55 PM

Post #6 of 11 (3198 views)

Permalink

>On 10/31/06, Hadley Rich <mythtvnz@nice.net.nz> wrote:
>>(if anyone has a copy of the modified version of tv_grab_dvb
>>that Steve posted the other day I'd love to have a look at it).
>
>I'll send you a copy once I'm back in NZ next week. Remind me if I
>forget. Btw, if anyone wants to host a copy somewhere, let me know.
>
>Cheers,
>Steve
>

If it's the one that outputs the categories, I'd be interested in
checking it out. I currently have a modified version spitting out a
feed at http://epg.hotblack.co.nz/listings_beta.xml.gz at the
moment, but the channel IDs are coming through as 1032.UNKNOWN rather
than 1032.dvb.guide. So using this new file with the categories
unfortunately won't be a drop in replacement for the main file.

Using the -c chanidents when running the modified tv_grab_dvb to
rectify this, causes my copy to segfault, so 1032.UNKNOWN is as good
as it's going to get for the moment.

But I can chuck a copy of the script up there if you like.

- Wade

_______________________________________________
mythtvnz mailing list
mythtvnz@lists.linuxnut.co.nz
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

Re: Compiling EPG data [ In reply to ]

steven at openmedia

Nov 1, 2006, 10:56 PM

Post #7 of 11 (3181 views)

Permalink

Nick & Ann Read wrote:
>> Btw, if anyone wants to host a copy somewhere, let me know.
>>
>
>
>
> www.mythtv.co.nz?
>
More than happy to host the scripts :)

EPG data might be another matter for the moment.

Steve

--
Steven Ellis - Technical Director
OpenMedia Limited
email - steven@openmedia.co.nz
sales - sales@openmedia.co.nz
support - support@openmedia.co.nz
website - http://www.openmedia.co.nz

_______________________________________________
mythtvnz mailing list
mythtvnz@lists.linuxnut.co.nz
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

Compiling EPG data [ In reply to ]

toby at np

Nov 2, 2006, 5:41 PM

Post #8 of 11 (3186 views)

Permalink

Does anyone know how the service-ids file is generated....
http://hairy.geek.nz/epg/service-ids.txt

This has been really useful and if David's site is going down I'd like to
replicate and put somewhere.

Toby

_______________________________________________
mythtvnz mailing list
mythtvnz@lists.linuxnut.co.nz
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

Re: Compiling EPG data [ In reply to ]

david.zanetti at catalyst

Nov 5, 2006, 1:11 PM

Post #9 of 11 (3167 views)

Permalink

On Fri, 2006-11-03 at 14:41 +1300, Toby Mills wrote:
> Does anyone know how the service-ids file is generated....
> http://hairy.geek.nz/epg/service-ids.txt
>
> This has been really useful and if David's site is going down I'd like to
> replicate and put somewhere.

It's a really hackish script I have that is parsing the output of scan.
I should re-write it to export more useful information based on parsing
the data from dvbsnoop.

On that supply of data, I've secured a sat feed for the foreseable
future, the EPG data and service IDs will remain. Will need to be
re-arranged a bit in how it's sourced, but the URLs won't change.

--
David Zanetti <david.zanetti@catalyst.net.nz>
Systems Architect
Catalyst IT Limited
+64-4-8032233 +64-21-402260

Re: Compiling EPG data [ In reply to ]

nick.read at engineer

Nov 5, 2006, 3:17 PM

Post #10 of 11 (3158 views)

Permalink

Quoting David Zanetti <david.zanetti@catalyst.net.nz>:

> On that supply of data, I've secured a sat feed for the foreseable
> future, the EPG data and service IDs will remain. Will need to be
> re-arranged a bit in how it's sourced, but the URLs won't change.

New Zealand thanks you! :-)

_______________________________________________
mythtvnz mailing list
mythtvnz@lists.linuxnut.co.nz
http://lists.ourshack.com/mailman/listinfo/mythtvnz
Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

Re: Compiling EPG data [ In reply to ]

jsmoore at orcon

Nov 8, 2006, 12:31 AM

Post #11 of 11 (3126 views)

Permalink

David,

Thanks very much for keeping the EPG feed going.
It is greatly appreciated by many.

Regards
John Moore

David Zanetti wrote:

On Fri, 2006-11-03 at 14:41 +1300, Toby Mills wrote:
Does anyone know how the service-ids file is generated.... http://hairy.geek.nz/epg/service-ids.txt"]http://hairy.geek.nz/epg/service-ids.txt This has been really useful and if David's site is going down I'd like to replicate and put somewhere.
It's a really hackish script I have that is parsing the output of scan. I should re-write it to export more useful information based on parsing the data from dvbsnoop. On that supply of data, I've secured a sat feed for the foreseable future, the EPG data and service IDs will remain. Will need to be re-arranged a bit in how it's sourced, but the URLs won't change.

_______________________________________________ mythtvnz mailing list mythtvnz@lists.linuxnut.co.nz http://lists.ourshack.com/mailman/listinfo/mythtvnz Archives http://www.gossamer-threads.com/lists/mythtv/mythtvnz/

Mailing List Archive

Mailing List Archive

Attached Files: