DataDirect replacement service going live!

Forum rules
Get Help using the Schedules Direct service. NOTE: application issues are probably better resolved via the application's support methods. If you post here, at least include your application name!
Post Reply
SFischer1
Posts: 19
Joined: Thu Aug 23, 2007 12:40 am

Re: DataDirect replacement service going live!

Post by SFischer1 » Sun Oct 19, 2014 10:33 pm

OK, so an approved application last updated (12/25/10) will stop working some time on or after Nov 1, 2014.

And adding a line to "hosts" will not change this as "the domain name can go away at any time".

SHF

rmeden
SD Board Member
Posts: 1526
Joined: Tue Aug 14, 2007 2:31 pm
Location: Cedar Hill, TX
Contact:

Re: DataDirect replacement service going live!

Post by rmeden » Sun Oct 19, 2014 10:39 pm

SFischer1 wrote:OK, so an approved application last updated (12/25/10) will stop working some time on or after Nov 1, 2014.

And adding a line to "hosts" will not change this as "the domain name can go away at any time".
No. The hosts file change bypasses the domain name system so you can keep going even if the domain goes away.

My goal is the old application can work with the new server. No guarantees, but I am trying!

bill6502
Posts: 16
Joined: Fri Sep 19, 2014 4:52 pm

Re: DataDirect replacement service going live!

Post by bill6502 » Mon Oct 20, 2014 6:52 am

mattlach wrote:An excerpt of my mythfilldatabase output:

Code: Select all

2014-10-19 18:41:01.679139 I  Found 740 channels for source 1 which use grabber
Just FYI, the 740 is the number of entries in the MythTV channel table
that have an XMLTVID entry. The actual query in this case is:

Code: Select all

SELECT COUNT(chanid) FROM channel WHERE sourceid = 1 AND xmltvid != '';
How they got there is another story.

mattlach
Posts: 16
Joined: Mon Jun 23, 2014 10:46 am

Re: DataDirect replacement service going live!

Post by mattlach » Mon Oct 20, 2014 6:56 am

rmeden wrote:
mattlach wrote:
rmeden wrote:Matt, I don't know your SD username to check the DB.
Username is mattlach
Duh.. I thought I tried to look that up.

I show 662 stations excluded. Are you still seeing the stations in your download?

If you are try editing your SD lineup, just click save, and test again.

Will try that, thank you.

--Matt

mattlach
Posts: 16
Joined: Mon Jun 23, 2014 10:46 am

Re: DataDirect replacement service going live!

Post by mattlach » Mon Oct 20, 2014 7:04 am

bill6502 wrote:
mattlach wrote:An excerpt of my mythfilldatabase output:

Code: Select all

2014-10-19 18:41:01.679139 I  Found 740 channels for source 1 which use grabber
Just FYI, the 740 is the number of entries in the MythTV channel table
that have an XMLTVID entry. The actual query in this case is:

Code: Select all

SELECT COUNT(chanid) FROM channel WHERE sourceid = 1 AND xmltvid != '';
How they got there is another story.
Thank you for that info.

I don't know how to do sql queries to save my life. I just run the pre-written scripts.

Does the mythfilldatabase script output that at any point?

So I just edited and saved my SD exclusions again, and re-ran mythfilldatabase, and everything is still there.

Will the added channels remove themselves once this is resolved, or do I need to delete all my channels and repopulate them? (This would be a bummer, as I edited the text on some channels to make them easier to identify, where the callsigns were unclear)

Appreciate the help!

--Matt

bill6502
Posts: 16
Joined: Fri Sep 19, 2014 4:52 pm

Re: DataDirect replacement service going live!

Post by bill6502 » Mon Oct 20, 2014 10:14 am

mattlach wrote: ...
I don't know how to do sql queries to save my life. I just run the pre-written scripts.
...
Does the mythfilldatabase script output that at any point?
...
Hi,

The query I mentioned earlier is the actual one used by the program
when it tells you "Found 740 channels...". So, there's no need to run
mysql yourself. Perhaps long ago you had all of them selected. They
remain populated in the MythTV DB.

For example, at one time I had STZCHD (XMLTVID 57569) selected
in my SD lineups. Now I don't. But, MythTV still has that channel defined
with the XMLTVID. When I look at the raw data downloaded from
(the new) SD, that XMLTVID isn't there. As I would expect. If you know
that you're getting schedule data for some of all of the channels you've
de-selected (by looking in the MythTV Program Guide), then that's one
for Robert. Based on what you've posted here, it looks like MythTV is
doing what it should.

rmeden
SD Board Member
Posts: 1526
Joined: Tue Aug 14, 2007 2:31 pm
Location: Cedar Hill, TX
Contact:

Re: DataDirect replacement service going live!

Post by rmeden » Mon Oct 20, 2014 10:16 am

mattlach wrote:
bill6502 wrote:
mattlach wrote:An excerpt of my mythfilldatabase output:
So I just edited and saved my SD exclusions again, and re-ran mythfilldatabase, and everything is still there.
I don't think looking at the MythTV database table is he best way to troubleshoot or even confirm the problem still exists. It may only show that it happened at one time. I'll let the MythTV folks figure that out... I think there's a file in /tmp with the raw data to check. (I would look at the number of <map> entries )

Note to all: I've updated the OP with info on bypassing Tribune's DNS changes.

mattlach
Posts: 16
Joined: Mon Jun 23, 2014 10:46 am

Re: DataDirect replacement service going live!

Post by mattlach » Mon Oct 20, 2014 1:46 pm

bill6502 wrote:
mattlach wrote: ...
I don't know how to do sql queries to save my life. I just run the pre-written scripts.
...
Does the mythfilldatabase script output that at any point?
...
Hi,

The query I mentioned earlier is the actual one used by the program
when it tells you "Found 740 channels...". So, there's no need to run
mysql yourself. Perhaps long ago you had all of them selected. They
remain populated in the MythTV DB.

For example, at one time I had STZCHD (XMLTVID 57569) selected
in my SD lineups. Now I don't. But, MythTV still has that channel defined
with the XMLTVID. When I look at the raw data downloaded from
(the new) SD, that XMLTVID isn't there. As I would expect. If you know
that you're getting schedule data for some of all of the channels you've
de-selected (by looking in the MythTV Program Guide), then that's one
for Robert. Based on what you've posted here, it looks like MythTV is
doing what it should.
Well, starting with my original install in June I configured it to only have 78 channels visible in the channel browser.

After the schedulesdirect update that night all of a sudden all 740 channels appeared in the channel browser. (662 of which I either don't have, or are SD versions of HD channels I have, and I didn't want them showing up.)

If I had to guess some problem caused the exclusions not to work during my update the other night, and MythTV dutifully received all the channel data, and created channels for everything.

I can't confirm if it is currently doing this or, if it was a one time thing, and the channels still remain. I will try looking somewhere in /tmp as suggested.

Do they disappear on their own, if they no longer have data? Since SD populates 14 days of data, I should expect them to be there until those 14 days after the last SD update for which exclusions did not work, yes? Is this how it works?

mattlach
Posts: 16
Joined: Mon Jun 23, 2014 10:46 am

Re: DataDirect replacement service going live!

Post by mattlach » Mon Oct 20, 2014 1:58 pm

rmeden wrote: I don't think looking at the MythTV database table is he best way to troubleshoot or even confirm the problem still exists. It may only show that it happened at one time. I'll let the MythTV folks figure that out... I think there's a file in /tmp with the raw data to check. (I would look at the number of <map> entries )

Thank you for this.

In /tmp I have a file named mythtv_ddp_data. Does this sound like the correct file? it's some sort of XML formatted file.

If I grep out the <map station='xxxxx'... tags, there are 742 of them, two more than would have been expected if it was grabbing all 740 channels. (odd?)

That being said, the file is dated October 18th at 10:06pm (EST). In troubleshooting this issue I ran mythfilldatabase several times yesterday, so it is odd there wouldn't be a more recent file...

bill6502
Posts: 16
Joined: Fri Sep 19, 2014 4:52 pm

Re: DataDirect replacement service going live!

Post by bill6502 » Mon Oct 20, 2014 2:56 pm

mattlach wrote: In /tmp I have a file named mythtv_ddp_data. Does this sound like the correct file? ...
It is, in this case. The fact that it's still there is a bug that has been fixed in 0.28-pre.
For a 'sure-fire' method of finding the file, watch the mythfilldatabase output and
look for a line that contains:

Code: Select all

...Writing to temporary file: [/tmp/mythtv_.......]
Keep watching the output and when a line containing the following is seen:

Code: Select all

...Uncompressed to xxxxxxxx bytes
copy the file found above to some other location. The /tmp... file will exist
for roughly 1 minute. Then it can be examined (like the OP did.)

The above is for anyone else reading this thread. The OP needn't repeat
the process.

Post Reply