DataDirect replacement service going live!

Forum rules
Get Help using the Schedules Direct service. NOTE: application issues are probably better resolved via the application's support methods. If you post here, at least include your application name!

Re: DataDirect replacement service going live!

Postby jxself » Tue Oct 28, 2014 5:46 am

I learned of this upcoming transition. I'm using the fixes branch of MythTV 0.25. The easiest method seemed dropping that entry into /etc/hosts so that file contains:
54.85.117.227 docs.tms.tribune.com webservices.schedulesdirect.tmsdatadirect.com

But I noticed that, on MythWeb's Backend Status page, near the bottom it says how many days of guide data are left and it keeps getting smaller. I have 14 days of guide data, then 13, 12, 11, and currently it says "There's guide data until 2014-11-07 04:00 (10 days)." It's like I am not getting any new data. That area currently says:

Code: Select all
Last mythfilldatabase run started on 2014-10-27 08:50:03 and ended on 2014-10-27 08:50:06. mythfilldatabase ran, but did not insert any new data into the Guide. This can indicate a potential grabber failure.
Suggested next mythfilldatabase run: 2014-10-28 08:50.
There's guide data until 2014-11-07 04:00 (10 days).
DataDirect Status: Your subscription expires on Sun Jul 26 2015 6:50 PM


I try to run mythfilldatabase manually to see what happens. I'm told the results are too long and so are provided on http://jxself.org/mythfilldatabase1.txt

In doing some searching I go to http://www.schedulesdirect.org/getdata and copy/paste the data into a file and run mythfilldatabase that way. The results are http://jxself.org/mythfilldatabase2.txt

I had hoped that updating the hosts file would allow for the use of a drop-in replacement service without upgrading MythTV but am I wrong?
jxself
 
Posts: 2
Joined: Sun Oct 26, 2014 7:34 am

Re: DataDirect replacement service going live!

Postby bill6502 » Tue Oct 28, 2014 9:26 am

jxself wrote:...
But I noticed that, on MythWeb's Backend Status page, near the bottom it says how many days of guide data are left and it keeps getting smaller. I have 14 days of guide data, then 13, 12, 11, and currently it says "There's guide data until 2014-11-07 04:00 (10 days)."
...

I had hoped that updating the hosts file would allow for the use of a drop-in replacement service without upgrading MythTV but am I wrong?

Hi,

The number of days dropping is a symptom of a stuck file in /tmp. Look for one named something like mythtv_ddp_data
and delete it. The problem was fixed after 0.27.4 (but that's another story.)

FIY, the best way to run mythfilldatabase manually is with the options -v file,network. Never run with -v all, even though
it seems like a good idea. --dd-grab-all is always preferred, assuming you don't have an underpowered backend.

If you run manually, always check /tmp for the stuck file. That way when it's run automatically by the backend,
the owner of the file won't be yourself and user mythtv will be able to remove it. This isn't likely an issue with
the conversion. Interesting to note in your log that the version is dirty[ v0.25.3-46-gdf9f50e-dirty], if you're
building from source, be sure to see: https://www.mythtv.org/wiki/Schedules_D ... e_solution .
Finally, your entry in /etc/hosts also has: docs.tms.tribune.com, which isn't required (it doesn't hurt, it's just
not required.)
Last edited by bill6502 on Tue Oct 28, 2014 7:39 pm, edited 1 time in total.
bill6502
 
Posts: 16
Joined: Fri Sep 19, 2014 4:52 pm

Re: DataDirect replacement service going live!

Postby cfcubed » Tue Oct 28, 2014 12:32 pm

jrguy wrote:I use SD for the My Telly app which has not been maintained by developers for several years. Coding 54.85.117.227 into the two-line hosts file format presented by skst resulted in the following message when attempting a Guide update:
<snip>
com.withay.http.BadAuthorizationException
2014-10-14T00:41:05Z Opening connection to <http://webservices.schedulesdirect.tmsdatadirect.com/schedulesdirect/tvlistings/xtvdService>
2014-10-17T00:41:05Z Sending first request for digest nonce"

Substituting 144.142.232.53 in both lines worked and produced an updated Guide. <snip>


jrguy - Just a heads-up that *if* its easy & quick I do plan to patch My Telly to work with the DD replacement service. Would not roll any interim fix that only works until Nov 1 though, for that the hosts workaround as posted seems to work. BTW please see My Telly's SourceForge Discussion - Help area (... Guide Data ...) thread for any status updates.
cfcubed
 
Posts: 11
Joined: Wed Oct 10, 2007 6:00 am

Re: DataDirect replacement service going live!

Postby eblro01 » Tue Oct 28, 2014 1:40 pm

After successful running an update following the recommended /etc/hosts file change, I now have the same issue with the number of days of schedule data that others have reported, i.e., decrements by 1 every day. I tried deleting the files mentioned in /tmp, but the problem remains. The error message I get when mythfilldatabase runs the update is that the update fails with a "Connections Timed Out" message. The MythTV status page on MythWeb says the mythfilldatabase update ran and is successful - but that can't be right?

There's some old references in the Forum about needing to adjust the timeout limit from 10 seconds to something greater?? I don't know if that is an issue currently or not.

I can log into the back-end and run commands, and connect to MythWeb OK, but does that necessarily mean the back-end is connecting to the Internet OK??

Any help would be really appreciated. Here's the file that results when running mythfilldatabase, if that is any help.

Thanks,
Bob

*************************
bobby@mythtv:~$ mythfilldatabase
2014-10-28 15:13:50.510 Using runtime prefix = /usr
2014-10-28 15:13:50.510 Using configuration directory = /home/bobby/.mythtv
2014-10-28 15:13:50.511 Empty LocalHostName.
2014-10-28 15:13:50.511 Using localhost value of mythtv
2014-10-28 15:13:50.523 New DB connection, total: 1
2014-10-28 15:13:50.527 Connected to database 'mythconverg' at host: localhost
2014-10-28 15:13:50.527 Closing DB connection named 'DBManager0'
2014-10-28 15:13:50.528 Connected to database 'mythconverg' at host: localhost
2014-10-28 15:13:50.531 Current MythTV Schema Version (DBSchemaVer): 1254
2014-10-28 15:13:50.534 New DB connection, total: 2
2014-10-28 15:13:50.534 Connected to database 'mythconverg' at host: localhost
2014-10-28 15:13:50.845 Updating source #1 (SD) with grabber schedulesdirect1
2014-10-28 15:13:50.846 Found 86 channels for source 1 which use grabber
2014-10-28 15:13:50.846
2014-10-28 15:13:50.846 Checking day @ offset 0, date: Tue Oct 28 2014
2014-10-28 15:13:50.924 Data is already present for Tue Oct 28 2014, skipping
2014-10-28 15:13:50.924
2014-10-28 15:13:50.924 Checking day @ offset 1, date: Wed Oct 29 2014
2014-10-28 15:13:50.925 Data Refresh always needed for tomorrow
2014-10-28 15:13:50.925 Refreshing data for Wed Oct 29 2014
2014-10-28 15:13:50.925 New DB DataDirect connection
2014-10-28 15:13:50.925 Connected to database 'mythconverg' at host: localhost
2014-10-28 15:13:50.927 Retrieving datadirect data.
2014-10-28 15:13:50.927 Grabbing data for Tue Oct 28 2014 offset 1
2014-10-28 15:13:50.928 From Wed Oct 29 04:00:00 2014 to Thu Oct 30 04:00:00 2014 (UTC)
2014-10-28 15:13:50.928 Grabbing listing data
--2014-10-28 15:13:50-- http://webservices.schedulesdirect.tmsd ... tvdService
Resolving webservices.schedulesdirect.tmsdatadirect.com... 54.85.117.227
Connecting to webservices.schedulesdirect.tmsdatadirect.com|54.85.117.227|:80... failed: Connection timed out.
Retrying.

--2014-10-28 15:14:12-- (try: 2) http://webservices.schedulesdirect.tmsd ... tvdService
Connecting to webservices.schedulesdirect.tmsdatadirect.com|54.85.117.227|:80... failed: Connection timed out.
Retrying.

************************************************
This retry continues for several attempts.
eblro01
 
Posts: 0
Joined: Sun Oct 19, 2014 8:10 am

Re: DataDirect replacement service going live!

Postby jxself » Tue Oct 28, 2014 2:26 pm

bill6502 wrote:The number of days dropping is a symptom of a stuck file in /tmp. Look for one named something like mythtv_ddp_data
and delete it.

I did indeed have such a file and deleted it. I'll see what happens when it runs next. Hopefully it was just bad timing that it happened around the same time I was making the change to the hosts file. Also, thanks for the pointer to the patch and the other information.
jxself
 
Posts: 2
Joined: Sun Oct 26, 2014 7:34 am

Re: DataDirect replacement service going live!

Postby mathog » Tue Oct 28, 2014 2:33 pm

I changed the URL directly in the library, where it was stored, using a hex editor. This is equivalent to rebuilding from source, just
without actually doing so. My home DVR is running very old software (ubuntu 8.10, mythtv 0.21), so no easy way to upgrade with packages, and since it wasn't built from source, a rebuild was out of the question. Bind isn't running. This method
should be more stable than changing the /etc/hosts file, since it doesn't depend on the IP address, just the IP name.

Instructions here:

http://ubuntuforums.org/showthread.php?t=2248599&p=13152502#post13152502

It may sound a little hairy to be hexediting a library, but in this case it isn't really.
mathog
 
Posts: 1
Joined: Tue Oct 28, 2014 12:54 pm

Re: DataDirect replacement service going live!

Postby rchandra » Tue Oct 28, 2014 2:52 pm

rmeden wrote:Check out /getdata and /getdata2 to see what the lineups say should be on the various channels.

It could also be legacy stuff in your TMS record (Tribune made the change, but old data got stuck in your lineup). That's why folks had to sometimes do the "re-add lineup" to fix things at TMS-DD. SD-DD only stores excluded channel information (not a complete lineup), so you always get Tribune's current lineup. If /getdata2 is wrong, open a lineup support ticket to have it fixed.

Robert

Thanks for the reply, the "2" suffix is quite handy. When using it, WBBZ does not show up but WBBZDT3 does. Will be submitting a ticket so that all Buffalonians who use this guide data can know it's a MeTV affiliate, as well as any programming discrepancies I find (for example, I don't think we get CHiPs; it's replaced by local programming, and I'll know in about 10 minutes from when I wrote this what TWC is putting on ch. 5 at 6PM weekdays).
rchandra
 
Posts: 2
Joined: Wed Oct 22, 2014 12:58 am

Re: DataDirect replacement service going live!

Postby tim » Tue Oct 28, 2014 3:37 pm

One of my lineups shows up as type Satellite with /getdata. It is now showing up as type CableDigital. Is there anyway to change it back to Satellite?

/getdate:

Code: Select all
<lineup id='0009995:X' name='Shaw Direct' location='Canada (West) Advanced' type='Satellite' device='Digital' postalCode='S7J3X3'>


/getdata2:
Code: Select all
<lineup id='0009995:X' name='Shaw Direct' location='Canada (West) Advanced' type='CableDigital' device='Digital' postalCode='S7J3X3' >
tim
 
Posts: 2
Joined: Mon Aug 20, 2007 9:06 pm

Re: DataDirect replacement service going live!

Postby bill6502 » Tue Oct 28, 2014 4:55 pm

eblro01 wrote:...
I can log into the back-end and run commands, and connect to MythWeb OK, but does that necessarily mean the back-end is connecting to the Internet OK??
...

Usually not. That is, you're probably connecting to the backend via Private Network addresses, over your LAN.
You need to test connectivity to the WAN. Try the following, if they don't work, you're not connecting to the
internet (and should have nothing to do with the SD change):
Code: Select all
ping 54.85.117.227
ping google.com

You can always delete your change in /etc/hosts and see if things return to normal. And if it does, paste
the /etc/hosts change here. If you report times (e.g. from your logs), be sure to mention your time zone.
bill6502
 
Posts: 16
Joined: Fri Sep 19, 2014 4:52 pm

Re: DataDirect replacement service going live!

Postby rmeden » Tue Oct 28, 2014 6:27 pm

tim wrote:One of my lineups shows up as type Satellite with /getdata. It is now showing up as type CableDigital. Is there anyway to change it back to Satellite?


I have to guess at those types... fixed.

Robert
rmeden
SD Board Member
 
Posts: 1512
Joined: Tue Aug 14, 2007 2:31 pm
Location: Cedar Hill, TX

PreviousNext

Return to Support

Who is online

Users browsing this forum: No registered users and 15 guests