TMS dropping Data Direct!!! But no reason to panic.

rkulagow
SD Staff
Posts: 974
Joined: Tue Aug 14, 2007 3:15 pm

Re: TMS dropping Data Direct!!! But no reason to panic.

Post by rkulagow »

Modified dates will always increase, so string compare will work.

System status is an array just-in-case. Currently, it will contain Online. It may be Offline, in which case your client should disconnect.

lastDataUpdate is for schedules, but is actually a hold-over from the previous API which only had a "global" lastDataUpdate. Now that schedules are updated more than once per day, it has less meaning, especially since the client can now query the server for the lastUpdate and MD5 for a particular stationID. lastDataUpdate will be deprecated and removed.

For schedules, lastModified and MD5 aren't mutually exclusive; a server-side routine calculates the deltas, so it's possible that there's no change in the data (so the MD5 is the same), but the modified date gets updated because it copies over the previously generated schedule to the active table, thereby updating the modified. Use the MD5 to ensure that you get the latest schedule.

Since this is beta, we leave errors on to make troubleshooting easier. I will make the routine that you reference in the Slim error more robust.

Finally, getting a null result is an error and should be reported; we had a bad load yesterday and I've added code to ensure that if there's a bad load that it's not "published".
rmeden
SD Board Member
Posts: 1738
Joined: Tue Aug 14, 2007 2:31 pm
Location: Cedar Hill, TX
Contact:

Re: TMS dropping Data Direct!!! But no reason to panic.

Post by rmeden »

tgm4883 wrote: Is the hostname edit just for testing? On November 1st, will the old/original hostname work for people still using the DD direct replacement service? (eg. do people that are using legacy applications need to do anything on their end?) As a Mythbuntu developer, from what it sounds like people won't need to do anything on their end as the DD direct replacement service will continue to support them, then we can work on a larger upgrade/move to the JSON service for the next MythTV release (which would be a much better change as it's a more usual suspected large change time)
I don't know yet. I've asked Gracenote/Tribune if they are willing to update their DNS for one service and add a redirect for another. I haven't gotten an answer yet.

BTW, I've started another thread for testing of the DD replacement service. The more testers the better!

Robert
rmeden
SD Board Member
Posts: 1738
Joined: Tue Aug 14, 2007 2:31 pm
Location: Cedar Hill, TX
Contact:

Re: TMS dropping Data Direct!!! But no reason to panic.

Post by rmeden »

neopelago wrote:My usual xmltv.exe data-only download this morning failed with the error message "This request requires HTTP authentication."
Has something changed already? Is there a fix for this?
Nothing should have changed, the Tribune DataDirect servers are working for me.

Robert
rkulagow
SD Staff
Posts: 974
Joined: Tue Aug 14, 2007 3:15 pm

Re: TMS dropping Data Direct!!! But no reason to panic.

Post by rkulagow »

pgbennett wrote: When I ran the U command I got bunches of error messages like this.
PHP Warning: file_put_contents(/home/mythtv/.mythtv/channels/s11069_h3_aa.png): failed to open stream: Permission denied in /home/peter/proj/sd/mfdb-json/sd-utility.php on line 1750
Check permissions: could not write to /home/mythtv/.mythtv/channels
Is this home directory hard coded? Maybe it should use a storage directory or the logged-in user's home directory? Will the frontend try to use this directory? What about remote frontends? Since my frontend does not use the mythtv user it may not find these anyway.
If you run git pull, this should now be fixed. We try to determine the directory, and then will abort if we can't determine it and the user didn't tell us to not download.
wh7qq
Posts: 3
Joined: Tue Aug 19, 2014 12:43 pm

Re: TMS dropping Data Direct!!! But no reason to panic.

Post by wh7qq »

If the instructions on Github are current, this user is totally blown away. My old eyes glass over after several Page Down keystrokes. Mythbuntu has always been a PITA and much the worse for 14.04.10 to use but at least it was "free". Been using 'nix full time for over 10 years so I am no stranger to the command line but having doled out $25 for the privilege of using SD (yes I know you have expenses), it is not likely to happen again unless some better way of installing this comes along. No reason to panic but no reason to renew either. The new TV season has started and I am doing manual scheduling of MythTV. Sorry if this offends, but it's what I see.
rmeden
SD Board Member
Posts: 1738
Joined: Tue Aug 14, 2007 2:31 pm
Location: Cedar Hill, TX
Contact:

Re: TMS dropping Data Direct!!! But no reason to panic.

Post by rmeden »

wh7qq de n5gwy

Have you tried the direct DD replacement? All you'll need to do is edit your /etc/hosts file.
(instructions in another thread.. probably right below this one)

Robert
wh7qq
Posts: 3
Joined: Tue Aug 19, 2014 12:43 pm

Re: TMS dropping Data Direct!!! But no reason to panic.

Post by wh7qq »

n5gwy de wh7qq, Tnx but I edited the /etc/hosts file as directed. Maybe I missed something but mythfilldatabase still does not work. I tried changing the settings in the myth backend sources (DataDirect xmltv) but the configure step popped with an code 104. _ _ ... ..._ _
rmeden
SD Board Member
Posts: 1738
Joined: Tue Aug 14, 2007 2:31 pm
Location: Cedar Hill, TX
Contact:

Re: TMS dropping Data Direct!!! But no reason to panic.

Post by rmeden »

wh7qq wrote:n5gwy de wh7qq, Tnx but I edited the /etc/hosts file as directed. Maybe I missed something but mythfilldatabase still does not work. I tried changing the settings in the myth backend sources (DataDirect xmltv) but the configure step popped with an code 104. _ _ ... ..._ _
Maybe I'm missing something here.

Does the original TMS hosted data direct work? (not changing the host file). If it doesn't I don't expect the new SD DD to work either. I thought you just had trouble getting JSON to work.

Are you using XMLTV tv_grab_na_dd or Mythfilldatabase's built in DD client? na_dd works fine with the new service.. it's how I test it.

Robert
wh7qq
Posts: 3
Joined: Tue Aug 19, 2014 12:43 pm

Re: TMS dropping Data Direct!!! But no reason to panic.

Post by wh7qq »

I have never been comfortable with the setup of the myriad variables in mythTV and I am not really sure of what you are talking about. I was messing around yesterday trying out the DD grabber and got pretty screwed up...now the frontend can't find the backend database. I have no idea how that happened but I got so disgusted with it that I turned the damned thing off and walked away. I think "myth" is a pretty good name for it.

I had it working pretty well in 12.04 and if I had half a brain, I would have left well enough alone. Upgrading to 14.04.1 has been disasterous...the kernel fighting with the nVidia drivers and the graphics card, the frontend-backend mysteries, and then the problem with SD not working anymore. Been using 'nix for over 10 years, no stranger to the command line, but I guess I am getting too old for this stuff.
pgbennett
Posts: 16
Joined: Sat Sep 27, 2014 2:03 pm

Re: TMS dropping Data Direct!!! But no reason to panic.

Post by pgbennett »

I am doing some testing of the mfdb-json.
I started a run of mfdb-json.php, then pressed control-C while it was downloading, long before it updated the database with any new programs. When trying to run it again, it just says "No Updated Schedules", "No Programs to fetch" and ends.
How do I re-run it? Is there a way to force a download of all programs if something goes wrong?
Next time I run will it pick up the stuff that I killed or will it miss a couple of days, thinking that I had completed everything?

The output is here
http://pastebin.com/ndFS6V7L

Peter
Post Reply