TMS dropping Data Direct!!! But no reason to panic.

ImNtReal
Posts: 2
Joined: Fri Oct 03, 2014 6:02 am

Re: TMS dropping Data Direct!!! But no reason to panic.

Post by ImNtReal » Wed Oct 08, 2014 5:20 pm

rkulagow wrote:If you're on API20140530, please run git pull and test again; this should be resolved now.
That's the fix. Thanks.

martyg
Posts: 9
Joined: Thu Feb 21, 2013 6:55 am

Re: TMS dropping Data Direct!!! But no reason to panic.

Post by martyg » Fri Oct 10, 2014 12:44 pm

Some user feedback from my testing here.

My test bed is a fresh Debian Jessie/Testing install, with the deb-multimedia.org MythTV packages.

1. Please add a "sudo apt-get install php5-mysql" to the dependencies at the top of the README file.
If this package is missing, the sd-utility.php script bombs out with an obscure "driver" issue.
I expect this is required for the Ubuntu folks as well.

All is well through the rest of the setup, until I bring down schedule data with mfdb-json.php.

2. I am getting a couple of weird, possibly related, errors from the schedule download.
2014-10-10 17:54:39:*** ERROR: JSON decode error /tmp/mfdb_programs_zXffZu/programs.16.json
2014-10-10 17:56:04:FATAL ERROR: Empty title? MV004114420000
Logs are enclosed.
mfdb-json-logs.tgz
(11.9 KiB) Downloaded 527 times
Thanks for all the work you guys do to keep us end-users online.

rkulagow
SD Staff
Posts: 915
Joined: Tue Aug 14, 2007 3:15 pm

Re: TMS dropping Data Direct!!! But no reason to panic.

Post by rkulagow » Fri Oct 10, 2014 12:58 pm

I've updated the README to include the prerequisite.

The issue with that particular programID is something I'm debugging; the routine that generates the programs should have caught that but didn't, so I'm tracing the code now.

rmeden
SD Board Member
Posts: 1520
Joined: Tue Aug 14, 2007 2:31 pm
Location: Cedar Hill, TX
Contact:

Re: TMS dropping Data Direct!!! But no reason to panic.

Post by rmeden » Fri Oct 10, 2014 8:49 pm

StefanJ wrote:I just found out about this situation today. glad to see it is being worked on on several fronts.
I'm curious how the stopgap XML service works, in regards to channel lineups.
Is there a website where I'd need to define channel lineups, or will my SD lineups be used to choose which channel information to download?
by Stopgap I assume you mean the replacement Data Direct service.

All you need to do is change your hostname, or IP address via a hosts file change. The first time you download data, it will grab your lineups from Tribune. Eventually you'll manage the lineups using the SD web site just like you do now.

rkulagow
SD Staff
Posts: 915
Joined: Tue Aug 14, 2007 3:15 pm

Re: TMS dropping Data Direct!!! But no reason to panic.

Post by rkulagow » Fri Oct 10, 2014 8:51 pm

martyg wrote: 2014-10-10 17:54:39:*** ERROR: JSON decode error /tmp/mfdb_programs_zXffZu/programs.16.json
2014-10-10 17:56:04:FATAL ERROR: Empty title? MV004114420000
Logs are enclosed.
This has now been fixed. Please download again and let me know if the code still throws an error.

martyg
Posts: 9
Joined: Thu Feb 21, 2013 6:55 am

Re: TMS dropping Data Direct!!! But no reason to panic.

Post by martyg » Sun Oct 12, 2014 7:09 pm

rkulagow wrote:This has now been fixed.
Looks good on this end.
I'm going to let this soak for a while on my VM before moving into production.
Thanks for looking at this so quickly.

rkulagow
SD Staff
Posts: 915
Joined: Tue Aug 14, 2007 3:15 pm

Re: TMS dropping Data Direct!!! But no reason to panic.

Post by rkulagow » Sun Oct 12, 2014 7:21 pm

No problem. The earlier "Huh, that's weird" errors get reported, the sooner they're fixed.

This one was due to a subtle bug where we were truncating upstream data based on the number of characters. However, if the last few characters were multi-byte, (MB) then the regular substr in PHP wasn't aware of that and was truncating mid-MB string, which caused json encode errors, which caused things to fail. If it was a 60 byte string, with the MB at the end, it didn't matter. But if we were at "102" characters, with the last few being MB to encode UTF-8, if we hard-truncate at 100, that's a problem!

Like I said, resolved.

TPeterson
Posts: 4
Joined: Mon Oct 13, 2014 11:43 am

Re: TMS dropping Data Direct!!! But no reason to panic.

Post by TPeterson » Mon Oct 13, 2014 11:53 am

rmeden wrote:Eventually you'll manage the lineups using the SD web site just like you do now.
Robert, please clarify. "Eventually" means in November, or sometime later?

martyg
Posts: 9
Joined: Thu Feb 21, 2013 6:55 am

Something Broke Last Nght

Post by martyg » Fri Oct 17, 2014 6:18 am

Started happening last night:
1. I did a git pull before running, still reporting mismtach
2. sd@localhost is the wrong account for my SQL database, always was mythtv@localhost

---

$./mfdb-json.php --x
Using beta server.
2014-10-17 13:15:38:Checking to see if we're running the latest client.
2014-10-17 13:15:39:***Version mismatch.***
2014-10-17 13:15:39:Server version: 0.18
2014-10-17 13:15:39:Our version: 0.19
2014-10-17 13:15:39:Continuing because of --x parameter.
2014-10-17 13:15:39:mfdb-json.php developer grabber API:20140530 v0.19/2014-10-16
2014-10-17 13:15:39:Temp directory for Schedules is /tmp/mfdb_schedules_bCPO5T
2014-10-17 13:15:39:Temp directory for Programs is /tmp/mfdb_programs_TVXuoB
2014-10-17 13:15:39:Using database information from ~/.mythtv/config.xml
Connecting to Schedules Direct database.
Got error connecting to database.
Code: 1045
Message: SQLSTATE[28000] [1045] Access denied for user 'sd'@'localhost' (using password: YES)

rmeden
SD Board Member
Posts: 1520
Joined: Tue Aug 14, 2007 2:31 pm
Location: Cedar Hill, TX
Contact:

Re: TMS dropping Data Direct!!! But no reason to panic.

Post by rmeden » Fri Oct 17, 2014 7:51 am

TPeterson wrote:
rmeden wrote:Eventually you'll manage the lineups using the SD web site just like you do now.
Robert, please clarify. "Eventually" means in November, or sometime later?
Eventually. Like Yesterday. :)

I updated the sd-dd "live" thread.

Robert

Post Reply