No new data - started July 19

Forum rules
Get Help using the Schedules Direct service. NOTE: application issues are probably better resolved via the application's support methods. If you post here, at least include your application name!

No new data - started July 19

Postby kpyle » Tue Jul 21, 2015 9:19 am

Application: mythfilldatabase (mythtv)
Lineup: TX42500

Starting July 19, "mythfilldatabase --dd-grab-all" runs but downloads no new data (i.e., no new data on Sunday, Monday, or Tuesday runs). Actual data ends August 2 0000 UTC.

The SD getdata test runs successfully, but of course only shows data in a short window near the current time.

Please let me know if I can provide additional data.
kpyle
 
Posts: 7
Joined: Sat Oct 25, 2014 8:22 pm

Re: No new data - started July 19

Postby rmeden » Tue Jul 21, 2015 6:44 pm

I show earlier today you downloaded guide data from 07/19 -> 08/05.

I suggest checking with the MythTV folks for how to troubleshoot.. I think there's a file stored in /tmp you can look at to view the raw data.
rmeden
SD Board Member
 
Posts: 1485
Joined: Tue Aug 14, 2007 2:31 pm
Location: Cedar Hill, TX

Re: No new data - started July 19

Postby kpyle » Tue Jul 21, 2015 6:55 pm

Well, there isn't a file left in /tmp, but it is possible to capture a copy with some trickery and quickness.

Naturally, it properly updated when I ran mythfilldatabase again to capture the data file. Thanks anyway.
kpyle
 
Posts: 7
Joined: Sat Oct 25, 2014 8:22 pm

Re: No new data - started July 19

Postby ajlill » Fri Jul 24, 2015 9:35 am

There seems to be an intermittent problem with not getting a full 13 days listings. I first noticed it about a month ago, and it seems to happen about once a week usually around the weekend. The randomizer is probably masking this for most people, but I pull my listings at the same time every day. Happened again today. From what I can tell they are good, they just haven't been updated this morning.
ajlill
 
Posts: 9
Joined: Thu Sep 13, 2007 1:40 pm

Re: No new data - started July 19

Postby kpyle » Fri Jul 24, 2015 10:17 am

I had the problem occur again today on the automatic MythTV run, and was able to recreate the problem on a manual run. I captured the data file dowloaded from SD on the manual run. It shows:

<xtvd from='2015-07-22T00:00:00Z' to='2015-08-08T00:00:00Z' ...

However, Myth reports:
Last mythfilldatabase run started on 2015-07-24 12:01:10 and ended on 2015-07-24 12:01:10. mythfilldatabase ran, but did not insert any new data into the Guide for 2 of 2 sources. This can indicate a potential grabber failure.
There's guide data until 2015-08-05 20:00 (12 days).

If I run the following command against the data file:
grep '^<schedule program' sd.data | grep -o '2015-0.-..T..' | sort | uniq -c

This shows me the number of programs in the schedule by hour and these are the last few lines of output:

...
55 2015-08-05T14
55 2015-08-05T15
56 2015-08-05T16
64 2015-08-05T17
58 2015-08-05T18
62 2015-08-05T19
63 2015-08-05T20
66 2015-08-05T21
67 2015-08-05T22
66 2015-08-05T23

So, the schedule data only goes up to 2015-08-06 00:00Z rather than 2015-08-08 00:00Z as shown in the xtvd tag.

I'll retain the downloaded data file in case it will be useful for any debugging.
kpyle
 
Posts: 7
Joined: Sat Oct 25, 2014 8:22 pm

Re: No new data - started July 19

Postby rmeden » Fri Jul 24, 2015 11:30 am

When was the grab done? As noted on the sd-dd service known issues, the service effectively has 13 days of data.

Data is usually loaded by 9:30 US/Eastern. Due to bugs in the MythTV code, most MythTV boxes download around 2am local time... leaving 12 days of data.

Robert
rmeden
SD Board Member
 
Posts: 1485
Joined: Tue Aug 14, 2007 2:31 pm
Location: Cedar Hill, TX

Re: No new data - started July 19

Postby kpyle » Fri Jul 24, 2015 12:09 pm

The automatic run that failed today was at 11:05:39 CDT. As I noted in the prior post, the manual run to capture the data file was at approximately noon CDT:

Last mythfilldatabase run started on 2015-07-24 12:01:10

So, both should have been well after today's ~9:30 ET (8:30 CT) data load.

I've had my Myth install configured to run mythfilldatabase in the 10 AM to 1 PM CT range for some time since I had seen your prior notes about the data load time. I've consistently gotten the expected 13 days of data until recently.
kpyle
 
Posts: 7
Joined: Sat Oct 25, 2014 8:22 pm

Re: No new data - started July 19

Postby rmeden » Fri Jul 24, 2015 2:52 pm

looks like the load failed this morning. :(

I'll look into why I didn't get an email and fix it.

Robert
rmeden
SD Board Member
 
Posts: 1485
Joined: Tue Aug 14, 2007 2:31 pm
Location: Cedar Hill, TX

Re: No new data - started July 19

Postby rmeden » Fri Jul 24, 2015 6:15 pm

Didn't get the email because STDERR was redirected to the log file :) Not sure if it was force of habit or intentional, but it's fixed.. and data loaded though 8/6 23;59 UTC
rmeden
SD Board Member
 
Posts: 1485
Joined: Tue Aug 14, 2007 2:31 pm
Location: Cedar Hill, TX

Re: No new data - started July 19

Postby onevista » Mon Jul 27, 2015 12:25 pm

No new data today Jul 27, 2015. mythtfill ran at 15:04 EDT . This has been happening intermittently for the past couple of weeks. It usually catches up the next day or so.
onevista
 
Posts: 9
Joined: Mon Oct 20, 2014 10:30 am

Next

Return to Support

Who is online

Users browsing this forum: No registered users and 2 guests

cron