No new data - started July 19

[kpyle]

Application: mythfilldatabase (mythtv)
Lineup: TX42500

Starting July 19, "mythfilldatabase --dd-grab-all" runs but downloads no new data (i.e., no new data on Sunday, Monday, or Tuesday runs). Actual data ends August 2 0000 UTC.

The SD getdata test runs successfully, but of course only shows data in a short window near the current time.

Please let me know if I can provide additional data.

[rmeden]

I show earlier today you downloaded guide data from 07/19 -> 08/05.

I suggest checking with the MythTV folks for how to troubleshoot.. I think there's a file stored in /tmp you can look at to view the raw data.

[kpyle]

Well, there isn't a file left in /tmp, but it is possible to capture a copy with some trickery and quickness.

Naturally, it properly updated when I ran mythfilldatabase again to capture the data file. Thanks anyway.

[ajlill]

There seems to be an intermittent problem with not getting a full 13 days listings. I first noticed it about a month ago, and it seems to happen about once a week usually around the weekend. The randomizer is probably masking this for most people, but I pull my listings at the same time every day. Happened again today. From what I can tell they are good, they just haven't been updated this morning.

[kpyle]

I had the problem occur again today on the automatic MythTV run, and was able to recreate the problem on a manual run. I captured the data file dowloaded from SD on the manual run. It shows:

<xtvd from='2015-07-22T00:00:00Z' to='2015-08-08T00:00:00Z' ...

However, Myth reports:
Last mythfilldatabase run started on 2015-07-24 12:01:10 and ended on 2015-07-24 12:01:10. mythfilldatabase ran, but did not insert any new data into the Guide for 2 of 2 sources. This can indicate a potential grabber failure.
There's guide data until 2015-08-05 20:00 (12 days).

If I run the following command against the data file:
grep '^<schedule program' sd.data | grep -o '2015-0.-..T..' | sort | uniq -c

This shows me the number of programs in the schedule by hour and these are the last few lines of output:

...
55 2015-08-05T14
55 2015-08-05T15
56 2015-08-05T16
64 2015-08-05T17
58 2015-08-05T18
62 2015-08-05T19
63 2015-08-05T20
66 2015-08-05T21
67 2015-08-05T22
66 2015-08-05T23

So, the schedule data only goes up to 2015-08-06 00:00Z rather than 2015-08-08 00:00Z as shown in the xtvd tag.

I'll retain the downloaded data file in case it will be useful for any debugging.

[rmeden]

When was the grab done? As noted on the sd-dd service known issues, the service effectively has 13 days of data.

Data is usually loaded by 9:30 US/Eastern. Due to bugs in the MythTV code, most MythTV boxes download around 2am local time... leaving 12 days of data.

Robert

[kpyle]

The automatic run that failed today was at 11:05:39 CDT. As I noted in the prior post, the manual run to capture the data file was at approximately noon CDT:

Last mythfilldatabase run started on 2015-07-24 12:01:10

So, both should have been well after today's ~9:30 ET (8:30 CT) data load.

I've had my Myth install configured to run mythfilldatabase in the 10 AM to 1 PM CT range for some time since I had seen your prior notes about the data load time. I've consistently gotten the expected 13 days of data until recently.

[rmeden]

looks like the load failed this morning.

I'll look into why I didn't get an email and fix it.

Robert

[rmeden]

Didn't get the email because STDERR was redirected to the log file Not sure if it was force of habit or intentional, but it's fixed.. and data loaded though 8/6 23;59 UTC

[onevista]

No new data today Jul 27, 2015. mythtfill ran at 15:04 EDT . This has been happening intermittently for the past couple of weeks. It usually catches up the next day or so.