Application: mythfilldatabase (mythtv)
Lineup: TX42500
Starting July 19, "mythfilldatabase --dd-grab-all" runs but downloads no new data (i.e., no new data on Sunday, Monday, or Tuesday runs). Actual data ends August 2 0000 UTC.
The SD getdata test runs successfully, but of course only shows data in a short window near the current time.
Please let me know if I can provide additional data.
No new data - started July 19
Forum rules
Get Help using the Schedules Direct service. NOTE: application issues are probably better resolved via the application's support methods. If you post here, at least include your application name!
Get Help using the Schedules Direct service. NOTE: application issues are probably better resolved via the application's support methods. If you post here, at least include your application name!
-
- SD Board Member
- Posts: 1593
- Joined: Tue Aug 14, 2007 2:31 pm
- Location: Cedar Hill, TX
- Contact:
Re: No new data - started July 19
I show earlier today you downloaded guide data from 07/19 -> 08/05.
I suggest checking with the MythTV folks for how to troubleshoot.. I think there's a file stored in /tmp you can look at to view the raw data.
I suggest checking with the MythTV folks for how to troubleshoot.. I think there's a file stored in /tmp you can look at to view the raw data.
Re: No new data - started July 19
Well, there isn't a file left in /tmp, but it is possible to capture a copy with some trickery and quickness.
Naturally, it properly updated when I ran mythfilldatabase again to capture the data file. Thanks anyway.
Naturally, it properly updated when I ran mythfilldatabase again to capture the data file. Thanks anyway.
Re: No new data - started July 19
There seems to be an intermittent problem with not getting a full 13 days listings. I first noticed it about a month ago, and it seems to happen about once a week usually around the weekend. The randomizer is probably masking this for most people, but I pull my listings at the same time every day. Happened again today. From what I can tell they are good, they just haven't been updated this morning.
Re: No new data - started July 19
I had the problem occur again today on the automatic MythTV run, and was able to recreate the problem on a manual run. I captured the data file dowloaded from SD on the manual run. It shows:
<xtvd from='2015-07-22T00:00:00Z' to='2015-08-08T00:00:00Z' ...
However, Myth reports:
Last mythfilldatabase run started on 2015-07-24 12:01:10 and ended on 2015-07-24 12:01:10. mythfilldatabase ran, but did not insert any new data into the Guide for 2 of 2 sources. This can indicate a potential grabber failure.
There's guide data until 2015-08-05 20:00 (12 days).
If I run the following command against the data file:
grep '^<schedule program' sd.data | grep -o '2015-0.-..T..' | sort | uniq -c
This shows me the number of programs in the schedule by hour and these are the last few lines of output:
...
55 2015-08-05T14
55 2015-08-05T15
56 2015-08-05T16
64 2015-08-05T17
58 2015-08-05T18
62 2015-08-05T19
63 2015-08-05T20
66 2015-08-05T21
67 2015-08-05T22
66 2015-08-05T23
So, the schedule data only goes up to 2015-08-06 00:00Z rather than 2015-08-08 00:00Z as shown in the xtvd tag.
I'll retain the downloaded data file in case it will be useful for any debugging.
<xtvd from='2015-07-22T00:00:00Z' to='2015-08-08T00:00:00Z' ...
However, Myth reports:
Last mythfilldatabase run started on 2015-07-24 12:01:10 and ended on 2015-07-24 12:01:10. mythfilldatabase ran, but did not insert any new data into the Guide for 2 of 2 sources. This can indicate a potential grabber failure.
There's guide data until 2015-08-05 20:00 (12 days).
If I run the following command against the data file:
grep '^<schedule program' sd.data | grep -o '2015-0.-..T..' | sort | uniq -c
This shows me the number of programs in the schedule by hour and these are the last few lines of output:
...
55 2015-08-05T14
55 2015-08-05T15
56 2015-08-05T16
64 2015-08-05T17
58 2015-08-05T18
62 2015-08-05T19
63 2015-08-05T20
66 2015-08-05T21
67 2015-08-05T22
66 2015-08-05T23
So, the schedule data only goes up to 2015-08-06 00:00Z rather than 2015-08-08 00:00Z as shown in the xtvd tag.
I'll retain the downloaded data file in case it will be useful for any debugging.
-
- SD Board Member
- Posts: 1593
- Joined: Tue Aug 14, 2007 2:31 pm
- Location: Cedar Hill, TX
- Contact:
Re: No new data - started July 19
When was the grab done? As noted on the sd-dd service known issues, the service effectively has 13 days of data.
Data is usually loaded by 9:30 US/Eastern. Due to bugs in the MythTV code, most MythTV boxes download around 2am local time... leaving 12 days of data.
Robert
Data is usually loaded by 9:30 US/Eastern. Due to bugs in the MythTV code, most MythTV boxes download around 2am local time... leaving 12 days of data.
Robert
Re: No new data - started July 19
The automatic run that failed today was at 11:05:39 CDT. As I noted in the prior post, the manual run to capture the data file was at approximately noon CDT:
Last mythfilldatabase run started on 2015-07-24 12:01:10
So, both should have been well after today's ~9:30 ET (8:30 CT) data load.
I've had my Myth install configured to run mythfilldatabase in the 10 AM to 1 PM CT range for some time since I had seen your prior notes about the data load time. I've consistently gotten the expected 13 days of data until recently.
Last mythfilldatabase run started on 2015-07-24 12:01:10
So, both should have been well after today's ~9:30 ET (8:30 CT) data load.
I've had my Myth install configured to run mythfilldatabase in the 10 AM to 1 PM CT range for some time since I had seen your prior notes about the data load time. I've consistently gotten the expected 13 days of data until recently.
-
- SD Board Member
- Posts: 1593
- Joined: Tue Aug 14, 2007 2:31 pm
- Location: Cedar Hill, TX
- Contact:
Re: No new data - started July 19
looks like the load failed this morning. 
I'll look into why I didn't get an email and fix it.
Robert

I'll look into why I didn't get an email and fix it.
Robert
-
- SD Board Member
- Posts: 1593
- Joined: Tue Aug 14, 2007 2:31 pm
- Location: Cedar Hill, TX
- Contact:
Re: No new data - started July 19
Didn't get the email because STDERR was redirected to the log file
Not sure if it was force of habit or intentional, but it's fixed.. and data loaded though 8/6 23;59 UTC

Re: No new data - started July 19
No new data today Jul 27, 2015. mythtfill ran at 15:04 EDT . This has been happening intermittently for the past couple of weeks. It usually catches up the next day or so.