special notice from Schedules Direct: Re - mythfilldatabase

Forum rules
Get Help using the Schedules Direct service. NOTE: application issues are probably better resolved via the application's support methods. If you post here, at least include your application name!
fphillips
Posts: 12
Joined: Tue May 13, 2014 12:16 pm
Location: Austin. TX

Re: special notice from Schedules Direct: Re - mythfilldata

Post by fphillips » Wed May 06, 2015 10:14 am

It looks like I made it onto the list and don't need to be. If you can tighten your shot group, maybe that would reduce the remaining spike further.
2015-04-27 12:13
2015-04-28 13:32
2015-04-29 15:42
2015-04-30 10:05
2015-05-01 04:39
2015-05-02 02:12
2015-05-03 02:05
2015-05-04 02:06
2015-05-05 02:07
2015-05-06 05:05

rmeden
SD Board Member
Posts: 1525
Joined: Tue Aug 14, 2007 2:31 pm
Location: Cedar Hill, TX
Contact:

Re: special notice from Schedules Direct: Re - mythfilldata

Post by rmeden » Wed May 06, 2015 8:36 pm

I implemented a change 2 days ago which didn't make the last graph. (but things were already good enough to reduce server counts). I posted the graph when I did because the last large spike was about to roll off causing the scale to change.

Today's unposted graph is even better as you can see by your 5am poll time. I'm going to let it run for a few days and I'll post another pic.

rmeden
SD Board Member
Posts: 1525
Joined: Tue Aug 14, 2007 2:31 pm
Location: Cedar Hill, TX
Contact:

Re: special notice from Schedules Direct: Re - mythfilldata

Post by rmeden » Thu May 14, 2015 10:24 pm

I owe you guys an update.. things are much better and I've reduced our Amazon costs for SD-DD by about 1/3!

Here's the graph I've been showing you guys... keep in mind vertical scale is about half of what we had before. There are still a few sharp peaks (as noted below), but we have some nice wide peaks spreading the load.

Image

I've set up some Amazon counters for the HTTP requests directly, and got this graph. Note all the peaks on the hour... folks just love setting cron to minute 0!
Image

I may tweak the logic a bit more, but next I plan on going after members who are downloading over 50 times a day. (but that's a different thread!)

Robert

Post Reply