Serious Problem with Maintenance Routines

[drollins]

See below - I am experiencing some serious issues with the maintenance routines on my site.

The number of milliseconds required to process this stuff gets worse and worse as time goes on....

Does anyone have an idea why this could be happening?

INFO 2009-07-15 08:25:05,739 140ms Object a - App Started: 7/15/2009 8:25:05 AM
INFO 2009-07-15 08:25:07,661 2062ms Object a - Running maintenance routines
INFO 2009-07-15 08:25:08,848 3250ms Object a - User maintenance disabled 4 expired merchant accounts.
INFO 2009-07-15 08:25:09,036 3437ms Object a - Maintenance routines complete
INFO 2009-07-15 08:25:24,398 18799ms Object a - Running maintenance routines
INFO 2009-07-15 08:25:25,445 19846ms Object a - User maintenance disabled 4 expired merchant accounts.
INFO 2009-07-15 08:25:25,460 19862ms Object a - Maintenance routines complete
INFO 2009-07-15 09:26:02,285 3656686ms Object a - Running maintenance routines
INFO 2009-07-15 09:26:02,738 3657139ms Object a - User maintenance disabled 4 expired merchant accounts.
INFO 2009-07-15 09:26:02,847 3657249ms Object a - Maintenance routines complete
INFO 2009-07-15 10:52:25,264 8839666ms Object a - Running maintenance routines
INFO 2009-07-15 10:52:25,264 8839666ms Object a - Running maintenance routines
INFO 2009-07-15 10:52:25,264 8839666ms Object a - Running maintenance routines
INFO 2009-07-15 10:52:25,843 8840244ms Object a - User maintenance disabled 4 expired merchant accounts.
INFO 2009-07-15 10:52:25,905 8840307ms Object a - User maintenance disabled 4 expired merchant accounts.
INFO 2009-07-15 10:52:26,061 8840463ms Object a - User maintenance disabled 4 expired merchant accounts.
INFO 2009-07-15 10:52:26,061 8840463ms Object a - Maintenance routines complete
INFO 2009-07-15 10:52:26,077 8840478ms Object a - Maintenance routines complete
INFO 2009-07-15 10:52:26,077 8840478ms Object a - Maintenance routines complete
INFO 2009-07-15 10:52:26,155 8840557ms Object a - Running maintenance routines
INFO 2009-07-15 10:52:26,171 8840572ms Object a - User maintenance disabled 4 expired merchant accounts.
INFO 2009-07-15 10:52:26,202 8840603ms Object a - Maintenance routines complete

[drollins]

8840603ms works out to over 24 hours!

[drollins]

Is there a way for me to change how maintenance works? Do I have any influence over this?

[jmestep]

Here is a post on it:
viewtopic.php?f=42&t=9703&hilit=maintenanceinterval

[Logan Rhodehamel]

See below - I am experiencing some serious issues with the maintenance routines on my site.

The number of milliseconds required to process this stuff gets worse and worse as time goes on....

That number of milliseconds is the time elapsed since the logger was initialized. It's not how long the item took to process. So actually, the maintenance does not appear to have taken longer than 1.5 seconds at worst - right when the application was initializing. So I think you are OK.

[drollins]

OK that is good news... sorry about the confusion.

But why do I still see stuff like this where the maintenance routines fire up three time like this in a very short time frame? I've set the Maintenance interval to 24 hours (1440) but it is firing all the time anyways.

INFO 2009-07-21 05:29:53,880 5953ms Object a - Running maintenance routines
INFO 2009-07-21 05:29:53,896 5968ms Object a - Running maintenance routines
INFO 2009-07-21 05:29:53,896 5968ms Object a - Running maintenance routines
INFO 2009-07-21 05:29:53,896 5968ms Object a - User maintenance disabled 4 expired merchant accounts.
INFO 2009-07-21 05:29:53,911 5984ms Object a - User maintenance disabled 4 expired merchant accounts.
INFO 2009-07-21 05:29:53,911 5984ms Object a - User maintenance disabled 4 expired merchant accounts.
INFO 2009-07-21 05:29:53,943 6015ms Object a - Maintenance routines complete
INFO 2009-07-21 05:29:53,943 6015ms Object a - Maintenance routines complete
INFO 2009-07-21 05:29:53,943 6015ms Object a - Maintenance routines complete

[Logan Rhodehamel]

OK that is good news... sorry about the confusion.

But why do I still see stuff like this where the maintenance routines fire up three time like this in a very short time frame? I've set the Maintenance interval to 24 hours (1440) but it is firing all the time anyways.

INFO 2009-07-21 05:29:53,880 5953ms Object a - Running maintenance routines
INFO 2009-07-21 05:29:53,896 5968ms Object a - Running maintenance routines
INFO 2009-07-21 05:29:53,896 5968ms Object a - Running maintenance routines

First... the maintenance always runs when the application initializes. That ensures it runs at least once. During periods of non-traffic, the application may unload itself before you ever reached the time interval (24 hours in your case).

So if you look at the millisecond timer, these calls are triggered right as the application is first starting. They weren't runs based on an interval timer.

As for why there are three calls... I would ask what version of the software you are running? Prior to a certain point, we initialized maintenance once for each application instance. This meant if you had IIS configured to use a web garden (multiple ASPNET processes) then maintenance would run once for each process.

Regardless, the maintenance calls are relatively low impact. The main job performed by maintenance is to clear out any old anonymous shopping sessions. IMO it's better for this process to run more frequently rather than less - that keeps the amount of work to do on each run to a minimum.

[drollins]

The build # of the commercebuilder.dll I am running is 7.0.8831.0

[Logan Rhodehamel]

The duplicate runs are almost certainly related to the code changes we made, I think for 7.0.2 release. It's a trivial issue in your configuration. (If your server was spawning 1000 processes it would be a different story - hence the change for 7.0.2.)

[drollins]

Could this be related to my Virtual memory problem??? See post below.

viewtopic.php?f=42&t=11793