lopaka1313 replied on Mon, Aug 3 2009 1:08 PM

rated by 0 users

Installed NPM 9.5 SP3 today and then tried to do DB maintenance and ran in to the same issue of it locking up when it hit "Summarizing detailed data from NPM_WIRELESS"

bduross replied on Mon, Aug 3 2009 1:14 PM

rated by 0 users

I noticed the same thing, I let it run for hours and it finally completed. It was fine over the weekend, however I had to kill the process this morning. Not sure where to go from here..

bshopp replied on Mon, Aug 3 2009 1:17 PM

rated by 0 users

Could you both please open support tickets

arronb replied on Mon, Aug 3 2009 1:17 PM

rated by 0 users

Same here. I thought SP3 was going to fix this?

bshopp replied on Mon, Aug 3 2009 1:30 PM

rated by 0 users

SP3 did fix some issues with DB maint.  It is hard to say exactly what is going on in your setup/scenarios, which is why I was requesting support tickets so we can investigate further and see what is going on

ctschap replied on Thu, Aug 20 2009 8:34 AM

rated by 0 users

I had similar issues prior to SP3. I was always getting this error and another similar one:

Failed to execute procedure: NPM_HST_WL_DetailToHourly
System.Data.SqlClient.SqlException: The INSERT statement conflicted with the FOREIGN KEY constraint "FK_NPM_NV_WL_INTERFACES_HOURLY_NPM_NV_WL_APS_HOURLY". The conflict occurred in database "NetPerfMon", table "dbo.NPM_NV_WL_APS_HOURLY".

It would error out three times and then give up and move on to finish the maintenance several hours later.

After SP3, the errors went away and data has been successfully summarized, but it still takes nearly six hours to complete.

lopaka1313 replied on Thu, Aug 27 2009 4:14 PM

rated by 0 users

I have been logging in to my Orion server everyday to kill this process (including weekends) but today I created a batch file that kills the process and then I set up a scheduled task to run the batch file right after the process starts.  Now I don't have to worry about it.

ctschap replied on Wed, Sep 2 2009 9:44 AM

rated by 0 users

I noticed in the release notes for SP4 this line:

"- An error related to the Database Maintenance procedure that creates hourly summaries of historical data has been fixed."

Is this intended to be the "fix fix" for the long DB-Maint run times?

bshopp replied on Wed, Sep 2 2009 11:18 AM

rated by 0 users

It fixes some issues we saw.  We are investigating another item on this and if you see it, please let Support know as we are looking into this.

lopaka1313 replied on Wed, Sep 2 2009 4:34 PM

rated by 0 users

I still get "stuck" on the wireless and it really screws everything up.  I don't know if I should just clear out all that data and start fresh.  I need help though.  This is getting really old.

bshopp replied on Wed, Sep 2 2009 4:37 PM

rated by 0 users

lopaka1313, I am pinging you offline to discuss

ctschap replied on Thu, Sep 3 2009 4:11 AM

rated by 0 users

That is the same place mine gets "stuck." No errors are thrown, anymore, since the upgrade to SP3, but it still takes the majority of the time. It hangs on the "Summarizing Detailed..."

I tried removing everything from the Wireless_Detail table but that really did not help. For mine, though, weekend runs are usually much better.

jcooler replied on Thu, Sep 3 2009 8:20 AM

rated by 0 users

I just realized that I am having this problem too. By database maint hangs at "Summarizing detailed data from NPM_WIRELESS". 

I have noticed that I have gaps in my stats collections. Then I noticed that the gaps seem to start at 2:15 AM, which is the time that the database maintenance runs. I then noticed that the database-maint.exe job was still running. Though I just noticed this today, I'm pretty sure that this has been happening for a while, as I have gaps in data, going back at least several weeks. It also seems to have made my polling completion drop to around 95%.

I looked at the swdebugMaintenance.log file. The following error is at the bottom of the file. It is repeated several times at the end of the file.

-------------log file error------------------------------------------------

2009-09-03 08:57:02,448 [1] ERROR SolarWinds.Data.DatabaseMaintenance.StandardTableHandlerDAL - Failed to execute procedure: NPM_HST_WL_DetailToHourly

System.Data.SqlClient.SqlException: Transaction (Process ID 569) was deadlocked on lock | communication buffer resources with another process and has been chosen as the deadlock victim. Rerun the transaction.

at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)

at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)

at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)

at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)

at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString)

at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async)

at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, DbAsyncResult result)

at System.Data.SqlClient.SqlCommand.InternalExecuteNonQuery(DbAsyncResult result, String methodName, Boolean sendToPipe)

at System.Data.SqlClient.SqlCommand.ExecuteNonQuery()

at SolarWinds.Data.DatabaseMaintenance.StandardTableHandlerDAL.InternalExecuteStoredProc(String procedureName, SqlParameter[] parameters)

------------------------end log error----------------------------------------------------------

Any suggestions? From what I'm reading, there is not a resolution for this yet. bshopp, you got anything for me? :)

bshopp replied on Thu, Sep 3 2009 8:44 AM

rated by 0 users

First make sure you are on SP4, if still after you are seeing issues, please open a support ticket so we can get you squared away and reference this post.  We have some tweaks we can make to see if we can get you resolved.

jcooler replied on Thu, Sep 3 2009 8:47 AM

rated by 0 users

How can I kill the database-Maint.exe process.  It is ran with the "system" user, and therefore will not let me kill it.

The only way I am able to is to reboot the server, and I dont want to do that on a regular basis.