This discussion has been locked.
You can no longer post new replies to this discussion. If you have a question you can start a new discussion

ADS_ADSGroup_Insert Job frozen but AD Object was created

Hello Experts,

We have a mystery that i'd like to get some help with.  We have multiple Jobs that are either ADS_ADSGroup_Insert, ADS_ADSAccount_Insert and they are frozen but the AD Object was created in AD.  You are able to able to provision to this Account or Group via OneIM but you can provision access to it in AD.  This is the error i am getting:  

ErrorMessages = (2019-04-05 18:17:11.660) [1777018] Error executing synchronization project (Active Directory Domain (DC=tmk,DC=ent,DC=lc))'s workflow (Provisioning - tmk).
[1777124] Error executing projection step (group) of projection configuration (Provisioning - tmk (Provisioning)).
[1777219] Error executing synchronization step (group)!
[1777004] Method (Update object (Update)) could not be executed successfully.
[2226012] Error committing object CN=TG_SQL_AWTMNDSKWLSQL01_EnterpriseLead_RO,OU=TaskGroups,OU=AllGroups,DC=tmk,DC=ent,DC=lc.(Error: Error committing object 890c2e3d-9d63-4401-83b7-e8a60c3fa399.(Error: Querying GC://MKTMP1DC02.tmk.ent.lc using filter (DistinguishedName=CN=Vibha K. Prajapati,OU=MCKUsers,OU=AllUsers,DC=tmk,DC=ent,DC=lc)
Querying GC MKTMP1DC02.tmk.ent.lc results in error: The server is not operational.
.
Querying GC://watmp1dc01.tmk.ent.lc using filter (DistinguishedName=CN=Vibha K. Prajapati,OU=MCKUsers,OU=AllUsers,DC=tmk,DC=ent,DC=lc)
Error executing group_allowwritemembers_Set on object CN=TG_SQL_AWTMNDSKWLSQL01_EnterpriseLead_RO,OU=TaskGroups,OU=AllGroups,DC=tmk,DC=ent,DC=lc (Error: [System.Reflection.TargetInvocationException] Exception has been thrown by the target of an invocation.
[System.Runtime.InteropServices.COMException] The server is not operational.
).
Error writing property vrtAllowWriteMembers. The modification will rerun after committing object.
Property vrtMembersAllDn will be set.
2 write operations on properties were deferred and will be executed now.
Querying GC://MKTMP1DC02.tmk.ent.lc using filter (DistinguishedName=CN=Vibha K. Prajapati,OU=MCKUsers,OU=AllUsers,DC=tmk,DC=ent,DC=lc)
Querying GC MKTMP1DC02.tmk.ent.lc results in error: The server is not operational.
.
Querying GC://watmp1dc01.tmk.ent.lc using filter (DistinguishedName=CN=Vibha K. Prajapati,OU=MCKUsers,OU=AllUsers,DC=tmk,DC=ent,DC=lc)
Error executing group_allowwritemembers_Get on object CN=TG_SQL_AWTMNDSKWLSQL01_EnterpriseLead_RO,OU=TaskGroups,OU=AllGroups,DC=tmk,DC=ent,DC=lc (Error: [System.Reflection.TargetInvocationException] Exception has been thrown by the target of an invocation.
[System.Runtime.InteropServices.COMException] The server is not operational.
).
Property vrtAllowWriteMembers will be set.
Querying GC://MKTMP1DC02.tmk.ent.lc using filter (DistinguishedName=CN=Vibha K. Prajapati,OU=MCKUsers,OU=AllUsers,DC=tmk,DC=ent,DC=lc)
Querying GC MKTMP1DC02.tmk.ent.lc results in error: The server is not operational.
.
Querying GC://watmp1dc01.tmk.ent.lc using filter (DistinguishedName=CN=Vibha K. Prajapati,OU=MCKUsers,OU=AllUsers,DC=tmk,DC=ent,DC=lc)
Error executing group_allowwritemembers_Set on object CN=TG_SQL_AWTMNDSKWLSQL01_EnterpriseLead_RO,OU=TaskGroups,OU=AllGroups,DC=tmk,DC=ent,DC=lc (Error: [System.Reflection.TargetInvocationException] Exception has been thrown by the target of an invocation.
[System.Runtime.InteropServices.COMException] The server is not operational.
).
The server is not operational.

Exception has been thrown by the target of an invocation.
Error writing one or more properties of object.
Object not committed successfully. Retrying using single property commit.
Property groupType not changed because value is already set.
Property objectClass will be set.
Querying GC://MKTMP1DC02.tmk.ent.lc using filter (DistinguishedName=CN=Vibha K. Prajapati,OU=MCKUsers,OU=AllUsers,DC=tmk,DC=ent,DC=lc)
Querying GC MKTMP1DC02.tmk.ent.lc results in error: The server is not operational.
.
Querying GC://watmp1dc01.tmk.ent.lc using filter (DistinguishedName=CN=Vibha K. Prajapati,OU=MCKUsers,OU=AllUsers,DC=tmk,DC=ent,DC=lc)
Error executing group_allowwritemembers_Get on object CN=TG_SQL_AWTMNDSKWLSQL01_EnterpriseLead_RO,OU=TaskGroups,OU=AllGroups,DC=tmk,DC=ent,DC=lc (Error: [System.Reflection.TargetInvocationException] Exception has been thrown by the target of an invocation.
[System.Runtime.InteropServices.COMException] The server is not operational.
).
Property vrtAllowWriteMembers will be set.
Querying GC://MKTMP1DC02.tmk.ent.lc using filter (DistinguishedName=CN=Vibha K. Prajapati,OU=MCKUsers,OU=AllUsers,DC=tmk,DC=ent,DC=lc)
Querying GC MKTMP1DC02.tmk.ent.lc results in error: The server is not operational.
.
Querying GC://watmp1dc01.tmk.ent.lc using filter (DistinguishedName=CN=Vibha K. Prajapati,OU=MCKUsers,OU=AllUsers,DC=tmk,DC=ent,DC=lc)
Error executing group_allowwritemembers_Set on object CN=TG_SQL_AWTMNDSKWLSQL01_EnterpriseLead_RO,OU=TaskGroups,OU=AllGroups,DC=tmk,DC=ent,DC=lc (Error: [System.Reflection.TargetInvocationException] Exception has been thrown by the target of an invocation.
[System.Runtime.InteropServices.COMException] The server is not operational.
).
The server is not operational.

Exception has been thrown by the target of an invocation.
Property displayName not changed because value is already set.
Property vrtMembersAllDn will be set.
))
   at VI.Projector.JobComponent.ProjectorComponent._AdHocProjection()
   at VI.Projector.Database.ProjectorExecutor.Project(ISession session, IProjectionConfiguration configuration, ProjectionOption options, ISystemObject adHocObject, CancellationToken cancellationToken)
   at VI.Projector.Projection.Extensions.Execute(IProjectorEngine engine, IProjectionConfiguration configuration, ProjectionOption options, ISystemObject adHocObject, CancellationToken cancellationToken)
   at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
   ---- Start of Inner Exception ----
   at VI.Projector.Projection.ProjectorEngine.<ExecuteAsync>d__3.MoveNext()
   ---- Start of Inner Exception ----
   at VI.Projector.Projection.ProjectorEngine.<ExecuteAsync>d__3.MoveNext()
   ---- Start of Inner Exception ----
   at VI.Projector.Projection.ProjectorEngine.<ExecuteAsync>d__3.MoveNext()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
--- End of stack trace from previous location where exception was thrown ---
   at VI.Projector.Projection.ProjectionStrategy.<ExecuteStepAsync>d__2.MoveNext()
   ---- Start of Inner Exception ----
   at VI.Projector.Projection.ProjectionStrategy.<ExecuteStepAsync>d__2.MoveNext()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
--- End of stack trace from previous location where exception was thrown ---
   at VI.Projector.Projection.ProjectionStrategyBase.<OnExecuteStepAsync>d__2.MoveNext()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
--- End of stack trace from previous location where exception was thrown ---
   at VI.Projector.Projection.ProjectionStrategyBase.<_ProcessIntersectionSetAsync>d__17.MoveNext()
   at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1.ConfiguredTaskAwaiter.GetResult()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
--- End of stack trace from previous location where exception was thrown ---
   at VI.Projector.Projection.ProjectionStrategyBase.<_ProcessMappingOfSystemObjectPairsAsync>d__21.MoveNext()
   at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1.ConfiguredTaskAwaiter.GetResult()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
--- End of stack trace from previous location where exception was thrown ---
   at System.Threading.Tasks.Task.Execute()
   at System.Threading.Tasks.Task`1.InnerInvoke()
   at VI.Projector.Projection.ProjectionStrategyBase.<>c__DisplayClass21_0.<_ProcessMappingOfSystemObjectPairsAsync>b__9()
   at VI.Projector.Projection.ProjectionStrategyBase._ExecuteMethods(IProjectionStep step, SystemObjectMatchingSet matchingSet, ISystemConnection connection, ISchemaMethodAssignment[] methodAssignments, IList`1 systemObjectPairs, SystemMappingSide side, ProjectionDirection projectionDirection, Boolean forceReloadObject, Boolean ignoreQuotas)
   at VI.Projector.Projection.ProjectionStrategyBase._ExecuteMethodNative(ISystemConnection connection, SystemObjectMatchingSet matchingSet, ISchemaMethod method, IEnumerable`1 objectsWithAncestryToExecute, Boolean reloadObjects, Boolean isImport)
   at VI.Projector.Connection.SystemConnection.ExecuteMethod(ISchemaMethod method, IEnumerable`1 systemObjects, ExecuteMethodOptions option)
   ---- Start of Inner Exception ----
   at VI.Projector.Connection.SystemConnection.ExecuteMethod(ISchemaMethod method, IEnumerable`1 systemObjects, ExecuteMethodOptions option)
   at VI.Projector.Journal.JournalConnector.OnExecuteMethod(ExecuteMethodRequest request)
   at VI.Projector.Connection.Connectors.BottleNeckConnector._Redirect[T](Func`1 redirection)
   at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
   ---- Start of Inner Exception ----
   at VI.Projector.Connection.Connectors.BottleNeckConnectorTask.Execute()
   at VI.Projector.Connection.Connectors.BottleNeckConnector.<>c__DisplayClass12_0.<OnExecuteMethod>b__0()
   at VI.Projector.Connection.SystemConnector.ExecuteMethod(ExecuteMethodRequest request)
   at VI.Projector.Connection.SystemConnector.CommitObject(CommitObjectRequest request)
   at VI.Projector.ADS.ProjectorADSConnector.OnCommitObject(CommitObjectRequest request)
   at VI.Projector.ProjectorBaseConnector.HandleException(ObjectRequest request, Exception Ex)
Synchronization ended with errors.
You can find more detailed information in the log from Friday, April 5, 2019.
(2019-04-10 14:56:39.630) Reactivation of frozen Job 85820611-cf15-4c63-a968-52e2491f3e71 with parameter SELF
(2019-04-10 14:57:11.353) [1777018] Error executing synchronization project (Active Directory Domain (DC=tmk,DC=ent,DC=lc))'s workflow (Provisioning - tmk).
[1777124] Error executing projection step (group) of projection configuration (Provisioning - tmk (Provisioning)).
[1777219] Error executing synchronization step (group)!
[1777004] Method (Update object (Update)) could not be executed successfully.
[2226012] Error committing object CN=TG_SQL_AWTMNDSKWLSQL01_EnterpriseLead_RO,OU=TaskGroups,OU=AllGroups,DC=tmk,DC=ent,DC=lc.(Error: Error committing object 890c2e3d-9d63-4401-83b7-e8a60c3fa399.(Error: Querying GC://MKTMP1DC01.tmk.ent.lc using filter (DistinguishedName=CN=Vibha K. Prajapati,OU=MCKUsers,OU=AllUsers,DC=tmk,DC=ent,DC=lc)
Querying GC MKTMP1DC01.tmk.ent.lc results in error: The server is not operational.
.
Querying GC://mktmp2dc03.tmk.ent.lc using filter (DistinguishedName=CN=Vibha K. Prajapati,OU=MCKUsers,OU=AllUsers,DC=tmk,DC=ent,DC=lc)
Error executing group_allowwritemembers_Set on object CN=TG_SQL_AWTMNDSKWLSQL01_EnterpriseLead_RO,OU=TaskGroups,OU=AllGroups,DC=tmk,DC=ent,DC=lc (Error: [System.Reflection.TargetInvocationException] Exception has been thrown by the target of an invocation.
[System.Runtime.InteropServices.COMException] The server is not operational.
).
Error writing property vrtAllowWriteMembers. The modification will rerun after committing object.
1 write operations on properties were deferred and will be executed now.
Querying GC://MKTMP1DC01.tmk.ent.lc using filter (DistinguishedName=CN=Vibha K. Prajapati,OU=MCKUsers,OU=AllUsers,DC=tmk,DC=ent,DC=lc)
Querying GC MKTMP1DC01.tmk.ent.lc results in error: The server is not operational.
.
Querying GC://mktmp2dc03.tmk.ent.lc using filter (DistinguishedName=CN=Vibha K. Prajapati,OU=MCKUsers,OU=AllUsers,DC=tmk,DC=ent,DC=lc)
Error executing group_allowwritemembers_Get on object CN=TG_SQL_AWTMNDSKWLSQL01_EnterpriseLead_RO,OU=TaskGroups,OU=AllGroups,DC=tmk,DC=ent,DC=lc (Error: [System.Reflection.TargetInvocationException] Exception has been thrown by the target of an invocation.
[System.Runtime.InteropServices.COMException] The server is not operational.
).
Property vrtAllowWriteMembers will be set.
Querying GC://MKTMP1DC01.tmk.ent.lc using filter (DistinguishedName=CN=Vibha K. Prajapati,OU=MCKUsers,OU=AllUsers,DC=tmk,DC=ent,DC=lc)
Querying GC MKTMP1DC01.tmk.ent.lc results in error: The server is not operational.
.
Querying GC://mktmp2dc03.tmk.ent.lc using filter (DistinguishedName=CN=Vibha K. Prajapati,OU=MCKUsers,OU=AllUsers,DC=tmk,DC=ent,DC=lc)
Error executing group_allowwritemembers_Set on object CN=TG_SQL_AWTMNDSKWLSQL01_EnterpriseLead_RO,OU=TaskGroups,OU=AllGroups,DC=tmk,DC=ent,DC=lc (Error: [System.Reflection.TargetInvocationException] Exception has been thrown by the target of an invocation.
[System.Runtime.InteropServices.COMException] The server is not operational.
).
The server is not operational.

Exception has been thrown by the target of an invocation.
Error writing one or more properties of object.
Object not committed successfully. Retrying using single property commit.
Property groupType not changed because value is already set.
Querying GC://MKTMP1DC01.tmk.ent.lc using filter (DistinguishedName=CN=Vibha K. Prajapati,OU=MCKUsers,OU=AllUsers,DC=tmk,DC=ent,DC=lc)
Querying GC MKTMP1DC01.tmk.ent.lc results in error: The server is not operational.
.
Querying GC://mktmp2dc03.tmk.ent.lc using filter (DistinguishedName=CN=Vibha K. Prajapati,OU=MCKUsers,OU=AllUsers,DC=tmk,DC=ent,DC=lc)
Error executing group_allowwritemembers_Get on object CN=TG_SQL_AWTMNDSKWLSQL01_EnterpriseLead_RO,OU=TaskGroups,OU=AllGroups,DC=tmk,DC=ent,DC=lc (Error: [System.Reflection.TargetInvocationException] Exception has been thrown by the target of an invocation.
[System.Runtime.InteropServices.COMException] The server is not operational.
).
Property vrtAllowWriteMembers will be set.
Querying GC://MKTMP1DC01.tmk.ent.lc using filter (DistinguishedName=CN=Vibha K. Prajapati,OU=MCKUsers,OU=AllUsers,DC=tmk,DC=ent,DC=lc)
Querying GC MKTMP1DC01.tmk.ent.lc results in error: The server is not operational.
.
Querying GC://mktmp2dc03.tmk.ent.lc using filter (DistinguishedName=CN=Vibha K. Prajapati,OU=MCKUsers,OU=AllUsers,DC=tmk,DC=ent,DC=lc)
Error executing group_allowwritemembers_Set on object CN=TG_SQL_AWTMNDSKWLSQL01_EnterpriseLead_RO,OU=TaskGroups,OU=AllGroups,DC=tmk,DC=ent,DC=lc (Error: [System.Reflection.TargetInvocationException] Exception has been thrown by the target of an invocation.
[System.Runtime.InteropServices.COMException] The server is not operational.
).
The server is not operational.

Exception has been thrown by the target of an invocation.
Property secretary not changed because value is already set.
))
   at VI.Projector.JobComponent.ProjectorComponent._AdHocProjection()
   at VI.Projector.Database.ProjectorExecutor.Project(ISession session, IProjectionConfiguration configuration, ProjectionOption options, ISystemObject adHocObject, CancellationToken cancellationToken)
   at VI.Projector.Projection.Extensions.Execute(IProjectorEngine engine, IProjectionConfiguration configuration, ProjectionOption options, ISystemObject adHocObject, CancellationToken cancellationToken)
   at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
   ---- Start of Inner Exception ----
   at VI.Projector.Projection.ProjectorEngine.<ExecuteAsync>d__3.MoveNext()
   ---- Start of Inner Exception ----
   at VI.Projector.Projection.ProjectorEngine.<ExecuteAsync>d__3.MoveNext()
   ---- Start of Inner Exception ----
   at VI.Projector.Projection.ProjectorEngine.<ExecuteAsync>d__3.MoveNext()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
--- End of stack trace from previous location where exception was thrown ---
   at VI.Projector.Projection.ProjectionStrategy.<ExecuteStepAsync>d__2.MoveNext()
   ---- Start of Inner Exception ----
   at VI.Projector.Projection.ProjectionStrategy.<ExecuteStepAsync>d__2.MoveNext()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
--- End of stack trace from previous location where exception was thrown ---
   at VI.Projector.Projection.ProjectionStrategyBase.<OnExecuteStepAsync>d__2.MoveNext()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
--- End of stack trace from previous location where exception was thrown ---
   at VI.Projector.Projection.ProjectionStrategyBase.<_ProcessIntersectionSetAsync>d__17.MoveNext()
   at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1.ConfiguredTaskAwaiter.GetResult()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
--- End of stack trace from previous location where exception was thrown ---
   at VI.Projector.Projection.ProjectionStrategyBase.<_ProcessMappingOfSystemObjectPairsAsync>d__21.MoveNext()
   at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1.ConfiguredTaskAwaiter.GetResult()
   at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
   at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
--- End of stack trace from previous location where exception was thrown ---
   at System.Threading.Tasks.Task.Execute()
   at System.Threading.Tasks.Task`1.InnerInvoke()
   at VI.Projector.Projection.ProjectionStrategyBase.<>c__DisplayClass21_0.<_ProcessMappingOfSystemObjectPairsAsync>b__9()
   at VI.Projector.Projection.ProjectionStrategyBase._ExecuteMethods(IProjectionStep step, SystemObjectMatchingSet matchingSet, ISystemConnection connection, ISchemaMethodAssignment[] methodAssignments, IList`1 systemObjectPairs, SystemMappingSide side, ProjectionDirection projectionDirection, Boolean forceReloadObject, Boolean ignoreQuotas)
   at VI.Projector.Projection.ProjectionStrategyBase._ExecuteMethodNative(ISystemConnection connection, SystemObjectMatchingSet matchingSet, ISchemaMethod method, IEnumerable`1 objectsWithAncestryToExecute, Boolean reloadObjects, Boolean isImport)
   at VI.Projector.Connection.SystemConnection.ExecuteMethod(ISchemaMethod method, IEnumerable`1 systemObjects, ExecuteMethodOptions option)
   ---- Start of Inner Exception ----
   at VI.Projector.Connection.SystemConnection.ExecuteMethod(ISchemaMethod method, IEnumerable`1 systemObjects, ExecuteMethodOptions option)
   at VI.Projector.Journal.JournalConnector.OnExecuteMethod(ExecuteMethodRequest request)
   at VI.Projector.Connection.Connectors.BottleNeckConnector._Redirect[T](Func`1 redirection)
   at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
   ---- Start of Inner Exception ----
   at VI.Projector.Connection.Connectors.BottleNeckConnectorTask.Execute()
   at VI.Projector.Connection.Connectors.BottleNeckConnector.<>c__DisplayClass12_0.<OnExecuteMethod>b__0()
   at VI.Projector.Connection.SystemConnector.ExecuteMethod(ExecuteMethodRequest request)
   at VI.Projector.Connection.SystemConnector.CommitObject(CommitObjectRequest request)
   at VI.Projector.ADS.ProjectorADSConnector.OnCommitObject(CommitObjectRequest request)
   at VI.Projector.ProjectorBaseConnector.HandleException(ObjectRequest request, Exception Ex)
Synchronization ended with errors.
You can find more detailed information in the log from Wednesday, April 10, 2019.

This is causing some grief to our users since we are not able to provision thru OneIM.  Any and all of your help will be greatly appreciated.

TY.

JP

Parents Reply Children
No Data