SCIM synchronization performance

Hello,

What version are you running?

What is SCIM connecting to?

Generally, enabling the cache will increase performance.  More on this here:

https://support.oneidentity.com/technical-documents/identity-manager/8.2/target-system-synchronization-reference-guide/41#TOPIC-1717041

Trevor

Thank you Trevor.

One Identity version is 8.1.3

SCIM is connected to application called Drillster, Drillster has midelware azure end points.

One identity is coneecting to midleware and midleware is connecting to Application.

After checking Use local cache option I am getting error when I do target system browse.

When I keep this option unchecked browes funftion is working and I can see user objects.

What is the error?

error is as below:

[1777384] : Error while reading User objects with properties ().
at VI.Projector.SCIM.Connector.ProjectorSCIMConnector.OnQueryObjectsByFilter(QueryObjectsByFilterRequest request)
at VI.Projector.ProjectorBaseConnector.HandleException(ObjectRequest Request, Exception Ex, Object[] MethodArguments, String MethodName)
The operation has timed out
at System.Threading.Tasks.Task.<>c__DisplayClass176_0.<ExecuteSelfReplicating>b__0(Object )
at System.Threading.Tasks.Task.InnerInvokeWithArg(Task childTask)
at System.Threading.Tasks.Parallel.<>c__DisplayClass17_0`1.<ForWorker>b__1()
at VI.Projector.SCIM.Connector.SCIMNativeSystemConnection.<>c__DisplayClass4_1.<Partition>b__1(SCIMAssembledDataObject obj)
at VI.Projector.SCIM.Connector.SCIMAssembledDataObject.ToSystemObjectData(ProjectorSCIMConnectorSchemaType schemaType, String[] propertiesToLoad, String Uid, Boolean AllProperties)
at VI.Projector.SCIM.Connector.ValueHandlerJson.VHGetValue(Object DEntry, ProjectorSCIMConnectorSchemaProperty Property, Boolean IsMultivalued)
at VI.Projector.SCIM.Connector.ValueHandlerJson.VHGetRaw(Object DEntry, String PropertyName, Boolean IsMultivaluedSubattribute)
at VI.Projector.SCIM.Connector.SCIMAssembledDataObject.get_DataJson()
at VI.Projector.SCIM.Connector.SCIMAssembledDataObject.LoadSCIMData(Boolean Reload)
at VI.Projector.SCIM.Connector.RESTConnection.Call(String endPoint, String method, IDictionary`2 data, String query, List`1 AcceptedStatusCodes)
at VI.Projector.SCIM.Connector.Request.Send(IList`1 acceptedStatusCodes)
The operation has timed out
at VI.Projector.SCIM.Connector.Request.Send(IList`1 acceptedStatusCodes)
at System.Net.HttpWebRequest.GetResponse()

error is as below:

[1777384] : Error while reading User objects with properties ().
at VI.Projector.SCIM.Connector.ProjectorSCIMConnector.OnQueryObjectsByFilter(QueryObjectsByFilterRequest request)
at VI.Projector.ProjectorBaseConnector.HandleException(ObjectRequest Request, Exception Ex, Object[] MethodArguments, String MethodName)
The operation has timed out
at System.Threading.Tasks.Task.<>c__DisplayClass176_0.<ExecuteSelfReplicating>b__0(Object )
at System.Threading.Tasks.Task.InnerInvokeWithArg(Task childTask)
at System.Threading.Tasks.Parallel.<>c__DisplayClass17_0`1.<ForWorker>b__1()
at VI.Projector.SCIM.Connector.SCIMNativeSystemConnection.<>c__DisplayClass4_1.<Partition>b__1(SCIMAssembledDataObject obj)
at VI.Projector.SCIM.Connector.SCIMAssembledDataObject.ToSystemObjectData(ProjectorSCIMConnectorSchemaType schemaType, String[] propertiesToLoad, String Uid, Boolean AllProperties)
at VI.Projector.SCIM.Connector.ValueHandlerJson.VHGetValue(Object DEntry, ProjectorSCIMConnectorSchemaProperty Property, Boolean IsMultivalued)
at VI.Projector.SCIM.Connector.ValueHandlerJson.VHGetRaw(Object DEntry, String PropertyName, Boolean IsMultivaluedSubattribute)
at VI.Projector.SCIM.Connector.SCIMAssembledDataObject.get_DataJson()
at VI.Projector.SCIM.Connector.SCIMAssembledDataObject.LoadSCIMData(Boolean Reload)
at VI.Projector.SCIM.Connector.RESTConnection.Call(String endPoint, String method, IDictionary`2 data, String query, List`1 AcceptedStatusCodes)
at VI.Projector.SCIM.Connector.Request.Send(IList`1 acceptedStatusCodes)
The operation has timed out
at VI.Projector.SCIM.Connector.Request.Send(IList`1 acceptedStatusCodes)
at System.Net.HttpWebRequest.GetResponse()

I'd suggest to open a Service Request with Support and request hotfix 32757.

Also I have noticed that SCIM loads data in batch of 1024 records from target system while synchronizing records in OIM database.

And if any single record throws error in this 1024 then complete batch is rejected for loading in one identity database.

In our case we have total records 11385 in target application but synchronization synch only 10361 records in database.

After analyzing issue I found that there was error in GET request for one record and sync rejected to load 1024 records.

Will this issue is also fixed as part of hotfix 32757.

Hi Trevor,

After fixing error mesage we checked Use local cache option and ran simulation but simulation takes time about 1 Hour.

Could you please let me know what can be done.

I suggest to open a Service Request so we can provide any required hotfixes, and review the errors you're referring to.

An hour is not uncommon for a full sync to run.  It may depend on your environment, e.g. network speed, SQL performance, etc.  This would require further analysis.

Trevor