• State Not Answered
  • Replies 2 replies
  • Subscribers 97 subscribers
  • Views 903 views
  • Users 0 members are here
Options
Related

History database

emna neffati_30808
over 2 years ago

Hello all,


We recently implemented the data archiving process and there were huge number of data to be historized which caused a lot of slowness in the 1IM tools and responsiveness of the portal.
How do we prevent such behavior?
When we stop the schedule that triggers the process of data archiving does it have an impact on the data or not?


Thank you

  • 0 over 2 years ago

    What version of Identity Manager? Do you mean the nightly maintenance jobs that run such as the reindex ? If they are taking a long time to run it can be related to the amount of data that you have in those tables. I imagine the DBQueue tasks are going into reset, if they are you can check the dialog journal to confirm why they are going into reset.

  • 0 over 1 year ago

    To prevent slowness and improve responsiveness during the data archiving process, you can consider the following strategies along with CRM enrichment:

    1. To ensure efficient performance, assess the data archiving process for bottlenecks and areas that can be streamlined. Implement optimizations in queries, data retrieval methods, and processing speed to enhance overall efficiency and accommodate CRM enrichment.

    2. Incorporate batch processing by dividing the data into smaller segments or batches. Sequentially process these batches to minimize system load, allowing resources to be allocated for CRM enrichment and other tasks without compromising performance.

    3. Plan the data archiving process during off-peak hours or low-usage periods. By executing the process when the system experiences lower activity, you can mitigate the impact on responsiveness and dedicate resources to CRM enrichment during high-traffic times.

    4. Introduce throttling mechanisms to manage concurrent archiving processes and data archival rates. By regulating these aspects, you can prevent system overload, ensuring that ample resources are accessible for CRM enrichment and critical operations.

    5. Evaluate your existing infrastructure and scale up resources like processing power, memory, and storage. This augmentation can accommodate the demands of both data archiving and CRM enrichment. Consider enhancements such as additional servers, increased memory allocation, or hardware upgrades to maintain optimal performance.