Older Indices are not getting archived/deleted

Older Indices are not getting archived/deleted #658





Solution Document

ICICI || Older Indices are not getting archived/deleted

Overview

General/Customer specific

General

Author

Akash Thosare

Reviewer

Approver

 NA

Release date

18/08/2022

Product Version

8.5r5


Audience: CSG/TechWarriors/PAC/Platform/Product teams


What’s the Issue?

ICICI || Older Indices are not getting archived/deleted

Describe the Issue in Detail

scenario:

  1. As per retention setting (10 days) old indices are expected to get archived/deleted automatically.


  1. However, we are seeing indices of 2-3 months older to be in open state. due to which the disk space is getting consumed at times and we are deleting the indices manually.




Solution Summary


  1. After analysis of this issue it is known that the indices are successfully getting deleted as per the data retention policy, but those indices get created again everyday with older data coming from some data point(s).
  2. All this appears as if the indices are not getting deleted.
  3. We checked on target servers where server timestamp was not correct due to which data was indexing with older date and creating index again.

Solution Steps in Detail

Note -


  1. Turn on the DEBUG mode for the DAQ_Manage_Index module in the vusoft_logging.conf file so that we can check the logs.
  2. After analysis of this issue it is known that the indices are successfully getting deleted as per the data retention policy, but those indices get created again everyday with older data coming from some data point(s).
  3. All this appears as if the indices are not getting deleted.
  4. We checked on target servers where server timestamp was not correct due to which data was indexing with older date and creating index again.


Corrective actions if any to avoid in future


More Help: .


References:





    • Related Articles

    • #967 - CICI || Older Indices are not getting archived/deleted

      Solution Document ICICI || Older Indices are not getting archived/deleted Overview General/Customer specific General Author Seema Prasath Reviewer NA Approver NA Release date 18/08/2023 Product Version 9.5r0 Audience: ...

    • Can we restore an archived index and close it and then again archive it?

      Question: I want to understand that can we restore an archived index and then close it and archive it again after using the information required? For example: We are keeping the data open for last 2 days for an index and archiving the older data than ...

    • ICICI || Report is not getting displayed with all BMV metrics 333

      Solution Document ICICI || Report is not getting displayed with all BMV metrics   Overview General/Customer specific General Author Harshita Chimmalagi Reviewer NA Approver  NA  Release date 15/09/2022 Product Version 8.5r5 ...

    • How to delete multiple open indices in Elasticsearch?

      Question: Sometimes in the development environment, we create a code change to store certain data in Elasticsearch. It creates a new index in Elasticsearch on a regular interval of time. For a large period of time, the number of open indices may ...

    • Reports not getting generated - 655

      Solution Document ICICI || Reports not getting generated on DR Overview General/Customer specific General Author Harshita Chimmalagi Reviewer NA Approver  NA  Release date 26/10/2022 Product Version 8.5r5 Audience: CSG/TechWarriors/Product teams ...