[RBL] Issue With Data Indexing

[RBL] Issue With Data Indexing

There is following issue with the RBL project.  We are monitoring ESB as an application in RBL. Currently, I am not able to see proper data getting indexed. Redis queue building up and dequeuing is also happening properly. There is no error in ES as well. Can someone help me to resolve this issue?  We are getting very less count of transactions which is unusual. We are collecting data from log files in this case.  I have changed thread pool bulk queue size to 1000 but ES is failing. Please suggest the solution for this issue.

ANSThe issue got resolved by following steps:
  1. There was issue with configuring thread_pool. one parameter(search.queue_size) with thread_pool and another with threadpool …(bulk.queue_size)
  2. Issue was ‘failed to parse field field name’. After resolving this it started showing in the logs properly. Here for this application, date field is not standardized across all logs hence this issue started coming up.
    • Related Articles

    • What should I do when I see slow search performance or slow indexing performance in Elasticsearch?

      If we talk about performance problems, we can think of the following use cases from the end-user perspective. Search Performance is slow, i.e you execute a search from Kibana and the response is slow or times out. Indexing Performance is slow. i.e ...
    • [RBL] Issue In Telnet (Unable To Telnet Through Port 5050 From Source Server)

      In RBL there is an issue in telnet (unable to telnet through port 5050 from source server) Source :: ebanking servers Destination :: Vunet shipper Port :: 5050 RBL network team said everything thing is fine from source end but we are not getting ...
    • Incident Index data not coming 353

      Incident Index data not coming Overview General/Customer specific General Author Rukmini Reviewer Seema Approver   Release date 03/09/2022 Product Version 9.1r3 Audience: CSG/TechWarriors/PAC/Platform/Product teams What’s the Issue?  In BMCSL ...
    • Issue with analyser logstash

      Question: In intellect analyser logstash is in excited state. Even after restarting the service it’s again going into excited state. There is no space issue also . Data has stopped coming from last night 11:00pm.  Following errors seen in logstash ...
    • Unable to process data in shipper1 510

      VuNet Systems Private Limited Unable to process data in shipper1 510 Overview General/Customer specific RBL Author Rachitha H V Reviewer Seema Approver Deepak G Release date Product Version 8.5r5 Audience: CSG/TechWarriors/PAC/Platform/Product teams ...