One of the most challenging tasks in any microservices ecosystem is the centralized log management, and there are many open source and paid solutions available in the market. In our ecosystem, we are using ELK stack as it provides scalability and the multitenant-capable full-text search engine that easily integrates with Logstash and Kibana for centralized […]
In our previous blog, we have covered the basics of fluentd, the lifecycle of fluentd events and the primary directives involved. In this blog, we’ll configure fluentd to dump tomcat logs to Elasticsearch. We’ll also talk about filter directive/plugin and how to configure it to add hostname field in the event stream. Fluentd is a log collector that works on […]
With the recently launched AWS Mumbai region, many of us might need to migrate our infrastructure there. In one such scenario, we have to setup Elasticsearch cluster on AWS EC2 instances and test it in Mumbai region. While migrating Elasticsearch cluster from AWS Singapore region to Aws Mumbai region, we faced few challenges, one […]
As with any software that stores data it is important o take back up of that data. Elastic search is a data store with exceptionally good capabilities of searching. In elastic search data is stored in indexes. So Either you can take back up of whole cluster or you can take back up of indexes you […]
Our cloud DevOps engineers have been using Elasticsearch on production environment for an e-commerce website for quite a while. The website has one admin server to manage activities such as adding new production, managing discounts on various items, fetching reports etc. We came across a requirement where downloading reports from admin server should not put extra load on […]
Our DevOps team was using Found for one of our projects in the production environment. We have been facing a problem with found where it’s memory pressure frequently goes up and does not drop down so easily and until the time it remains up the Found was not able to serve the requests. Then, we decided to […]
In our project we have two use cases where, we need a custom analyzer that answers both the below use cases :- Let’s take a string “king of pop michael jackson” thats indexed somewhere in my elasticsearch document. 1. First Use Case :- Searching Substring : Sometimes the end user doesn’t want to write the […]
In adaptTo() 2014, I delivered a talk on “Integrating ElasticSearch with AEM”. It started with a brief introduction about ElasticSearch, its working and flexibilty when it comes to huge amount of data. Here is a brief review of topics covered after that: How data is analyzed and indexed on the server Integration approaches with AEM […]
