An Analysis on the Comparison of the Performance and Configuration Features of Big Data Tools Solr and Elasticsearch

Abstract

Today, every kind of text, audio and visual data, which are thought to be transformed into pieces of information, are stored for long periods of time for processing. The concept of Bid Data is not only associated with the data stored, but also with the system involving hardware and software that collects, processes, stores, and analyzes the data. As the data grows bigger, their physical storage options must be provided in a distributed architecture. Solr and Elasticsearch are among the most preferred tools which makes this storage process easier. As a part of Apache Lucene project, Solr is a software which was started to be developed in 2004 with the searching features of full text, multiple search, dynamic clustering, database-integrated, open source and elasticity. Similarly, Elasticsearch is a new open-source tool for real-time, full-text and distributed search, which was launched in 2010 using the Lucene library. Although Solr and Elasticsearch have similar features, there are many parameters that differentiates one from the other such as intended use, type of use, and query and indexing performances. This study researches and analyzes the differences between Solr and Elasticsearch with regards to their query and indexing speeds, ease and difficulties of use, configuration forms, and architectures in light of the literature, and the results are discussed regarding these tools’ performances.

Keywords

• Big data,Elasticsearch,Solr

References

1. [1] F. Ohhorst, “Turning Big Data Into Big Money”, Big Data Analytics, , New Jersey, AB.D., 2013.
2. [2] Science Clouds., https://portal.futuregrid.org/., Last Access : 13.07.2016
3. [3] S. Ramamorthy, S. Rajalakshmi, “Optimized Data Analysis in Cloud using BigData Analytics Techniques,” 4th ICCCNT Conferense, Tiruchengode, India, 2013.
4. [4] C. Yeşilkaya, “Apache Solr Kurulumu”, https://blog.kodcu.com/2013/03/apache-solr-kurulumu-ornek-sorgulama/ Last Access : 13.07.2016.
5. [5] DB-Engines Ranking of Search Engines, http://db-engines.com/en/ranking/search+engine, Last Access : 13.07.2016
6. [6] Apache Solr, https://tr.wikipedia.org/wiki/Apache_Solr, Last Access : 13.07.2016
7. [7] M.A. Akca, T. Aydoğan, “Elasticsearch Yük Dengeleme Işleminin Manuel Yapılandırılması Ve Başarım Ölçümü İçin Yazılım Geliştirilmesi”, “Selcuk University, Journal of Engineering, Science & Technology, 4/2, 121-130, 2016
8. [8] Solr, “http://lucene.apache.org/solr”, Last Access : 13.07.2016

9. [9] Solr’a Giriş ve Solarium, http://www.sonsuzdongu.com/blog/solr-a-giris-ve-solarium, Last Access : 13.07.2016
10. [10] H. Akdoğan, “Elasticsearch”, https://blog.kodcu.com/2013/08/elasticsearch/, Last Access : 14.07.2016
11. [11] Apache Solr vs Elasticsearch, http://solr-vs-elasticsearch.com//, Last Access : 14.07.2016
12. [12] C. Hull, “Elasticsearch and SolrCloud a performance comparison”, http://www.slideshare.net/charliejuggler/lucene-solrlondonug-meetup28nov2014-solr-es-performance?from_action=save”, Last Access : 17.07.2016
13. [13] Tom, “Elasticsearch vs Solr Performance”, http://www.flax.co.uk/blog/2015/12/02/elasticsearch-vs-solr-performance-round-2/, Last Access : 15.07.2016
14. [14] Queries per second, https://en.wikipedia.org/wiki/Queries_per_second, Last Access : 15.07.2016