elasticsearch debug level logging quickly fills up disk

Bug #1558759 reported by Travis Tripp
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Searchlight
New
Low
Unassigned

Bug Description

As the amount of data we add grows, i've noticed the log messages are getting really out of hand. For example, if I do a search from horizon allowing 100 results, the devstack screen session will show 6 pages (225 * 80 terminal size) of information for a single request.

We need to figure out a better setting for this or people deploying searchlight in devstack will find the logs to quickly get out of hand.

2016-03-17 13:36:46.876 DEBUG elasticsearch [req-9a64d88e-69ec-4ccd-a112-eace11aac379 436f53362bda4cdabe17b22e254dd76a 6c574d27888a4f07b3745d6ef2d385a7 - - -]

<The full search results>

} from (pid=81012) log_request_success /usr/local/lib/python2.7/dist-packages/elasticsearch/connection/base.py:66

description: updated
Revision history for this message
Steve McLellan (sjmc7) wrote :

Don't log at DEBUG level? :)

A large amount of the logging is from the elasticsearch client; we could consider setting a separate log level for those logs so that you can see searchlight debug level logging without the several hundred lines from elasticsearch.

For mitaka i'd recommend setting debug = False in long running deployments.

Changed in searchlight:
importance: Undecided → Low
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.