How to use nsq as a broker for the ELK stack (ElasticSearch+LogStash+Kibana)

Question

I am trying to use nsq as a broker for the ELK stack.

I was thinking of doing this by having nsq send data to elasticsearch via the REST api. According to that doc, I can make an HTTP PUT request to add data to elastic search.

But, according the nsq doc, nsq can only make a POST or GET request via the nsq_to_http utility. I can't make a PUT request which elasticsearch requires. How can I pass values from nsq to elasticsearch?

Answer 1

You could use the nsq_to_file utility and then use logstash to post the files. For anything further you would need to look at the code to adapt it to what you want.