ElasticSearch on AWS

[philippbussche]

Hi there, I am using ElasticSearch in AWS and there authentification is different.
I added my own pipeline for this, maybe you want to have a look:
https://github.com/philippbussche/scrapy-tooling/tree/master/src/elasticsearchAWSpipeline
Maybe we want to incorporate this into the official pipeline ?
Disclaimer: I am using kind of an old version of Scrapy so obviously I would have to change things.

[jayzeng]

@philippbussche thanks for the heads-up, it looks interesting. This library supports ntlm auth (see https://github.com/knockrentals/scrapy-elasticsearch/blob/master/scrapyelasticsearch/scrapyelasticsearch.py#L60), do you mind checking in a PR by following the same pattern?