add index mapping

[dijadev]

Hi!
How could I define a mapping for each field?
I want all my index fields to be indexed with mapping "not_analyzed" so i can get exacte values in search results.

Thank you,

[jayzeng]

@dijadev this is a elasticsearch question, I would suggest you to follow https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-put-mapping.html

[hieu-n]

I found this issue by Google. I think @dijadev was aware of insert/update Elasticsearch mappings by using the REST API. I guess what @dijadev meant is a way to define the mapping (or the template) from ScrapyElasticsearch pipeline settings. For an example:

# in settings.py
ELASTICSEARCH_INDEX_MAPPING = {
# some mapping settings here
}
ELASTICSEARCH_TEMPLATE = {
# some template settings here
}

In from_crawler methods, we could add some code to upload this template/mapping to Elasticsearch server (by using put_template and put_mapping methods from the official elasticsearch python library: https://elasticsearch-py.readthedocs.io/en/master/api.html).

I got this idea from Logstash (I am sure you guys know what it is). It also has the configuration to define the template (template, template_name, template_overwrite, ...): https://www.elastic.co/guide/en/logstash/current/plugins-outputs-elasticsearch.html#plugins-outputs-elasticsearch-template

I hope @jayzeng may consider this as a feature request.

[jayzeng]

@hieu-n thanks for elaborating the issue, template in logstash accepts a mapping json. Is that what you are looking for? I can implement the feature by providing similar settings (template, which is a mapping file, template_name and template_overwrite)

[hieu-n]

@jayzeng I think putting the mapping in a separate json file as logstash does is a good idea, because the mapping could be lengthy and complex. However, it is up to you to decide.

[dijadev]

@hieu-n Yah it's exactly what I was looking for, but finally I defined the mapping in elasticsearch directly as described in elasticseach doc..
Thanks everyone !