ElasticSearch Storage Plugin

Introduced in release: 1.19

Drill’s ElasticSearch storage plugin allows you to perform SQL queries against ElasticSearch indices. This storage plugin implementation is based on Apache Calcite adapter for ElasticSearch.

For more details about supported versions please refer to Supported versions page.

Supported optimizations and features

This storage plugin supports the following optimizations:

• Project pushdown
• Filter pushdown (only expressions supported by Calcite adapter for ElasticSearch. Filter with unsupported expressions wouldn’t be pushed to ElasticSearch but will be produced by Drill)
• Limit pushdown
• Aggregation pushdown
• Sort pushdown

Besides these optimizations, ElasticSearch storage plugin supports the schema provisioning feature. For more details please refer to Specifying the Schema as Table Function Parameter.

Configuration

The plugin can be registered in Apache Drill using the drill web interface by navigating to the storage page. Following is the default registration configuration.

{
  "type": "elastic",
  "hosts": [
    "http://localhost:9200"
  ],
  "credentialsProvider": {
    "credentialsProviderType": "PlainCredentialsProvider",
    "credentials": {
      "username": "elastic",
      "password": "password"
    }
  },
  "enabled": false
}

Configuration Options