Scroll

Scroll over search request.

Get all documents from a search request and store it as Kestra Internal Storage file.

yaml
type: "io.kestra.plugin.elasticsearch.Scroll"

yaml
id: elasticsearch_scroll
namespace: company.team

tasks:
  - id: scroll
    type: io.kestra.plugin.elasticsearch.Scroll
    connection:
      hosts:
        - "http://localhost:9200"
    indexes:
      - "my_index"
    request:
      query:
        term:
          name:
            value: 'john'

Dynamic NO

The connection properties.

Dynamic YES

The ElasticSearch value.

Can be a JSON string. In this case, the contentType will be used or a raw Map.

Dynamic NO

Default JSON

Possible Values

CBORJSONSMILEYAML

The content type of value.

Not used anymore.

SubType string

Dynamic YES

The ElasticSearch indices.

Default to all indices.

Dynamic YES

Controls the shard routing of the request.

Using this value to hash the shard and not the id.

The size of the rows fetch

Format uri

The uri of store result

SubType string

Dynamic YES

Min items 1

List of HTTP ElasticSearch servers.

Must be an URI like https://elasticsearch.com: 9200 with scheme and port.

Dynamic NO

Basic auth configuration.

SubType string

Dynamic YES

List of HTTP headers to be send on every request.

Must be a string with key value separated with : , ex: Authorization: Token XYZ.

Dynamic YES

Sets the path's prefix for every request used by the HTTP client.

For example, if this is set to /my/path, then any client request will become /my/path/ + endpoint. In essence, every request's endpoint is prefixed by this pathPrefix. The path prefix is useful for when ElasticSearch is behind a proxy that provides a base path or a proxy that requires all paths to start with '/'; it is not intended for other purposes and it should not be supplied in other scenarios.

Dynamic YES

Whether the REST client should return any response containing at least one warning header as a failure.

Dynamic YES

Trust all SSL CA certificates.

Use this if the server is using a self signed SSL certificate.

Dynamic YES

Basic auth password.

Dynamic YES

Basic auth username.

​Scroll

Scroll