Download a file from a HTTP server.
This task connects to a HTTP server and copy a file to Kestra's internal storage.
type: "io.kestra.plugin.core.http.Download"Download a CSV file.
id: download
namespace: company.team
tasks:
- id: extract
type: io.kestra.plugin.core.http.Download
uri: https://huggingface.co/datasets/kestra/datasets/raw/main/csv/orders.csvYESThe fully-qualified URI that points to the HTTP destination
YESIf true, allow a failed response code (response code >= 400)
Deprecated, use options.allowFailed instead.
YESThe full body as a string
YESapplication/jsonThe request content type
YEStrueShould the task fail when downloading an empty file.
YESThe form data to be send
YESThe headers to pass to the request
YESGETThe HTTP method to use
NO{
"followRedirects": "true",
"allowFailed": "false",
"defaultCharset": "UTF-8"
}The HTTP request options
NOThe SSL request options
The status code of the response.
The headers of the response.
The content-length of the response.
uriThe URL of the downloaded file on Kestra's internal storage.
YESdurationThe time allowed to establish a connection to the server before failing.
YESPT5MdurationThe time allowed for a read connection to remain idle before closing it.
YESThe password for HTTP basic authentication.
YESThe username for HTTP basic authentication.
YESfalseIf true, allow a failed response code (response code >= 400)
NOThe authentification to use.
NOThe password for HTTP basic authentication.
NOThe username for HTTP basic authentication.
NOdurationThe time allowed to establish a connection to the server before failing.
NOdurationThe time an idle connection can remain in the client's connection pool before being closed.
YESUTF-8The default charset for the request.
YEStrueWhether redirects should be followed automatically.
NOALLTRACEDEBUGINFOWARNERROROFFNOT_SPECIFIEDThe log level for the HTTP client.
NOREQUEST_HEADERSREQUEST_BODYRESPONSE_HEADERSRESPONSE_BODYThe enabled log.
NOThe maximum content length of the response.
NOThe proxy configuration.
NOThe address of the proxy server.
NOThe password for proxy authentication.
NOThe port of the proxy server.
NODIRECTHTTPSOCKSThe type of proxy to use.
NOThe username for proxy authentication.
NOdurationThe time allowed for a read connection to remain idle before closing it.
NOdurationThe maximum time allowed for reading data from the server before failing.
NOThe SSL request options
NOThe timeout configuration.
YESThe address of the proxy server.
YESThe password for proxy authentication.
YESThe port of the proxy server.
YESThe username for proxy authentication.
YESWhether to disable checking of the remote SSL certificate.
Only applies if no trust store is configured. Note: This makes the SSL connection insecure and should only be used for testing. If you are using a self-signed certificate, set up a trust store instead.
YESThe token for bearer token authentication.