How to connect to Amazon S3 (with session token)

This article explains the steps to be followed to connect to a Amazon S3 storage from Zetaris

1. Login to Zetaris and on the left hand side pane, under Data Lake Warehouses click '+' to create a new file source

2. Provide a name that uniquely identifies the file source (e.g. format: AmazonS3_data) and enter the required S3 storage parameters .

3. Once you click Create, if the entered details are correct, you will be able to successfully connect to the S3 storage bucket.

4. When you refresh the newly created data lake warehouse, you will now be able to see all the objects form the storage.

Datasource Registration via Command

CREATE LIGHTNING FILESTORE TABLE store_sales FROM TPCDS_S3 FORMAT PARQUET OPTIONS (

    PATH "s3a://zetaris-emr-test/tpcds_db/store_sales/",

    inferSchema "true",

    header "true",

    AWSACCESSKEYID "XXX",

    AWSSECRETACCESSKEY "Rg/zo1Tdzr6qoTnysdcBQVobFq8VL2zMoUw0S8pQ",

    awsSessionToken "XXX"

);