What is Brage and S3?
Brage (brage.it.ntnu.no) is an object storage based on Dell ECS. It uses amazon S3 api for access. It's primary use case for backing up large amounts of scientific data, 100 Terrabytes or more, which is either to be archived or to be used by a web application or to be accessed by users who does not have a NTNU account.
How Do I get access to Brage & S3?
please send an email to: help@hpc.ntnu.no and make an inquiry
How do I upload or download data from NTNU S3/brage.it.ntnu.no?
All data access is done with S3 api, so you need access ID key and Access secret key. With access ID and key you may use either s3browser (Win) and equivalents or awscli
We have an example on how to use Cyberduck S3 browser (on mac) for s3
Another good client for S3 is Rclone, which also comes with it's own experimental gui. Rclone can also serve your s3 files with its built in web server.
Different keys with different access rights may be created per bucket or object.
Where can I find documentation for S3?
Generally you should look up aws s3 api documentation, but in addition Dell has it's documentation for their S3 online
We also have a local copy of ECS data access guide, but latest information is always available on Dell websites.
example awscli config files:
$ cat .aws/config
[default]
output=json
[plugins]
endpoint = awscli_plugin_endpoint
[profile mhread]
services = mh
[profile mhwrite]
services = mh
[profile mhfullaccess]
services = mh
[services mh]
s3=
endpoint_url = http://129.241.241.254
[profile brage]
s3 =
endpoint_url = http://brage.it.ntnu.no
[mhread]
aws_access_key_id=AKIA8E210FD3550BED0D
aws_secret_access_key=SECRETKEY
aws_session_token=
[mhwrite]
aws_access_key_id=AAKIAF777D09943CDE46
aws_secret_access_key=SECRETKEY
aws_session_token=
[mhfullaccess]
aws_access_key_id=AKIA93F8466C2A69065F
aws_secret_access_key=SECRETKEY
aws_session_token=
[brage]
aws_access_key_id=AKIA01AAE164319CDE39
aws_secret_access_key=SECRETKEY
aws_session_token=