Skip to content

Use buckets

A bucket is cloud object storage (Amazon S3 or Google Cloud Storage) that shows on the project’s Storage page.

  • A managed bucket is created by projectEureka for the project.
  • An external bucket already exists. projectEureka only keeps an entry for it and never deletes the bucket.
Recording coming soon Google Cloud · buckets
Video: Google Cloud

Google Cloud video: https://docs.projecteureka.ai/clips/buckets/gcp/buckets.gcp.mp4

Video: AWS

AWS video: https://docs.projecteureka.ai/clips/buckets/aws/buckets.aws.mp4

Video: Kubernetes

Kubernetes video: https://docs.projecteureka.ai/clips/buckets/k8s/buckets.k8s.mp4

Google Cloud

Managed and external buckets are both available.
  • You need the Editor or Owner role in the project, or be a system admin, to add, change, or remove a bucket entry. Readers see the list and cannot change that entry. The server enforces this for the page, for eureka bucket add, and for a bucket request submitted as a run. Object bytes are separate: a Reader can write, read, and delete objects in a managed bucket or a keyed external bucket. The key helper does that work and does not return the key. A public bucket with no key stays read only. See Roles and permissions.
  1. Open the project and select Storage Settings.
  2. Select Create Managed Bucket.

Google Cloud

Storage Settings with the Create Managed Bucket and Add External Bucket buttons and the storage list
  1. Enter Bucket Name and Mount Target (the folder name the bucket uses under the project’s storage). A name is 3–63 characters: lowercase letters, numbers, dots, and hyphens, starting and ending with a letter or number. Spaces, an IP-shaped name, consecutive dots, a goog prefix, and the word google are refused. A flow that uses Braket needs a bucket name that starts with amazon-braket-.
  2. Choose Location. It cannot be changed after the bucket is created.
  3. Optional: select Keep previous versions of objects, Public read, or Public website (index and error page).
  4. Select Add.

Google Cloud

Create Managed Bucket form with Bucket Name, Mount Target, Location, and the bucket options

The new bucket shows at once as Creating… and the list updates by itself.

  1. In Storage Settings, select Add External Bucket.
  2. In Bucket URL or Bucket Name, paste a console link or the bucket name. Storage Provider fills in.
  3. For a private bucket, paste the Key. A public bucket needs no key and is read only. The key is stored as a secret. It is not shown again to project members, only system admins can read it. Project members write, read, and delete objects through the key helper, which uses the stored key and does not return it. A public bucket with no key stays read only.
  4. Check Mount Target, then select Add. If the mount target is left empty, the bucket name is used. projectEureka never deletes an external bucket. It only keeps this entry.

Google Cloud

Add External Bucket form with Bucket URL or Bucket Name, Mount Target, Storage Provider, and Key

A name or a mount target that this project already uses is refused: A storage resource in this project is already named … or Mount … is already in this project.

eureka bucket add NAME --project PROJECT [--target MOUNT] checks the name the same way as the form. --target defaults to the bucket name.

See the bucket setup notes in the repo (doc/storage.md) for CORS and key formats.

  1. In Storage Settings, open the row’s Actions and select Delete.
  2. Confirm.
  • An external bucket: only the projectEureka entry is removed. The cloud bucket is left.
  • A managed bucket: the cloud bucket is deleted only if it is empty. If it has files, the message This bucket was not removed explains why. You can then select Remove projectEureka entry to remove only the entry and keep the bucket and files.

Google Cloud

Screenshot coming soonGoogle Cloud · public/screenshots/buckets/buckets-step4.gcp.png