Skip to main content
Version: 3.2

Google Cloud Storage Listener

The Google Cloud Storage Listener monitors Google Storage buckets for files and will execute a pre-defined Job Configuration (config-id) when triggered.

Notes

Add Blob Storage Permissions

For more information on how to create/obtain this key, see https://cloud.google.com/storage/docs/reference/libraries#setting_up_authentication

application.properties

<ProgramDataDirectory>/Actian/FileFolderListener/conf/application.properties

Example

# GCP Storage Connection Info (key file)
gcp.storage.service-account-key=C:/ProgramData/AccessKeys/gcp-account-name-1-935e6EXAMPLE.json

Listener Configuration

listeners.yml

<ProgramDataDirectory>/Actian/FileFolderListener/conf/listeners.yml

Example

IMPORTANT

Indentation is critical for YAML syntax!

listeners:      
- id: gcp-bucket-listener-accounts
config-id: 90378
listener-type: gcp
active: true
source-bucket-name: listener-bucket-us-east1-accounts
source-bucket-region: us-east1
include-pattern: ^Accounts.*
filename-override: Accounts.txt
- id: gcp-bucket-listener-contacts
config-id: 90379
listener-type: gcp
active: true
source-bucket-name: listener-bucket-us-east1-contacts
source-bucket-region: us-east1
include-pattern: ^Contacts.*
filename-override: Contacts.txt

Properties

PropertyDescriptionDefault
idA unique identifier for the listener.
listener-typeAvailable listener types: local, aws, gcp azure.
config-idThe Job Configuration id to run in Integration Manager.
activeWhether or not this listener is active.true
source-bucket-nameThe GCP bucket name to monitor for new files.
source-bucket-regionRegion of the GCP bucket (Note that GCP region codes are slightly different from AWS S3).
include-patternIncludes files if the file name matches the regular expression pattern you specify. See Cheatsheet and RegexPal.
source-file-prefixIGNORED. NOT SUPPORTED FOR THIS LISTENER.
filename-overrideThis value will override the filename passed to Integration Manager, regardless of the original source file name. The original source file name will always be used for backup and error files.