← Back to packages

Package google.pubsub.v1

Service Publisher

Service SchemaService

Service Subscriber

Message AcknowledgeConfirmation

Message AcknowledgeRequest

Message AnalyticsHubSubscriptionInfo

Message ApiViolationReason

Message AvroConfig

Message AvroFailureReason

Message AvroFormat

Message AwsKinesis

Message AwsKinesisFailureReason

Message AwsMsk

Message AwsMskFailureReason

Message AzureEventHubs

Message AzureEventHubsFailureReason

Message BigQueryConfig

Message CloudStorage

Message CloudStorageConfig

Message CloudStorageFailure

Message CommitSchemaRequest

Message ConfluentCloud

Message ConfluentCloudFailureReason

Message CreateSchemaRequest

Message CreateSnapshotRequest

Message DeadLetterPolicy

Message DeleteSchemaRequest

Message DeleteSchemaRevisionRequest

Message DeleteSnapshotRequest

Message DeleteSubscriptionRequest

Message DeleteTopicRequest

Message DetachSubscriptionRequest

Message DetachSubscriptionResponse

Message ExpirationPolicy

Message GetSchemaRequest

Message GetSnapshotRequest

Message GetSubscriptionRequest

Message GetTopicRequest

Message IngestionDataSourceSettings

Message IngestionFailureEvent

Message JavaScriptUDF

Message ListSchemaRevisionsRequest

Message ListSchemaRevisionsResponse

Message ListSchemasRequest

Message ListSchemasResponse

Message ListSnapshotsRequest

Message ListSnapshotsResponse

Message ListSubscriptionsRequest

Message ListSubscriptionsResponse

Message ListTopicSnapshotsRequest

Message ListTopicSnapshotsResponse

Message ListTopicSubscriptionsRequest

Message ListTopicSubscriptionsResponse

Message ListTopicsRequest

Message ListTopicsResponse

Message MessageStoragePolicy

Message MessageTransform

Message MessageTransformationFailureReason

Message ModifyAckDeadlineConfirmation

Message ModifyAckDeadlineRequest

Message ModifyPushConfigRequest

Message NoWrapper

Message OidcToken

Message PlatformLogsSettings

Message PubSubAvroFormat

Message PublishRequest

Message PublishResponse

Message PubsubMessage

Message PubsubWrapper

Message PullRequest

Message PullResponse

Message PushConfig

Message ReceivedMessage

Message RetryPolicy

Message RollbackSchemaRequest

Message Schema

Message SchemaSettings

Message SchemaViolationReason

Message SeekRequest

Message SeekResponse

Message Snapshot

Message StreamingPullRequest

Message StreamingPullResponse

Message Subscription

Message SubscriptionProperties

Message TextConfig

Message TextFormat

Message Topic

Message UpdateSnapshotRequest

Message UpdateSubscriptionRequest

Message UpdateTopicRequest

Message ValidateMessageRequest

Message ValidateMessageResponse

Message ValidateSchemaRequest

Message ValidateSchemaResponse

Enum Encoding

Enum SchemaView

Enum Severity

Enum State

Enum State

Enum State

Enum State

Enum State

Enum State

Enum State

Enum State

Enum State

Enum Type

Services

service Publisher google/pubsub/v1/pubsub.proto

The service that an application uses to manipulate topics, and to send messages to a topic.

Creates the given topic with the given name. See the [resource name rules] (https://cloud.google.com/pubsub/docs/pubsub-basics#resource_names).

Updates an existing topic by updating the fields specified in the update mask. Note that certain properties of a topic are not modifiable.

Adds one or more messages to the topic. Returns NOT_FOUND if the topic does not exist.

Gets the configuration of a topic.

Lists the names of the snapshots on this topic. Snapshots are used in Seek operations, which allow you to manage message acknowledgments in bulk. That is, you can set the acknowledgment state of messages in an existing subscription to the state captured by a snapshot.

rpc DeleteTopic
Request: google.pubsub.v1.DeleteTopicRequest
Response: google.protobuf.Empty

Deletes the topic with the given name. Returns NOT_FOUND if the topic does not exist. After a topic is deleted, a new topic may be created with the same name; this is an entirely new topic with none of the old configuration or subscriptions. Existing subscriptions to this topic are not deleted, but their topic field is set to _deleted-topic_.

Detaches a subscription from this topic. All messages retained in the subscription are dropped. Subsequent Pull and StreamingPull requests will return FAILED_PRECONDITION. If the subscription is a push subscription, pushes to the endpoint will stop.

service SchemaService google/pubsub/v1/schema.proto

Service for doing schema-related operations.

Commits a new schema revision to an existing schema.

Creates a new schema revision that is a copy of the provided revision_id.

rpc DeleteSchema
Request: google.pubsub.v1.DeleteSchemaRequest
Response: google.protobuf.Empty

Deletes a schema.

service Subscriber google/pubsub/v1/pubsub.proto

The service that an application uses to manipulate subscriptions and to consume messages from a subscription via the Pull method or by establishing a bi-directional stream using the StreamingPull method.

Creates a subscription to a given topic. See the [resource name rules] (https://cloud.google.com/pubsub/docs/pubsub-basics#resource_names). If the subscription already exists, returns ALREADY_EXISTS. If the corresponding topic doesn't exist, returns NOT_FOUND.

If the name is not provided in the request, the server will assign a random name for this subscription on the same project as the topic, conforming to the [resource name format] (https://cloud.google.com/pubsub/docs/pubsub-basics#resource_names). The generated name is populated in the returned Subscription object. Note that for REST API requests, you must specify a name in the request.

Gets the configuration details of a subscription.

Updates an existing subscription by updating the fields specified in the update mask. Note that certain properties of a subscription, such as its topic, are not modifiable.

Deletes an existing subscription. All messages retained in the subscription are immediately dropped. Calls to Pull after deletion will return NOT_FOUND. After a subscription is deleted, a new one may be created with the same name, but the new one has no association with the old subscription or its topic unless the same topic is specified.

Modifies the ack deadline for a specific message. This method is useful to indicate that more time is needed to process a message by the subscriber, or to make the message available for redelivery if the processing was interrupted. Note that this does not modify the subscription-level ackDeadlineSeconds used for subsequent messages.

rpc Acknowledge
Request: google.pubsub.v1.AcknowledgeRequest
Response: google.protobuf.Empty

Acknowledges the messages associated with the ack_ids in the AcknowledgeRequest. The Pub/Sub system can remove the relevant messages from the subscription.

Acknowledging a message whose ack deadline has expired may succeed, but such a message may be redelivered later. Acknowledging a message more than once will not result in an error.

Pulls messages from the server.

Establishes a stream with the server, which sends messages down to the client. The client streams acknowledgments and ack deadline modifications back to the server. The server will close the stream and return the status on any error. The server may close the stream with status UNAVAILABLE to reassign server-side resources, in which case, the client should re-establish the stream. Flow control can be achieved by configuring the underlying RPC channel.

Modifies the PushConfig for a specified subscription.

This may be used to change a push subscription to a pull one (signified by an empty PushConfig) or vice versa, or change the endpoint URL and other attributes of a push subscription. Messages will accumulate for delivery continuously through the call regardless of changes to the PushConfig.

Gets the configuration details of a snapshot. Snapshots are used in Seek operations, which allow you to manage message acknowledgments in bulk. That is, you can set the acknowledgment state of messages in an existing subscription to the state captured by a snapshot.

Lists the existing snapshots. Snapshots are used in Seek operations, which allow you to manage message acknowledgments in bulk. That is, you can set the acknowledgment state of messages in an existing subscription to the state captured by a snapshot.

Creates a snapshot from the requested subscription. Snapshots are used in Seek operations, which allow you to manage message acknowledgments in bulk. That is, you can set the acknowledgment state of messages in an existing subscription to the state captured by a snapshot. If the snapshot already exists, returns ALREADY_EXISTS. If the requested subscription doesn't exist, returns NOT_FOUND. If the backlog in the subscription is too old -- and the resulting snapshot would expire in less than 1 hour -- then FAILED_PRECONDITION is returned. See also the Snapshot.expire_time field. If the name is not provided in the request, the server will assign a random name for this snapshot on the same project as the subscription, conforming to the [resource name format] (https://cloud.google.com/pubsub/docs/pubsub-basics#resource_names). The generated name is populated in the returned Snapshot object. Note that for REST API requests, you must specify a name in the request.

Updates an existing snapshot by updating the fields specified in the update mask. Snapshots are used in Seek operations, which allow you to manage message acknowledgments in bulk. That is, you can set the acknowledgment state of messages in an existing subscription to the state captured by a snapshot.

rpc DeleteSnapshot
Request: google.pubsub.v1.DeleteSnapshotRequest
Response: google.protobuf.Empty

Removes an existing snapshot. Snapshots are used in [Seek] (https://cloud.google.com/pubsub/docs/replay-overview) operations, which allow you to manage message acknowledgments in bulk. That is, you can set the acknowledgment state of messages in an existing subscription to the state captured by a snapshot. When the snapshot is deleted, all messages retained in the snapshot are immediately dropped. After a snapshot is deleted, a new one may be created with the same name, but the new one has no association with the old snapshot or its subscription, unless the same subscription is specified.

Seeks an existing subscription to a point in time or to a given snapshot, whichever is provided in the request. Snapshots are used in [Seek] (https://cloud.google.com/pubsub/docs/replay-overview) operations, which allow you to manage message acknowledgments in bulk. That is, you can set the acknowledgment state of messages in an existing subscription to the state captured by a snapshot. Note that both the subscription and the snapshot must be on the same topic.

Messages

message AcknowledgeConfirmation (Nested in google.pubsub.v1.StreamingPullResponse ) google/pubsub/v1/pubsub.proto

Acknowledgment IDs sent in one or more previous requests to acknowledge a previously received message.

Field Type Description
1 ack_ids repeated string

Optional. Successfully processed acknowledgment IDs.

2 invalid_ack_ids repeated string

Optional. List of acknowledgment IDs that were malformed or whose acknowledgment deadline has expired.

3 unordered_ack_ids repeated string

Optional. List of acknowledgment IDs that were out of order.

4 temporary_failed_ack_ids repeated string

Optional. List of acknowledgment IDs that failed processing with temporary issues.

message AcknowledgeRequest google/pubsub/v1/pubsub.proto

Request for the Acknowledge method.

Field Type Description
1 subscription string

Required. The subscription whose message is being acknowledged. Format is projects/{project}/subscriptions/{sub}.

2 ack_ids repeated string

Required. The acknowledgment ID for the messages being acknowledged that was returned by the Pub/Sub system in the Pull response. Must not be empty.

message AnalyticsHubSubscriptionInfo (Nested in google.pubsub.v1.Subscription ) google/pubsub/v1/pubsub.proto

Information about an associated Analytics Hub subscription.

Field Type Description
1 listing string

Optional. The name of the associated Analytics Hub listing resource. Pattern: "projects/{project}/locations/{location}/dataExchanges/{data_exchange}/listings/{listing}"

2 subscription string

Optional. The name of the associated Analytics Hub subscription resource. Pattern: "projects/{project}/locations/{location}/subscriptions/{subscription}"

message ApiViolationReason (Nested in google.pubsub.v1.IngestionFailureEvent ) google/pubsub/v1/pubsub.proto

Specifies the reason why some data may have been left out of the desired Pub/Sub message due to the API message limits (https://cloud.google.com/pubsub/quotas#resource_limits). For example, when the number of attributes is larger than 100, the number of attributes is truncated to 100 to respect the limit on the attribute count. Other attribute limits are treated similarly. When the size of the desired message would've been larger than 10MB, the message won't be published at all, and ingestion of the subsequent messages will proceed as normal.

Field Type Description

message AvroConfig (Nested in google.pubsub.v1.CloudStorageConfig ) google/pubsub/v1/pubsub.proto

Configuration for writing message data in Avro format. Message payloads and metadata will be written to files as an Avro binary.

Field Type Description
1 write_metadata bool

Optional. When true, write the subscription name, message_id, publish_time, attributes, and ordering_key as additional fields in the output. The subscription name, message_id, and publish_time fields are put in their own fields while all other message properties other than data (for example, an ordering_key, if present) are added as entries in the attributes map.

2 use_topic_schema bool

Optional. When true, the output Cloud Storage file will be serialized using the topic schema, if it exists.

message AvroFailureReason (Nested in google.pubsub.v1.IngestionFailureEvent ) google/pubsub/v1/pubsub.proto

Set when an Avro file is unsupported or its format is not valid. When this occurs, one or more Avro objects won't be ingested.

Field Type Description

message AvroFormat (Nested in google.pubsub.v1.IngestionDataSourceSettings.CloudStorage ) google/pubsub/v1/pubsub.proto

Configuration for reading Cloud Storage data in Avro binary format. The bytes of each object will be set to the data field of a Pub/Sub message.

Field Type Description

message AwsKinesis (Nested in google.pubsub.v1.IngestionDataSourceSettings ) google/pubsub/v1/pubsub.proto

Ingestion settings for Amazon Kinesis Data Streams.

Field Type Description
1 state google.pubsub.v1.IngestionDataSourceSettings.AwsKinesis.State

Output only. An output-only field that indicates the state of the Kinesis ingestion source.

2 stream_arn string

Required. The Kinesis stream ARN to ingest data from.

3 consumer_arn string

Required. The Kinesis consumer ARN to used for ingestion in Enhanced Fan-Out mode. The consumer must be already created and ready to be used.

4 aws_role_arn string

Required. AWS role ARN to be used for Federated Identity authentication with Kinesis. Check the Pub/Sub docs for how to set up this role and the required permissions that need to be attached to it.

5 gcp_service_account string

Required. The GCP service account to be used for Federated Identity authentication with Kinesis (via a AssumeRoleWithWebIdentity call for the provided role). The aws_role_arn must be set up with accounts.google.com:sub equals to this service account number.

message AwsKinesisFailureReason (Nested in google.pubsub.v1.IngestionFailureEvent ) google/pubsub/v1/pubsub.proto

Failure when ingesting from an AWS Kinesis source.

Field Type Description
1 stream_arn string

Optional. The stream ARN of the Kinesis stream being ingested from.

2 partition_key string

Optional. The partition key of the message that failed to be ingested.

3 sequence_number string

Optional. The sequence number of the message that failed to be ingested.

oneof reason
4 schema_violation_reason google.pubsub.v1.IngestionFailureEvent.SchemaViolationReason

Optional. The Pub/Sub message failed schema validation.

5 message_transformation_failure_reason google.pubsub.v1.IngestionFailureEvent.MessageTransformationFailureReason

Optional. Failure encountered when applying a message transformation to the Pub/Sub message.

message AwsMsk (Nested in google.pubsub.v1.IngestionDataSourceSettings ) google/pubsub/v1/pubsub.proto

Ingestion settings for Amazon MSK.

Field Type Description
1 state google.pubsub.v1.IngestionDataSourceSettings.AwsMsk.State

Output only. An output-only field that indicates the state of the Amazon MSK ingestion source.

2 cluster_arn string

Required. The Amazon Resource Name (ARN) that uniquely identifies the cluster.

3 topic string

Required. The name of the topic in the Amazon MSK cluster that Pub/Sub will import from.

4 aws_role_arn string

Required. AWS role ARN to be used for Federated Identity authentication with Amazon MSK. Check the Pub/Sub docs for how to set up this role and the required permissions that need to be attached to it.

5 gcp_service_account string

Required. The GCP service account to be used for Federated Identity authentication with Amazon MSK (via a AssumeRoleWithWebIdentity call for the provided role). The aws_role_arn must be set up with accounts.google.com:sub equals to this service account number.

message AwsMskFailureReason (Nested in google.pubsub.v1.IngestionFailureEvent ) google/pubsub/v1/pubsub.proto

Failure when ingesting from an Amazon MSK source.

Field Type Description
1 cluster_arn string

Optional. The ARN of the cluster of the topic being ingested from.

2 kafka_topic string

Optional. The name of the Kafka topic being ingested from.

3 partition_id int64

Optional. The partition ID of the message that failed to be ingested.

4 offset int64

Optional. The offset within the partition of the message that failed to be ingested.

oneof reason
5 api_violation_reason google.pubsub.v1.IngestionFailureEvent.ApiViolationReason

Optional. The Pub/Sub API limits prevented the desired message from being published.

6 schema_violation_reason google.pubsub.v1.IngestionFailureEvent.SchemaViolationReason

Optional. The Pub/Sub message failed schema validation.

7 message_transformation_failure_reason google.pubsub.v1.IngestionFailureEvent.MessageTransformationFailureReason

Optional. Failure encountered when applying a message transformation to the Pub/Sub message.

message AzureEventHubs (Nested in google.pubsub.v1.IngestionDataSourceSettings ) google/pubsub/v1/pubsub.proto

Ingestion settings for Azure Event Hubs.

Field Type Description
1 state google.pubsub.v1.IngestionDataSourceSettings.AzureEventHubs.State

Output only. An output-only field that indicates the state of the Event Hubs ingestion source.

2 resource_group string

Optional. Name of the resource group within the azure subscription.

3 namespace string

Optional. The name of the Event Hubs namespace.

4 event_hub string

Optional. The name of the Event Hub.

5 client_id string

Optional. The client id of the Azure application that is being used to authenticate Pub/Sub.

6 tenant_id string

Optional. The tenant id of the Azure application that is being used to authenticate Pub/Sub.

7 subscription_id string

Optional. The Azure subscription id.

8 gcp_service_account string

Optional. The GCP service account to be used for Federated Identity authentication.

message AzureEventHubsFailureReason (Nested in google.pubsub.v1.IngestionFailureEvent ) google/pubsub/v1/pubsub.proto

Failure when ingesting from an Azure Event Hubs source.

Field Type Description
1 namespace string

Optional. The namespace containing the event hub being ingested from.

2 event_hub string

Optional. The name of the event hub being ingested from.

3 partition_id int64

Optional. The partition ID of the message that failed to be ingested.

4 offset int64

Optional. The offset within the partition of the message that failed to be ingested.

oneof reason
5 api_violation_reason google.pubsub.v1.IngestionFailureEvent.ApiViolationReason

Optional. The Pub/Sub API limits prevented the desired message from being published.

6 schema_violation_reason google.pubsub.v1.IngestionFailureEvent.SchemaViolationReason

Optional. The Pub/Sub message failed schema validation.

7 message_transformation_failure_reason google.pubsub.v1.IngestionFailureEvent.MessageTransformationFailureReason

Optional. Failure encountered when applying a message transformation to the Pub/Sub message.

message BigQueryConfig google/pubsub/v1/pubsub.proto

Configuration for a BigQuery subscription.

Field Type Description
1 table string

Optional. The name of the table to which to write data, of the form {projectId}.{datasetId}.{tableId}

2 use_topic_schema bool

Optional. When true, use the topic's schema as the columns to write to in BigQuery, if it exists. use_topic_schema and use_table_schema cannot be enabled at the same time.

3 write_metadata bool

Optional. When true, write the subscription name, message_id, publish_time, attributes, and ordering_key to additional columns in the table. The subscription name, message_id, and publish_time fields are put in their own columns while all other message properties (other than data) are written to a JSON object in the attributes column.

4 drop_unknown_fields bool

Optional. When true and use_topic_schema is true, any fields that are a part of the topic schema that are not part of the BigQuery table schema are dropped when writing to BigQuery. Otherwise, the schemas must be kept in sync and any messages with extra fields are not written and remain in the subscription's backlog.

5 state google.pubsub.v1.BigQueryConfig.State

Output only. An output-only field that indicates whether or not the subscription can receive messages.

6 use_table_schema bool

Optional. When true, use the BigQuery table's schema as the columns to write to in BigQuery. use_table_schema and use_topic_schema cannot be enabled at the same time.

7 service_account_email string

Optional. The service account to use to write to BigQuery. The subscription creator or updater that specifies this field must have iam.serviceAccounts.actAs permission on the service account. If not specified, the Pub/Sub service agent, service-{project_number}@gcp-sa-pubsub.iam.gserviceaccount.com, is used.

message CloudStorage (Nested in google.pubsub.v1.IngestionDataSourceSettings ) google/pubsub/v1/pubsub.proto

Ingestion settings for Cloud Storage.

Field Type Description
1 state google.pubsub.v1.IngestionDataSourceSettings.CloudStorage.State

Output only. An output-only field that indicates the state of the Cloud Storage ingestion source.

2 bucket string

Optional. Cloud Storage bucket. The bucket name must be without any prefix like "gs://". See the [bucket naming requirements] (https://cloud.google.com/storage/docs/buckets#naming).

6 minimum_object_create_time google.protobuf.Timestamp

Optional. Only objects with a larger or equal creation timestamp will be ingested.

9 match_glob string

Optional. Glob pattern used to match objects that will be ingested. If unset, all objects will be ingested. See the supported patterns.

oneof input_format
3 text_format google.pubsub.v1.IngestionDataSourceSettings.CloudStorage.TextFormat

Optional. Data from Cloud Storage will be interpreted as text.

4 avro_format google.pubsub.v1.IngestionDataSourceSettings.CloudStorage.AvroFormat

Optional. Data from Cloud Storage will be interpreted in Avro format.

5 pubsub_avro_format google.pubsub.v1.IngestionDataSourceSettings.CloudStorage.PubSubAvroFormat

Optional. It will be assumed data from Cloud Storage was written via Cloud Storage subscriptions.

message CloudStorageConfig google/pubsub/v1/pubsub.proto

Configuration for a Cloud Storage subscription.

Field Type Description
1 bucket string

Required. User-provided name for the Cloud Storage bucket. The bucket must be created by the user. The bucket name must be without any prefix like "gs://". See the [bucket naming requirements] (https://cloud.google.com/storage/docs/buckets#naming).

2 filename_prefix string

Optional. User-provided prefix for Cloud Storage filename. See the object naming requirements.

3 filename_suffix string

Optional. User-provided suffix for Cloud Storage filename. See the object naming requirements. Must not end in "/".

6 max_duration google.protobuf.Duration

Optional. The maximum duration that can elapse before a new Cloud Storage file is created. Min 1 minute, max 10 minutes, default 5 minutes. May not exceed the subscription's acknowledgment deadline.

7 max_bytes int64

Optional. The maximum bytes that can be written to a Cloud Storage file before a new file is created. Min 1 KB, max 10 GiB. The max_bytes limit may be exceeded in cases where messages are larger than the limit.

8 max_messages int64

Optional. The maximum number of messages that can be written to a Cloud Storage file before a new file is created. Min 1000 messages.

9 state google.pubsub.v1.CloudStorageConfig.State

Output only. An output-only field that indicates whether or not the subscription can receive messages.

10 filename_datetime_format string

Optional. User-provided format string specifying how to represent datetimes in Cloud Storage filenames. See the datetime format guidance.

11 service_account_email string

Optional. The service account to use to write to Cloud Storage. The subscription creator or updater that specifies this field must have iam.serviceAccounts.actAs permission on the service account. If not specified, the Pub/Sub service agent, service-{project_number}@gcp-sa-pubsub.iam.gserviceaccount.com, is used.

oneof output_format
4 text_config google.pubsub.v1.CloudStorageConfig.TextConfig

Optional. If set, message data will be written to Cloud Storage in text format.

5 avro_config google.pubsub.v1.CloudStorageConfig.AvroConfig

Optional. If set, message data will be written to Cloud Storage in Avro format.

message CloudStorageFailure (Nested in google.pubsub.v1.IngestionFailureEvent ) google/pubsub/v1/pubsub.proto

Failure when ingesting from a Cloud Storage source.

Field Type Description
1 bucket string

Optional. Name of the Cloud Storage bucket used for ingestion.

2 object_name string

Optional. Name of the Cloud Storage object which contained the section that couldn't be ingested.

3 object_generation int64

Optional. Generation of the Cloud Storage object which contained the section that couldn't be ingested.

oneof reason
5 avro_failure_reason google.pubsub.v1.IngestionFailureEvent.AvroFailureReason

Optional. Failure encountered when parsing an Avro file.

6 api_violation_reason google.pubsub.v1.IngestionFailureEvent.ApiViolationReason

Optional. The Pub/Sub API limits prevented the desired message from being published.

7 schema_violation_reason google.pubsub.v1.IngestionFailureEvent.SchemaViolationReason

Optional. The Pub/Sub message failed schema validation.

8 message_transformation_failure_reason google.pubsub.v1.IngestionFailureEvent.MessageTransformationFailureReason

Optional. Failure encountered when applying a message transformation to the Pub/Sub message.

message CommitSchemaRequest google/pubsub/v1/schema.proto

Request for CommitSchema method.

Field Type Description
1 name string

Required. The name of the schema we are revising. Format is projects/{project}/schemas/{schema}.

2 schema google.pubsub.v1.Schema

Required. The schema revision to commit.

message ConfluentCloud (Nested in google.pubsub.v1.IngestionDataSourceSettings ) google/pubsub/v1/pubsub.proto

Ingestion settings for Confluent Cloud.

Field Type Description
1 state google.pubsub.v1.IngestionDataSourceSettings.ConfluentCloud.State

Output only. An output-only field that indicates the state of the Confluent Cloud ingestion source.

2 bootstrap_server string

Required. The address of the bootstrap server. The format is url:port.

3 cluster_id string

Required. The id of the cluster.

4 topic string

Required. The name of the topic in the Confluent Cloud cluster that Pub/Sub will import from.

5 identity_pool_id string

Required. The id of the identity pool to be used for Federated Identity authentication with Confluent Cloud. See https://docs.confluent.io/cloud/current/security/authenticate/workload-identities/identity-providers/oauth/identity-pools.html#add-oauth-identity-pools.

6 gcp_service_account string

Required. The GCP service account to be used for Federated Identity authentication with identity_pool_id.

message ConfluentCloudFailureReason (Nested in google.pubsub.v1.IngestionFailureEvent ) google/pubsub/v1/pubsub.proto

Failure when ingesting from a Confluent Cloud source.

Field Type Description
1 cluster_id string

Optional. The cluster ID containing the topic being ingested from.

2 kafka_topic string

Optional. The name of the Kafka topic being ingested from.

3 partition_id int64

Optional. The partition ID of the message that failed to be ingested.

4 offset int64

Optional. The offset within the partition of the message that failed to be ingested.

oneof reason
5 api_violation_reason google.pubsub.v1.IngestionFailureEvent.ApiViolationReason

Optional. The Pub/Sub API limits prevented the desired message from being published.

6 schema_violation_reason google.pubsub.v1.IngestionFailureEvent.SchemaViolationReason

Optional. The Pub/Sub message failed schema validation.

7 message_transformation_failure_reason google.pubsub.v1.IngestionFailureEvent.MessageTransformationFailureReason

Optional. Failure encountered when applying a message transformation to the Pub/Sub message.

message CreateSchemaRequest google/pubsub/v1/schema.proto

Request for the CreateSchema method.

Field Type Description
1 parent string

Required. The name of the project in which to create the schema. Format is projects/{project-id}.

2 schema google.pubsub.v1.Schema

Required. The schema object to create.

This schema's name parameter is ignored. The schema object returned by CreateSchema will have a name made using the given parent and schema_id.

3 schema_id string

The ID to use for the schema, which will become the final component of the schema's resource name.

See https://cloud.google.com/pubsub/docs/pubsub-basics#resource_names for resource name constraints.

message CreateSnapshotRequest google/pubsub/v1/pubsub.proto

Request for the CreateSnapshot method.

Field Type Description
1 name string

Required. User-provided name for this snapshot. If the name is not provided in the request, the server will assign a random name for this snapshot on the same project as the subscription. Note that for REST API requests, you must specify a name. See the resource name rules. Format is projects/{project}/snapshots/{snap}.

2 subscription string

Required. The subscription whose backlog the snapshot retains. Specifically, the created snapshot is guaranteed to retain: (a) The existing backlog on the subscription. More precisely, this is defined as the messages in the subscription's backlog that are unacknowledged upon the successful completion of the CreateSnapshot request; as well as: (b) Any messages published to the subscription's topic following the successful completion of the CreateSnapshot request. Format is projects/{project}/subscriptions/{sub}.

3 labels map<string, string>

Optional. See Creating and managing labels.

message DeadLetterPolicy google/pubsub/v1/pubsub.proto

Dead lettering is done on a best effort basis. The same message might be dead lettered multiple times.

If validation on any of the fields fails at subscription creation/updation, the create/update subscription request will fail.

Field Type Description
1 dead_letter_topic string

Optional. The name of the topic to which dead letter messages should be published. Format is projects/{project}/topics/{topic}.The Pub/Sub service account associated with the enclosing subscription's parent project (i.e., service-{project_number}@gcp-sa-pubsub.iam.gserviceaccount.com) must have permission to Publish() to this topic.

The operation will fail if the topic does not exist. Users should ensure that there is a subscription attached to this topic since messages published to a topic with no subscriptions are lost.

2 max_delivery_attempts int32

Optional. The maximum number of delivery attempts for any message. The value must be between 5 and 100.

The number of delivery attempts is defined as 1 + (the sum of number of NACKs and number of times the acknowledgment deadline has been exceeded for the message).

A NACK is any call to ModifyAckDeadline with a 0 deadline. Note that client libraries may automatically extend ack_deadlines.

This field will be honored on a best effort basis.

If this parameter is 0, a default value of 5 is used.

message DeleteSchemaRequest google/pubsub/v1/schema.proto

Request for the DeleteSchema method.

Field Type Description
1 name string

Required. Name of the schema to delete. Format is projects/{project}/schemas/{schema}.

message DeleteSchemaRevisionRequest google/pubsub/v1/schema.proto

Request for the DeleteSchemaRevision method.

Field Type Description
1 name string

Required. The name of the schema revision to be deleted, with a revision ID explicitly included.

Example: projects/123/schemas/my-schema@c7cfa2a8

2 revision_id string

Optional. This field is deprecated and should not be used for specifying the revision ID. The revision ID should be specified via the name parameter.

message DeleteSnapshotRequest google/pubsub/v1/pubsub.proto

Request for the DeleteSnapshot method.

Field Type Description
1 snapshot string

Required. The name of the snapshot to delete. Format is projects/{project}/snapshots/{snap}.

message DeleteSubscriptionRequest google/pubsub/v1/pubsub.proto

Request for the DeleteSubscription method.

Field Type Description
1 subscription string

Required. The subscription to delete. Format is projects/{project}/subscriptions/{sub}.

message DeleteTopicRequest google/pubsub/v1/pubsub.proto

Request for the DeleteTopic method.

Field Type Description
1 topic string

Required. Name of the topic to delete. Format is projects/{project}/topics/{topic}.

message DetachSubscriptionRequest google/pubsub/v1/pubsub.proto

Request for the DetachSubscription method.

Field Type Description
1 subscription string

Required. The subscription to detach. Format is projects/{project}/subscriptions/{subscription}.

message DetachSubscriptionResponse google/pubsub/v1/pubsub.proto

Response for the DetachSubscription method. Reserved for future use.

Field Type Description

message ExpirationPolicy google/pubsub/v1/pubsub.proto

A policy that specifies the conditions for resource expiration (i.e., automatic resource deletion).

Field Type Description
1 ttl google.protobuf.Duration

Optional. Specifies the "time-to-live" duration for an associated resource. The resource expires if it is not active for a period of ttl. The definition of "activity" depends on the type of the associated resource. The minimum and maximum allowed values for ttl depend on the type of the associated resource, as well. If ttl is not set, the associated resource never expires.

message GetSchemaRequest google/pubsub/v1/schema.proto

Request for the GetSchema method.

Field Type Description
1 name string

Required. The name of the schema to get. Format is projects/{project}/schemas/{schema}.

2 view google.pubsub.v1.SchemaView

The set of fields to return in the response. If not set, returns a Schema with all fields filled out. Set to BASIC to omit the definition.

message GetSnapshotRequest google/pubsub/v1/pubsub.proto

Request for the GetSnapshot method.

Field Type Description
1 snapshot string

Required. The name of the snapshot to get. Format is projects/{project}/snapshots/{snap}.

message GetSubscriptionRequest google/pubsub/v1/pubsub.proto

Request for the GetSubscription method.

Field Type Description
1 subscription string

Required. The name of the subscription to get. Format is projects/{project}/subscriptions/{sub}.

message GetTopicRequest google/pubsub/v1/pubsub.proto

Request for the GetTopic method.

Field Type Description
1 topic string

Required. The name of the topic to get. Format is projects/{project}/topics/{topic}.

message IngestionDataSourceSettings google/pubsub/v1/pubsub.proto

Settings for an ingestion data source on a topic.

Field Type Description
4 platform_logs_settings google.pubsub.v1.PlatformLogsSettings

Optional. Platform Logs settings. If unset, no Platform Logs will be generated.

oneof source
1 aws_kinesis google.pubsub.v1.IngestionDataSourceSettings.AwsKinesis

Optional. Amazon Kinesis Data Streams.

2 cloud_storage google.pubsub.v1.IngestionDataSourceSettings.CloudStorage

Optional. Cloud Storage.

3 azure_event_hubs google.pubsub.v1.IngestionDataSourceSettings.AzureEventHubs

Optional. Azure Event Hubs.

5 aws_msk google.pubsub.v1.IngestionDataSourceSettings.AwsMsk

Optional. Amazon MSK.

6 confluent_cloud google.pubsub.v1.IngestionDataSourceSettings.ConfluentCloud

Optional. Confluent Cloud.

message IngestionFailureEvent google/pubsub/v1/pubsub.proto

Payload of the Platform Log entry sent when a failure is encountered while ingesting.

Field Type Description
1 topic string

Required. Name of the import topic. Format is: projects/{project_name}/topics/{topic_name}.

2 error_message string

Required. Error details explaining why ingestion to Pub/Sub has failed.

oneof failure
3 cloud_storage_failure google.pubsub.v1.IngestionFailureEvent.CloudStorageFailure

Optional. Failure when ingesting from Cloud Storage.

4 aws_msk_failure google.pubsub.v1.IngestionFailureEvent.AwsMskFailureReason

Optional. Failure when ingesting from Amazon MSK.

5 azure_event_hubs_failure google.pubsub.v1.IngestionFailureEvent.AzureEventHubsFailureReason

Optional. Failure when ingesting from Azure Event Hubs.

6 confluent_cloud_failure google.pubsub.v1.IngestionFailureEvent.ConfluentCloudFailureReason

Optional. Failure when ingesting from Confluent Cloud.

7 aws_kinesis_failure google.pubsub.v1.IngestionFailureEvent.AwsKinesisFailureReason

Optional. Failure when ingesting from AWS Kinesis.

message JavaScriptUDF google/pubsub/v1/pubsub.proto

User-defined JavaScript function that can transform or filter a Pub/Sub message.

Field Type Description
1 function_name string

Required. Name of the JavasScript function that should applied to Pub/Sub messages.

2 code string

Required. JavaScript code that contains a function function_name with the below signature:

  /**
  * Transforms a Pub/Sub message.

  * @return {(Object<string, (string | Object<string, string>)>|null)} - To
  * filter a message, return `null`. To transform a message return a map
  * with the following keys:
  *   - (required) 'data' : {string}
  *   - (optional) 'attributes' : {Object<string, string>}
  * Returning empty `attributes` will remove all attributes from the
  * message.
  *
  * @param  {(Object<string, (string | Object<string, string>)>} Pub/Sub
  * message. Keys:
  *   - (required) 'data' : {string}
  *   - (required) 'attributes' : {Object<string, string>}
  *
  * @param  {Object<string, any>} metadata - Pub/Sub message metadata.
  * Keys:
  *   - (optional) 'message_id'  : {string}
  *   - (optional) 'publish_time': {string} YYYY-MM-DDTHH:MM:SSZ format
  *   - (optional) 'ordering_key': {string}
  */

  function <function_name>(message, metadata) {
  }

message ListSchemaRevisionsRequest google/pubsub/v1/schema.proto

Request for the ListSchemaRevisions method.

Field Type Description
1 name string

Required. The name of the schema to list revisions for.

2 view google.pubsub.v1.SchemaView

The set of Schema fields to return in the response. If not set, returns Schemas with name and type, but not definition. Set to FULL to retrieve all fields.

3 page_size int32

The maximum number of revisions to return per page.

4 page_token string

The page token, received from a previous ListSchemaRevisions call. Provide this to retrieve the subsequent page.

message ListSchemaRevisionsResponse google/pubsub/v1/schema.proto

Response for the ListSchemaRevisions method.

Field Type Description
1 schemas repeated google.pubsub.v1.Schema

The revisions of the schema.

2 next_page_token string

A token that can be sent as page_token to retrieve the next page. If this field is empty, there are no subsequent pages.

message ListSchemasRequest google/pubsub/v1/schema.proto

Request for the ListSchemas method.

Field Type Description
1 parent string

Required. The name of the project in which to list schemas. Format is projects/{project-id}.

2 view google.pubsub.v1.SchemaView

The set of Schema fields to return in the response. If not set, returns Schemas with name and type, but not definition. Set to FULL to retrieve all fields.

3 page_size int32

Maximum number of schemas to return.

4 page_token string

The value returned by the last ListSchemasResponse; indicates that this is a continuation of a prior ListSchemas call, and that the system should return the next page of data.

message ListSchemasResponse google/pubsub/v1/schema.proto

Response for the ListSchemas method.

Field Type Description
1 schemas repeated google.pubsub.v1.Schema

The resulting schemas.

2 next_page_token string

If not empty, indicates that there may be more schemas that match the request; this value should be passed in a new ListSchemasRequest.

message ListSnapshotsRequest google/pubsub/v1/pubsub.proto

Request for the ListSnapshots method.

Field Type Description
1 project string

Required. The name of the project in which to list snapshots. Format is projects/{project-id}.

2 page_size int32

Optional. Maximum number of snapshots to return.

3 page_token string

Optional. The value returned by the last ListSnapshotsResponse; indicates that this is a continuation of a prior ListSnapshots call, and that the system should return the next page of data.

message ListSnapshotsResponse google/pubsub/v1/pubsub.proto

Response for the ListSnapshots method.

Field Type Description
1 snapshots repeated google.pubsub.v1.Snapshot

Optional. The resulting snapshots.

2 next_page_token string

Optional. If not empty, indicates that there may be more snapshot that match the request; this value should be passed in a new ListSnapshotsRequest.

message ListSubscriptionsRequest google/pubsub/v1/pubsub.proto

Request for the ListSubscriptions method.

Field Type Description
1 project string

Required. The name of the project in which to list subscriptions. Format is projects/{project-id}.

2 page_size int32

Optional. Maximum number of subscriptions to return.

3 page_token string

Optional. The value returned by the last ListSubscriptionsResponse; indicates that this is a continuation of a prior ListSubscriptions call, and that the system should return the next page of data.

message ListSubscriptionsResponse google/pubsub/v1/pubsub.proto

Response for the ListSubscriptions method.

Field Type Description
1 subscriptions repeated google.pubsub.v1.Subscription

Optional. The subscriptions that match the request.

2 next_page_token string

Optional. If not empty, indicates that there may be more subscriptions that match the request; this value should be passed in a new ListSubscriptionsRequest to get more subscriptions.

message ListTopicSnapshotsRequest google/pubsub/v1/pubsub.proto

Request for the ListTopicSnapshots method.

Field Type Description
1 topic string

Required. The name of the topic that snapshots are attached to. Format is projects/{project}/topics/{topic}.

2 page_size int32

Optional. Maximum number of snapshot names to return.

3 page_token string

Optional. The value returned by the last ListTopicSnapshotsResponse; indicates that this is a continuation of a prior ListTopicSnapshots call, and that the system should return the next page of data.

message ListTopicSnapshotsResponse google/pubsub/v1/pubsub.proto

Response for the ListTopicSnapshots method.

Field Type Description
1 snapshots repeated string

Optional. The names of the snapshots that match the request.

2 next_page_token string

Optional. If not empty, indicates that there may be more snapshots that match the request; this value should be passed in a new ListTopicSnapshotsRequest to get more snapshots.

message ListTopicSubscriptionsRequest google/pubsub/v1/pubsub.proto

Request for the ListTopicSubscriptions method.

Field Type Description
1 topic string

Required. The name of the topic that subscriptions are attached to. Format is projects/{project}/topics/{topic}.

2 page_size int32

Optional. Maximum number of subscription names to return.

3 page_token string

Optional. The value returned by the last ListTopicSubscriptionsResponse; indicates that this is a continuation of a prior ListTopicSubscriptions call, and that the system should return the next page of data.

message ListTopicSubscriptionsResponse google/pubsub/v1/pubsub.proto

Response for the ListTopicSubscriptions method.

Field Type Description
1 subscriptions repeated string

Optional. The names of subscriptions attached to the topic specified in the request.

2 next_page_token string

Optional. If not empty, indicates that there may be more subscriptions that match the request; this value should be passed in a new ListTopicSubscriptionsRequest to get more subscriptions.

message ListTopicsRequest google/pubsub/v1/pubsub.proto

Request for the ListTopics method.

Field Type Description
1 project string

Required. The name of the project in which to list topics. Format is projects/{project-id}.

2 page_size int32

Optional. Maximum number of topics to return.

3 page_token string

Optional. The value returned by the last ListTopicsResponse; indicates that this is a continuation of a prior ListTopics call, and that the system should return the next page of data.

message ListTopicsResponse google/pubsub/v1/pubsub.proto

Response for the ListTopics method.

Field Type Description
1 topics repeated google.pubsub.v1.Topic

Optional. The resulting topics.

2 next_page_token string

Optional. If not empty, indicates that there may be more topics that match the request; this value should be passed in a new ListTopicsRequest.

message MessageStoragePolicy google/pubsub/v1/pubsub.proto

A policy constraining the storage of messages published to the topic.

Field Type Description
1 allowed_persistence_regions repeated string

Optional. A list of IDs of Google Cloud regions where messages that are published to the topic may be persisted in storage. Messages published by publishers running in non-allowed Google Cloud regions (or running outside of Google Cloud altogether) are routed for storage in one of the allowed regions. An empty list means that no regions are allowed, and is not a valid configuration.

2 enforce_in_transit bool

Optional. If true, allowed_persistence_regions is also used to enforce in-transit guarantees for messages. That is, Pub/Sub will fail Publish operations on this topic and subscribe operations on any subscription attached to this topic in any region that is not in allowed_persistence_regions.

message MessageTransform google/pubsub/v1/pubsub.proto

All supported message transforms types.

Field Type Description
3 enabled bool

Optional. This field is deprecated, use the disabled field to disable transforms.

4 disabled bool

Optional. If true, the transform is disabled and will not be applied to messages. Defaults to false.

oneof transform
2 javascript_udf google.pubsub.v1.JavaScriptUDF

Optional. JavaScript User Defined Function. If multiple JavaScriptUDF's are specified on a resource, each must have a unique function_name.

message MessageTransformationFailureReason (Nested in google.pubsub.v1.IngestionFailureEvent ) google/pubsub/v1/pubsub.proto

Set when a Pub/Sub message fails to get published due to a message transformation error.

Field Type Description

message ModifyAckDeadlineConfirmation (Nested in google.pubsub.v1.StreamingPullResponse ) google/pubsub/v1/pubsub.proto

Acknowledgment IDs sent in one or more previous requests to modify the deadline for a specific message.

Field Type Description
1 ack_ids repeated string

Optional. Successfully processed acknowledgment IDs.

2 invalid_ack_ids repeated string

Optional. List of acknowledgment IDs that were malformed or whose acknowledgment deadline has expired.

3 temporary_failed_ack_ids repeated string

Optional. List of acknowledgment IDs that failed processing with temporary issues.

message ModifyAckDeadlineRequest google/pubsub/v1/pubsub.proto

Request for the ModifyAckDeadline method.

Field Type Description
1 subscription string

Required. The name of the subscription. Format is projects/{project}/subscriptions/{sub}.

3 ack_deadline_seconds int32

Required. The new ack deadline with respect to the time this request was sent to the Pub/Sub system. For example, if the value is 10, the new ack deadline will expire 10 seconds after the ModifyAckDeadline call was made. Specifying zero might immediately make the message available for delivery to another subscriber client. This typically results in an increase in the rate of message redeliveries (that is, duplicates). The minimum deadline you can specify is 0 seconds. The maximum deadline you can specify in a single request is 600 seconds (10 minutes).

4 ack_ids repeated string

Required. List of acknowledgment IDs.

message ModifyPushConfigRequest google/pubsub/v1/pubsub.proto

Request for the ModifyPushConfig method.

Field Type Description
1 subscription string

Required. The name of the subscription. Format is projects/{project}/subscriptions/{sub}.

2 push_config google.pubsub.v1.PushConfig

Required. The push configuration for future deliveries.

An empty pushConfig indicates that the Pub/Sub system should stop pushing messages from the given subscription and allow messages to be pulled and acknowledged - effectively pausing the subscription if Pull or StreamingPull is not called.

message NoWrapper (Nested in google.pubsub.v1.PushConfig ) google/pubsub/v1/pubsub.proto

Sets the data field as the HTTP body for delivery.

Field Type Description
1 write_metadata bool

Optional. When true, writes the Pub/Sub message metadata to x-goog-pubsub-<KEY>:<VAL> headers of the HTTP request. Writes the Pub/Sub message attributes to <KEY>:<VAL> headers of the HTTP request.

message OidcToken (Nested in google.pubsub.v1.PushConfig ) google/pubsub/v1/pubsub.proto

Contains information needed for generating an OpenID Connect token.

Field Type Description
1 service_account_email string

Optional. Service account email used for generating the OIDC token. For more information on setting up authentication, see Push subscriptions.

2 audience string

Optional. Audience to be used when generating OIDC token. The audience claim identifies the recipients that the JWT is intended for. The audience value is a single case-sensitive string. Having multiple values (array) for the audience field is not supported. More info about the OIDC JWT token audience here: https://tools.ietf.org/html/rfc7519#section-4.1.3 Note: if not specified, the Push endpoint URL will be used.

message PlatformLogsSettings google/pubsub/v1/pubsub.proto

Settings for Platform Logs produced by Pub/Sub.

Field Type Description
1 severity google.pubsub.v1.PlatformLogsSettings.Severity

Optional. The minimum severity level of Platform Logs that will be written.

message PubSubAvroFormat (Nested in google.pubsub.v1.IngestionDataSourceSettings.CloudStorage ) google/pubsub/v1/pubsub.proto

Configuration for reading Cloud Storage data written via Cloud Storage subscriptions. The data and attributes fields of the originally exported Pub/Sub message will be restored when publishing.

Field Type Description

message PublishRequest google/pubsub/v1/pubsub.proto

Request for the Publish method.

Field Type Description
1 topic string

Required. The messages in the request will be published on this topic. Format is projects/{project}/topics/{topic}.

2 messages repeated google.pubsub.v1.PubsubMessage

Required. The messages to publish.

message PublishResponse google/pubsub/v1/pubsub.proto

Response for the Publish method.

Field Type Description
1 message_ids repeated string

Optional. The server-assigned ID of each published message, in the same order as the messages in the request. IDs are guaranteed to be unique within the topic.

message PubsubMessage google/pubsub/v1/pubsub.proto

A message that is published by publishers and consumed by subscribers. The message must contain either a non-empty data field or at least one attribute. Note that client libraries represent this object differently depending on the language. See the corresponding client library documentation for more information. See [quotas and limits] (https://cloud.google.com/pubsub/quotas) for more information about message limits.

Field Type Description
1 data bytes

Optional. The message data field. If this field is empty, the message must contain at least one attribute.

2 attributes map<string, string>

Optional. Attributes for this message. If this field is empty, the message must contain non-empty data. This can be used to filter messages on the subscription.

3 message_id string

ID of this message, assigned by the server when the message is published. Guaranteed to be unique within the topic. This value may be read by a subscriber that receives a PubsubMessage via a Pull call or a push delivery. It must not be populated by the publisher in a Publish call.

4 publish_time google.protobuf.Timestamp

The time at which the message was published, populated by the server when it receives the Publish call. It must not be populated by the publisher in a Publish call.

5 ordering_key string

Optional. If non-empty, identifies related messages for which publish order should be respected. If a Subscription has enable_message_ordering set to true, messages published with the same non-empty ordering_key value will be delivered to subscribers in the order in which they are received by the Pub/Sub system. All PubsubMessages published in a given PublishRequest must specify the same ordering_key value. For more information, see ordering messages.

message PubsubWrapper (Nested in google.pubsub.v1.PushConfig ) google/pubsub/v1/pubsub.proto

The payload to the push endpoint is in the form of the JSON representation of a PubsubMessage (https://cloud.google.com/pubsub/docs/reference/rpc/google.pubsub.v1#pubsubmessage).

Field Type Description

message PullRequest google/pubsub/v1/pubsub.proto

Request for the Pull method.

Field Type Description
1 subscription string

Required. The subscription from which messages should be pulled. Format is projects/{project}/subscriptions/{sub}.

2 return_immediately bool

Optional. If this field set to true, the system will respond immediately even if it there are no messages available to return in the Pull response. Otherwise, the system may wait (for a bounded amount of time) until at least one message is available, rather than returning no messages. Warning: setting this field to true is discouraged because it adversely impacts the performance of Pull operations. We recommend that users do not set this field.

3 max_messages int32

Required. The maximum number of messages to return for this request. Must be a positive integer. The Pub/Sub system may return fewer than the number specified.

message PullResponse google/pubsub/v1/pubsub.proto

Response for the Pull method.

Field Type Description
1 received_messages repeated google.pubsub.v1.ReceivedMessage

Optional. Received Pub/Sub messages. The list will be empty if there are no more messages available in the backlog, or if no messages could be returned before the request timeout. For JSON, the response can be entirely empty. The Pub/Sub system may return fewer than the maxMessages requested even if there are more messages available in the backlog.

message PushConfig google/pubsub/v1/pubsub.proto

Configuration for a push delivery endpoint.

Field Type Description
1 push_endpoint string

Optional. A URL locating the endpoint to which messages should be pushed. For example, a Webhook endpoint might use https://example.com/push.

2 attributes map<string, string>

Optional. Endpoint configuration attributes that can be used to control different aspects of the message delivery.

The only currently supported attribute is x-goog-version, which you can use to change the format of the pushed message. This attribute indicates the version of the data expected by the endpoint. This controls the shape of the pushed message (i.e., its fields and metadata).

If not present during the CreateSubscription call, it will default to the version of the Pub/Sub API used to make such call. If not present in a ModifyPushConfig call, its value will not be changed. GetSubscription calls will always return a valid version, even if the subscription was created without this attribute.

The only supported values for the x-goog-version attribute are:

  • v1beta1: uses the push format defined in the v1beta1 Pub/Sub API.
  • v1 or v1beta2: uses the push format defined in the v1 Pub/Sub API.

For example: attributes { "x-goog-version": "v1" }

oneof wrapper
4 pubsub_wrapper google.pubsub.v1.PushConfig.PubsubWrapper

Optional. When set, the payload to the push endpoint is in the form of the JSON representation of a PubsubMessage (https://cloud.google.com/pubsub/docs/reference/rpc/google.pubsub.v1#pubsubmessage).

5 no_wrapper google.pubsub.v1.PushConfig.NoWrapper

Optional. When set, the payload to the push endpoint is not wrapped.

oneof authentication_method
3 oidc_token google.pubsub.v1.PushConfig.OidcToken

Optional. If specified, Pub/Sub will generate and attach an OIDC JWT token as an Authorization header in the HTTP request for every pushed message.

message ReceivedMessage google/pubsub/v1/pubsub.proto

A message and its corresponding acknowledgment ID.

Field Type Description
1 ack_id string

Optional. This ID can be used to acknowledge the received message.

2 message google.pubsub.v1.PubsubMessage

Optional. The message.

3 delivery_attempt int32

Optional. The approximate number of times that Pub/Sub has attempted to deliver the associated message to a subscriber.

More precisely, this is 1 + (number of NACKs) + (number of ack_deadline exceeds) for this message.

A NACK is any call to ModifyAckDeadline with a 0 deadline. An ack_deadline exceeds event is whenever a message is not acknowledged within ack_deadline. Note that ack_deadline is initially Subscription.ackDeadlineSeconds, but may get extended automatically by the client library.

Upon the first delivery of a given message, delivery_attempt will have a value of 1. The value is calculated at best effort and is approximate.

If a DeadLetterPolicy is not set on the subscription, this will be 0.

message RetryPolicy google/pubsub/v1/pubsub.proto

A policy that specifies how Pub/Sub retries message delivery.

Retry delay will be exponential based on provided minimum and maximum backoffs. https://en.wikipedia.org/wiki/Exponential_backoff.

RetryPolicy will be triggered on NACKs or acknowledgment deadline exceeded events for a given message.

Retry Policy is implemented on a best effort basis. At times, the delay between consecutive deliveries may not match the configuration. That is, delay can be more or less than configured backoff.

Field Type Description
1 minimum_backoff google.protobuf.Duration

Optional. The minimum delay between consecutive deliveries of a given message. Value should be between 0 and 600 seconds. Defaults to 10 seconds.

2 maximum_backoff google.protobuf.Duration

Optional. The maximum delay between consecutive deliveries of a given message. Value should be between 0 and 600 seconds. Defaults to 600 seconds.

message RollbackSchemaRequest google/pubsub/v1/schema.proto

Request for the RollbackSchema method.

Field Type Description
1 name string

Required. The schema being rolled back with revision id.

2 revision_id string

Required. The revision ID to roll back to. It must be a revision of the same schema.

Example: c7cfa2a8

message Schema google/pubsub/v1/schema.proto

A schema resource.

Field Type Description
1 name string

Required. Name of the schema. Format is projects/{project}/schemas/{schema}.

2 type google.pubsub.v1.Schema.Type

The type of the schema definition.

3 definition string

The definition of the schema. This should contain a string representing the full definition of the schema that is a valid schema definition of the type specified in type.

4 revision_id string

Output only. Immutable. The revision ID of the schema.

6 revision_create_time google.protobuf.Timestamp

Output only. The timestamp that the revision was created.

message SchemaSettings google/pubsub/v1/pubsub.proto

Settings for validating messages published against a schema.

Field Type Description
1 schema string

Required. The name of the schema that messages published should be validated against. Format is projects/{project}/schemas/{schema}. The value of this field will be _deleted-schema_ if the schema has been deleted.

2 encoding google.pubsub.v1.Encoding

Optional. The encoding of messages validated against schema.

3 first_revision_id string

Optional. The minimum (inclusive) revision allowed for validating messages. If empty or not present, allow any revision to be validated against last_revision or any revision created before.

4 last_revision_id string

Optional. The maximum (inclusive) revision allowed for validating messages. If empty or not present, allow any revision to be validated against first_revision or any revision created after.

message SchemaViolationReason (Nested in google.pubsub.v1.IngestionFailureEvent ) google/pubsub/v1/pubsub.proto

Set when a Pub/Sub message fails to get published due to a schema validation violation.

Field Type Description

message SeekRequest google/pubsub/v1/pubsub.proto

Request for the Seek method.

Field Type Description
1 subscription string

Required. The subscription to affect.

oneof target
2 time google.protobuf.Timestamp

Optional. The time to seek to. Messages retained in the subscription that were published before this time are marked as acknowledged, and messages retained in the subscription that were published after this time are marked as unacknowledged. Note that this operation affects only those messages retained in the subscription (configured by the combination of message_retention_duration and retain_acked_messages). For example, if time corresponds to a point before the message retention window (or to a point before the system's notion of the subscription creation time), only retained messages will be marked as unacknowledged, and already-expunged messages will not be restored.

3 snapshot string

Optional. The snapshot to seek to. The snapshot's topic must be the same as that of the provided subscription. Format is projects/{project}/snapshots/{snap}.

message SeekResponse google/pubsub/v1/pubsub.proto

Response for the Seek method (this response is empty).

Field Type Description

message Snapshot google/pubsub/v1/pubsub.proto

A snapshot resource. Snapshots are used in Seek operations, which allow you to manage message acknowledgments in bulk. That is, you can set the acknowledgment state of messages in an existing subscription to the state captured by a snapshot.

Field Type Description
1 name string

Optional. The name of the snapshot.

2 topic string

Optional. The name of the topic from which this snapshot is retaining messages.

3 expire_time google.protobuf.Timestamp

Optional. The snapshot is guaranteed to exist up until this time. A newly-created snapshot expires no later than 7 days from the time of its creation. Its exact lifetime is determined at creation by the existing backlog in the source subscription. Specifically, the lifetime of the snapshot is 7 days - (age of oldest unacked message in the subscription). For example, consider a subscription whose oldest unacked message is 3 days old. If a snapshot is created from this subscription, the snapshot -- which will always capture this 3-day-old backlog as long as the snapshot exists -- will expire in 4 days. The service will refuse to create a snapshot that would expire in less than 1 hour after creation.

4 labels map<string, string>

Optional. See [Creating and managing labels] (https://cloud.google.com/pubsub/docs/labels).

message StreamingPullRequest google/pubsub/v1/pubsub.proto

Request for the StreamingPull streaming RPC method. This request is used to establish the initial stream as well as to stream acknowledgments and ack deadline modifications from the client to the server.

Field Type Description
1 subscription string

Required. The subscription for which to initialize the new stream. This must be provided in the first request on the stream, and must not be set in subsequent requests from client to server. Format is projects/{project}/subscriptions/{sub}.

2 ack_ids repeated string

Optional. List of acknowledgment IDs for acknowledging previously received messages (received on this stream or a different stream). If an ack ID has expired, the corresponding message may be redelivered later. Acknowledging a message more than once will not result in an error. If the acknowledgment ID is malformed, the stream will be aborted with status INVALID_ARGUMENT.

3 modify_deadline_seconds repeated int32

Optional. The list of new ack deadlines for the IDs listed in modify_deadline_ack_ids. The size of this list must be the same as the size of modify_deadline_ack_ids. If it differs the stream will be aborted with INVALID_ARGUMENT. Each element in this list is applied to the element in the same position in modify_deadline_ack_ids. The new ack deadline is with respect to the time this request was sent to the Pub/Sub system. Must be >= 0. For example, if the value is 10, the new ack deadline will expire 10 seconds after this request is received. If the value is 0, the message is immediately made available for another streaming or non-streaming pull request. If the value is < 0 (an error), the stream will be aborted with status INVALID_ARGUMENT.

4 modify_deadline_ack_ids repeated string

Optional. List of acknowledgment IDs whose deadline will be modified based on the corresponding element in modify_deadline_seconds. This field can be used to indicate that more time is needed to process a message by the subscriber, or to make the message available for redelivery if the processing was interrupted.

5 stream_ack_deadline_seconds int32

Required. The ack deadline to use for the stream. This must be provided in the first request on the stream, but it can also be updated on subsequent requests from client to server. The minimum deadline you can specify is 10 seconds. The maximum deadline you can specify is 600 seconds (10 minutes).

6 client_id string

Optional. A unique identifier that is used to distinguish client instances from each other. Only needs to be provided on the initial request. When a stream disconnects and reconnects for the same stream, the client_id should be set to the same value so that state associated with the old stream can be transferred to the new stream. The same client_id should not be used for different client instances.

7 max_outstanding_messages int64

Optional. Flow control settings for the maximum number of outstanding messages. When there are max_outstanding_messages currently sent to the streaming pull client that have not yet been acked or nacked, the server stops sending more messages. The sending of messages resumes once the number of outstanding messages is less than this value. If the value is <= 0, there is no limit to the number of outstanding messages. This property can only be set on the initial StreamingPullRequest. If it is set on a subsequent request, the stream will be aborted with status INVALID_ARGUMENT.

8 max_outstanding_bytes int64

Optional. Flow control settings for the maximum number of outstanding bytes. When there are max_outstanding_bytes or more worth of messages currently sent to the streaming pull client that have not yet been acked or nacked, the server will stop sending more messages. The sending of messages resumes once the number of outstanding bytes is less than this value. If the value is <= 0, there is no limit to the number of outstanding bytes. This property can only be set on the initial StreamingPullRequest. If it is set on a subsequent request, the stream will be aborted with status INVALID_ARGUMENT.

message StreamingPullResponse google/pubsub/v1/pubsub.proto

Response for the StreamingPull method. This response is used to stream messages from the server to the client.

Field Type Description
1 received_messages repeated google.pubsub.v1.ReceivedMessage

Optional. Received Pub/Sub messages. This will not be empty.

3 modify_ack_deadline_confirmation google.pubsub.v1.StreamingPullResponse.ModifyAckDeadlineConfirmation

Optional. This field will only be set if enable_exactly_once_delivery is set to true and is not guaranteed to be populated.

4 subscription_properties google.pubsub.v1.StreamingPullResponse.SubscriptionProperties

Optional. Properties associated with this subscription.

5 acknowledge_confirmation google.pubsub.v1.StreamingPullResponse.AcknowledgeConfirmation

Optional. This field will only be set if enable_exactly_once_delivery is set to true and is not guaranteed to be populated.

message Subscription google/pubsub/v1/pubsub.proto

A subscription resource. If none of push_config, bigquery_config, or cloud_storage_config is set, then the subscriber will pull and ack messages using API methods. At most one of these fields may be set.

Field Type Description
1 name string

Required. The name of the subscription. It must have the format "projects/{project}/subscriptions/{subscription}". {subscription} must start with a letter, and contain only letters ([A-Za-z]), numbers ([0-9]), dashes (-), underscores (_), periods (.), tildes (~), plus (+) or percent signs (%). It must be between 3 and 255 characters in length, and it must not start with "goog".

2 topic string

Required. The name of the topic from which this subscription is receiving messages. Format is projects/{project}/topics/{topic}. The value of this field will be _deleted-topic_ if the topic has been deleted.

4 push_config google.pubsub.v1.PushConfig

Optional. If push delivery is used with this subscription, this field is used to configure it.

5 ack_deadline_seconds int32

Optional. The approximate amount of time (on a best-effort basis) Pub/Sub waits for the subscriber to acknowledge receipt before resending the message. In the interval after the message is delivered and before it is acknowledged, it is considered to be outstanding. During that time period, the message will not be redelivered (on a best-effort basis).

For pull subscriptions, this value is used as the initial value for the ack deadline. To override this value for a given message, call ModifyAckDeadline with the corresponding ack_id if using non-streaming pull or send the ack_id in a StreamingModifyAckDeadlineRequest if using streaming pull. The minimum custom deadline you can specify is 10 seconds. The maximum custom deadline you can specify is 600 seconds (10 minutes). If this parameter is 0, a default value of 10 seconds is used.

For push delivery, this value is also used to set the request timeout for the call to the push endpoint.

If the subscriber never acknowledges the message, the Pub/Sub system will eventually redeliver the message.

7 retain_acked_messages bool

Optional. Indicates whether to retain acknowledged messages. If true, then messages are not expunged from the subscription's backlog, even if they are acknowledged, until they fall out of the message_retention_duration window. This must be true if you would like to [Seek to a timestamp] (https://cloud.google.com/pubsub/docs/replay-overview#seek_to_a_time) in the past to replay previously-acknowledged messages.

8 message_retention_duration google.protobuf.Duration

Optional. How long to retain unacknowledged messages in the subscription's backlog, from the moment a message is published. If retain_acked_messages is true, then this also configures the retention of acknowledged messages, and thus configures how far back in time a Seek can be done. Defaults to 7 days. Cannot be more than 31 days or less than 10 minutes.

9 labels map<string, string>

Optional. See Creating and managing labels.

10 enable_message_ordering bool

Optional. If true, messages published with the same ordering_key in PubsubMessage will be delivered to the subscribers in the order in which they are received by the Pub/Sub system. Otherwise, they may be delivered in any order.

11 expiration_policy google.pubsub.v1.ExpirationPolicy

Optional. A policy that specifies the conditions for this subscription's expiration. A subscription is considered active as long as any connected subscriber is successfully consuming messages from the subscription or is issuing operations on the subscription. If expiration_policy is not set, a default policy with ttl of 31 days will be used. The minimum allowed value for expiration_policy.ttl is 1 day. If expiration_policy is set, but expiration_policy.ttl is not set, the subscription never expires.

12 filter string

Optional. An expression written in the Pub/Sub filter language. If non-empty, then only PubsubMessages whose attributes field matches the filter are delivered on this subscription. If empty, then no messages are filtered out.

13 dead_letter_policy google.pubsub.v1.DeadLetterPolicy

Optional. A policy that specifies the conditions for dead lettering messages in this subscription. If dead_letter_policy is not set, dead lettering is disabled.

The Pub/Sub service account associated with this subscriptions's parent project (i.e., service-{project_number}@gcp-sa-pubsub.iam.gserviceaccount.com) must have permission to Acknowledge() messages on this subscription.

14 retry_policy google.pubsub.v1.RetryPolicy

Optional. A policy that specifies how Pub/Sub retries message delivery for this subscription.

If not set, the default retry policy is applied. This generally implies that messages will be retried as soon as possible for healthy subscribers. RetryPolicy will be triggered on NACKs or acknowledgment deadline exceeded events for a given message.

15 detached bool

Optional. Indicates whether the subscription is detached from its topic. Detached subscriptions don't receive messages from their topic and don't retain any backlog. Pull and StreamingPull requests will return FAILED_PRECONDITION. If the subscription is a push subscription, pushes to the endpoint will not be made.

16 enable_exactly_once_delivery bool

Optional. If true, Pub/Sub provides the following guarantees for the delivery of a message with a given value of message_id on this subscription:

  • The message sent to a subscriber is guaranteed not to be resent before the message's acknowledgment deadline expires.
  • An acknowledged message will not be resent to a subscriber.

Note that subscribers may still receive multiple copies of a message when enable_exactly_once_delivery is true if the message was published multiple times by a publisher client. These copies are considered distinct by Pub/Sub and have distinct message_id values.

17 topic_message_retention_duration google.protobuf.Duration

Output only. Indicates the minimum duration for which a message is retained after it is published to the subscription's topic. If this field is set, messages published to the subscription's topic in the last topic_message_retention_duration are always available to subscribers. See the message_retention_duration field in Topic. This field is set only in responses from the server; it is ignored if it is set in any requests.

18 bigquery_config google.pubsub.v1.BigQueryConfig

Optional. If delivery to BigQuery is used with this subscription, this field is used to configure it.

19 state google.pubsub.v1.Subscription.State

Output only. An output-only field indicating whether or not the subscription can receive messages.

22 cloud_storage_config google.pubsub.v1.CloudStorageConfig

Optional. If delivery to Google Cloud Storage is used with this subscription, this field is used to configure it.

23 analytics_hub_subscription_info google.pubsub.v1.Subscription.AnalyticsHubSubscriptionInfo

Output only. Information about the associated Analytics Hub subscription. Only set if the subscritpion is created by Analytics Hub.

25 message_transforms repeated google.pubsub.v1.MessageTransform

Optional. Transforms to be applied to messages before they are delivered to subscribers. Transforms are applied in the order specified.

message SubscriptionProperties (Nested in google.pubsub.v1.StreamingPullResponse ) google/pubsub/v1/pubsub.proto

Subscription properties sent as part of the response.

Field Type Description
1 exactly_once_delivery_enabled bool

Optional. True iff exactly once delivery is enabled for this subscription.

2 message_ordering_enabled bool

Optional. True iff message ordering is enabled for this subscription.

message TextConfig (Nested in google.pubsub.v1.CloudStorageConfig ) google/pubsub/v1/pubsub.proto

Configuration for writing message data in text format. Message payloads will be written to files as raw text, separated by a newline.

Field Type Description

message TextFormat (Nested in google.pubsub.v1.IngestionDataSourceSettings.CloudStorage ) google/pubsub/v1/pubsub.proto

Configuration for reading Cloud Storage data in text format. Each line of text as specified by the delimiter will be set to the data field of a Pub/Sub message.

Field Type Description
1 delimiter optional string

Optional. When unset, '\n' is used.

message Topic google/pubsub/v1/pubsub.proto

A topic resource.

Field Type Description
1 name string

Required. The name of the topic. It must have the format "projects/{project}/topics/{topic}". {topic} must start with a letter, and contain only letters ([A-Za-z]), numbers ([0-9]), dashes (-), underscores (_), periods (.), tildes (~), plus (+) or percent signs (%). It must be between 3 and 255 characters in length, and it must not start with "goog".

2 labels map<string, string>

Optional. See [Creating and managing labels] (https://cloud.google.com/pubsub/docs/labels).

3 message_storage_policy google.pubsub.v1.MessageStoragePolicy

Optional. Policy constraining the set of Google Cloud Platform regions where messages published to the topic may be stored. If not present, then no constraints are in effect.

5 kms_key_name string

Optional. The resource name of the Cloud KMS CryptoKey to be used to protect access to messages published on this topic.

The expected format is projects/*/locations/*/keyRings/*/cryptoKeys/*.

6 schema_settings google.pubsub.v1.SchemaSettings

Optional. Settings for validating messages published against a schema.

7 satisfies_pzs bool

Optional. Reserved for future use. This field is set only in responses from the server; it is ignored if it is set in any requests.

8 message_retention_duration google.protobuf.Duration

Optional. Indicates the minimum duration to retain a message after it is published to the topic. If this field is set, messages published to the topic in the last message_retention_duration are always available to subscribers. For instance, it allows any attached subscription to seek to a timestamp that is up to message_retention_duration in the past. If this field is not set, message retention is controlled by settings on individual subscriptions. Cannot be more than 31 days or less than 10 minutes.

9 state google.pubsub.v1.Topic.State

Output only. An output-only field indicating the state of the topic.

10 ingestion_data_source_settings google.pubsub.v1.IngestionDataSourceSettings

Optional. Settings for ingestion from a data source into this topic.

13 message_transforms repeated google.pubsub.v1.MessageTransform

Optional. Transforms to be applied to messages published to the topic. Transforms are applied in the order specified.

message UpdateSnapshotRequest google/pubsub/v1/pubsub.proto

Request for the UpdateSnapshot method.

Field Type Description
1 snapshot google.pubsub.v1.Snapshot

Required. The updated snapshot object.

2 update_mask google.protobuf.FieldMask

Required. Indicates which fields in the provided snapshot to update. Must be specified and non-empty.

message UpdateSubscriptionRequest google/pubsub/v1/pubsub.proto

Request for the UpdateSubscription method.

Field Type Description
1 subscription google.pubsub.v1.Subscription

Required. The updated subscription object.

2 update_mask google.protobuf.FieldMask

Required. Indicates which fields in the provided subscription to update. Must be specified and non-empty.

message UpdateTopicRequest google/pubsub/v1/pubsub.proto

Request for the UpdateTopic method.

Field Type Description
1 topic google.pubsub.v1.Topic

Required. The updated topic object.

2 update_mask google.protobuf.FieldMask

Required. Indicates which fields in the provided topic to update. Must be specified and non-empty. Note that if update_mask contains "message_storage_policy" but the message_storage_policy is not set in the topic provided above, then the updated value is determined by the policy configured at the project or organization level.

message ValidateMessageRequest google/pubsub/v1/schema.proto

Request for the ValidateMessage method.

Field Type Description
1 parent string

Required. The name of the project in which to validate schemas. Format is projects/{project-id}.

4 message bytes

Message to validate against the provided schema_spec.

5 encoding google.pubsub.v1.Encoding

The encoding expected for messages

oneof schema_spec
2 name string

Name of the schema against which to validate.

Format is projects/{project}/schemas/{schema}.

3 schema google.pubsub.v1.Schema

Ad-hoc schema against which to validate

message ValidateMessageResponse google/pubsub/v1/schema.proto

Response for the ValidateMessage method. Empty for now.

Field Type Description

message ValidateSchemaRequest google/pubsub/v1/schema.proto

Request for the ValidateSchema method.

Field Type Description
1 parent string

Required. The name of the project in which to validate schemas. Format is projects/{project-id}.

2 schema google.pubsub.v1.Schema

Required. The schema object to validate.

message ValidateSchemaResponse google/pubsub/v1/schema.proto

Response for the ValidateSchema method. Empty for now.

Field Type Description

Enums

enum Encoding google/pubsub/v1/schema.proto

Possible encoding types for messages.

Name Number Description
ENCODING_UNSPECIFIED 0

Unspecified

JSON 1

JSON encoding

BINARY 2

Binary encoding, as defined by the schema type. For some schema types, binary encoding may not be available.

enum SchemaView google/pubsub/v1/schema.proto

View of Schema object fields to be returned by GetSchema and ListSchemas.

Name Number Description
SCHEMA_VIEW_UNSPECIFIED 0

The default / unset value. The API will default to the BASIC view.

BASIC 1

Include the name and type of the schema, but not the definition.

FULL 2

Include all Schema object fields.

enum Severity google/pubsub/v1/pubsub.proto

Severity levels of Platform Logs.

Name Number Description
SEVERITY_UNSPECIFIED 0

Default value. Logs level is unspecified. Logs will be disabled.

DISABLED 1

Logs will be disabled.

DEBUG 2

Debug logs and higher-severity logs will be written.

INFO 3

Info logs and higher-severity logs will be written.

WARNING 4

Warning logs and higher-severity logs will be written.

ERROR 5

Only error logs will be written.

enum State google/pubsub/v1/pubsub.proto

Possible states for ingestion from Amazon Kinesis Data Streams.

Name Number Description
STATE_UNSPECIFIED 0

Default value. This value is unused.

ACTIVE 1

Ingestion is active.

KINESIS_PERMISSION_DENIED 2

Permission denied encountered while consuming data from Kinesis. This can happen if: - The provided aws_role_arn does not exist or does not have the appropriate permissions attached. - The provided aws_role_arn is not set up properly for Identity Federation using gcp_service_account. - The Pub/Sub SA is not granted the iam.serviceAccounts.getOpenIdToken permission on gcp_service_account.

PUBLISH_PERMISSION_DENIED 3

Permission denied encountered while publishing to the topic. This can happen if the Pub/Sub SA has not been granted the appropriate publish permissions

STREAM_NOT_FOUND 4

The Kinesis stream does not exist.

CONSUMER_NOT_FOUND 5

The Kinesis consumer does not exist.

enum State google/pubsub/v1/pubsub.proto

Possible states for ingestion from Cloud Storage.

Name Number Description
STATE_UNSPECIFIED 0

Default value. This value is unused.

ACTIVE 1

Ingestion is active.

CLOUD_STORAGE_PERMISSION_DENIED 2

Permission denied encountered while calling the Cloud Storage API. This can happen if the Pub/Sub SA has not been granted the appropriate permissions: - storage.objects.list: to list the objects in a bucket. - storage.objects.get: to read the objects in a bucket. - storage.buckets.get: to verify the bucket exists.

PUBLISH_PERMISSION_DENIED 3

Permission denied encountered while publishing to the topic. This can happen if the Pub/Sub SA has not been granted the appropriate publish permissions

BUCKET_NOT_FOUND 4

The provided Cloud Storage bucket doesn't exist.

TOO_MANY_OBJECTS 5

The Cloud Storage bucket has too many objects, ingestion will be paused.

enum State google/pubsub/v1/pubsub.proto

Possible states for managed ingestion from Event Hubs.

Name Number Description
STATE_UNSPECIFIED 0

Default value. This value is unused.

ACTIVE 1

Ingestion is active.

EVENT_HUBS_PERMISSION_DENIED 2

Permission denied encountered while consuming data from Event Hubs. This can happen when client_id, or tenant_id are invalid. Or the right permissions haven't been granted.

PUBLISH_PERMISSION_DENIED 3

Permission denied encountered while publishing to the topic.

NAMESPACE_NOT_FOUND 4

The provided Event Hubs namespace couldn't be found.

EVENT_HUB_NOT_FOUND 5

The provided Event Hub couldn't be found.

SUBSCRIPTION_NOT_FOUND 6

The provided Event Hubs subscription couldn't be found.

RESOURCE_GROUP_NOT_FOUND 7

The provided Event Hubs resource group couldn't be found.

enum State google/pubsub/v1/pubsub.proto

Possible states for managed ingestion from Amazon MSK.

Name Number Description
STATE_UNSPECIFIED 0

Default value. This value is unused.

ACTIVE 1

Ingestion is active.

MSK_PERMISSION_DENIED 2

Permission denied encountered while consuming data from Amazon MSK.

PUBLISH_PERMISSION_DENIED 3

Permission denied encountered while publishing to the topic.

CLUSTER_NOT_FOUND 4

The provided MSK cluster wasn't found.

TOPIC_NOT_FOUND 5

The provided topic wasn't found.

enum State google/pubsub/v1/pubsub.proto

Possible states for managed ingestion from Confluent Cloud.

Name Number Description
STATE_UNSPECIFIED 0

Default value. This value is unused.

ACTIVE 1

Ingestion is active.

CONFLUENT_CLOUD_PERMISSION_DENIED 2

Permission denied encountered while consuming data from Confluent Cloud.

PUBLISH_PERMISSION_DENIED 3

Permission denied encountered while publishing to the topic.

UNREACHABLE_BOOTSTRAP_SERVER 4

The provided bootstrap server address is unreachable.

CLUSTER_NOT_FOUND 5

The provided cluster wasn't found.

TOPIC_NOT_FOUND 6

The provided topic wasn't found.

enum State google/pubsub/v1/pubsub.proto

The state of the topic.

Name Number Description
STATE_UNSPECIFIED 0

Default value. This value is unused.

ACTIVE 1

The topic does not have any persistent errors.

INGESTION_RESOURCE_ERROR 2

Ingestion from the data source has encountered a permanent error. See the more detailed error state in the corresponding ingestion source configuration.

enum State google/pubsub/v1/pubsub.proto

Possible states for a subscription.

Name Number Description
STATE_UNSPECIFIED 0

Default value. This value is unused.

ACTIVE 1

The subscription can actively receive messages

RESOURCE_ERROR 2

The subscription cannot receive messages because of an error with the resource to which it pushes messages. See the more detailed error state in the corresponding configuration.

enum State google/pubsub/v1/pubsub.proto

Possible states for a BigQuery subscription.

Name Number Description
STATE_UNSPECIFIED 0

Default value. This value is unused.

ACTIVE 1

The subscription can actively send messages to BigQuery

PERMISSION_DENIED 2

Cannot write to the BigQuery table because of permission denied errors. This can happen if - Pub/Sub SA has not been granted the appropriate BigQuery IAM permissions - bigquery.googleapis.com API is not enabled for the project (instructions)

NOT_FOUND 3

Cannot write to the BigQuery table because it does not exist.

SCHEMA_MISMATCH 4

Cannot write to the BigQuery table due to a schema mismatch.

IN_TRANSIT_LOCATION_RESTRICTION 5

Cannot write to the destination because enforce_in_transit is set to true and the destination locations are not in the allowed regions.

enum State google/pubsub/v1/pubsub.proto

Possible states for a Cloud Storage subscription.

Name Number Description
STATE_UNSPECIFIED 0

Default value. This value is unused.

ACTIVE 1

The subscription can actively send messages to Cloud Storage.

PERMISSION_DENIED 2

Cannot write to the Cloud Storage bucket because of permission denied errors.

NOT_FOUND 3

Cannot write to the Cloud Storage bucket because it does not exist.

IN_TRANSIT_LOCATION_RESTRICTION 4

Cannot write to the destination because enforce_in_transit is set to true and the destination locations are not in the allowed regions.

SCHEMA_MISMATCH 5

Cannot write to the Cloud Storage bucket due to an incompatibility between the topic schema and subscription settings.

enum Type google/pubsub/v1/schema.proto

Possible schema definition types.

Name Number Description
TYPE_UNSPECIFIED 0

Default value. This value is unused.

PROTOCOL_BUFFER 1

A Protocol Buffer schema definition.

AVRO 2

An Avro schema definition.