Datastream support to create BQ tables partitioned/clustered

[tuliocgo]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request.
• Please do not leave +1 or me too comments, they generate extra noise for issue followers and do not help prioritize the request.
• If you are interested in working on this issue or have submitted a pull request, please leave a comment.
• If an issue is assigned to a user, that user is claiming responsibility for the issue.
• Customers working with a Google Technical Account Manager or Customer Engineer can ask them to reach out internally to expedite investigation and resolution of this issue.

Description

Hello, it seems that google recently made available the possibility to have Datastream to create partitioned/clustered tables and I think it would be a great addition to the provider to support this as it can yield substantial cost savings and query optimization potencial.

The article related to the functionality can be found here, it was last updated on 2025-11-17 ->
https://docs.cloud.google.com/datastream/docs/partitioning-and-clustering

New or Affected Resource(s)

• google_datastream_stream
• google_datastream_connection_profile

Potential Terraform Configuration

References

https://docs.cloud.google.com/datastream/docs/partitioning-and-clustering
https://registry.terraform.io/providers/hashicorp/google/latest/docs/resources/datastream_stream

b/463384830

[PaulRudin]

Yup - atm I have a process for pre-creating the table with partitions, before datastream starts writing to them. This kind of works but it's quite a pain in the presence of column changes / new tables getting created by datastream before we've set up the partitioning etc. and it's not straightforward to achieve via terraform.

This would be much better.