I am looking to connect to the GCP cloud SQL database using cloud-sql-proxy from the dataflow job. In order for a dataflow worker node to connect cloudsql I need to set up and run a proxy in each worker node as setup.. how to achieve this with dataflow java/python logic?
Asked
Active
Viewed 148 times
0
-
You might want to try using [the Cloud SQL Python Connector](https://github.com/GoogleCloudPlatform/cloud-sql-python-connector) or the [Cloud SQL Java Connector](https://github.com/GoogleCloudPlatform/cloud-sql-jdbc-socket-factory), they provide all the same benefits of the Cloud SQL Proxy but in a native solution for Java and Python. – Jack Wotherspoon May 05 '23 at 13:39
-
Hi, I am looking to know how to setup a proxy server before a dataflow job runs. – vkt May 07 '23 at 15:49
-
have you checked this [thread](https://stackoverflow.com/questions/50701736/start-cloudsql-proxy-on-python-dataflow-apache-beam)? – Sakshi Gatyan May 09 '23 at 11:22