Apache Beam getting started [GOLANG]: Panic by panic
Chances are that the getting started guide for apache beam, it’s maybe not for starters. That why I built this article, picking a couple of issues I face when trying to run their basic examples.
Each title represents a panic you may encounter when playing with apache beam, and right below you’ll find what it works as a solution for me.
filesystem scheme gs not found
More Details. FileSystem interface for Google Cloud Storage
falling back to unauthenticated gcs access; google could not find default credentials
- Setting a default account
2. Setting a default project
3. Creating a service account
4. Granting permissions to the service account
5. Generating the key file
6. Setting the environment variable, GOOGLE_APPLICATION_CREDENTIALS
proto: file “v1.proto” is already registered
You didn’t see this one coming. Did you?
It turns out that there is an env var you can set up in order to overcome this issue, GOLANG_PROTOBUF_REGISTRATION_CONFLICT:
Failed to execute job: googleapi: Error 403:Dataflow API has not been used in project `projectId` before or is disable.
This is pretty obvious and clear.
