python – How to configure parameters for Google Cloud Dataflow flex templates?

I have a parameter called –file_delimiter in my dataflow flex template job. This parameter takes ‘,’ or ‘|’ values ​​as input. In my beam pipeline, I am passing this as the argument for the read_csv transform. df = p | read_csv(input_file,sep=known_args.file_delimiter) argument parser code: parser.add_argument( “–file_delimiter”, default=”,”, ) when I run my dataflow job using … Read more