azure – Py4JJavaError: An error occurred while calling o3858.save. : org.apache.spark.SparkException: Writing job aborted

I m trying to write data into cosmos db using the dataframe df_u. i have defined the configuration in writeMcgMd. im using spark version 3.2.1 Code – df_u.write.format(“cosmos.oltp”).options(**writeMcgMd).mode(“append”).save() Used – writeMcgMd = { “spark.cosmos.accountEndpoint” : “https://cccc.azure.com:443/”, “spark.cosmos.accountKey” : “ccc”, “spark.cosmos.database” : “cccc”, “spark.cosmos.container” : “ccc”, # “spark.cosmos.write.strategy”: “ItemOverwrite” } Error from driver logs from databriks … Read more