Shuffle file permission issue when using ColumnarShuffleManager

[wangyum]

Backend

VL (Velox)

Bug description

All the shuffle fetch fail if use org.apache.spark.shuffle.sort.ColumnarShuffleManager.

Task log:

NodeManager log:

Using org.apache.spark.shuffle.sort.ColumnarShuffleManager lacks read permissions for others. The first line is the shuffle data generated by org.apache.spark.shuffle.sort.ColumnarShuffleManager, and the second line is the shuffle data generated by Spark built in sort.

Spark version

Spark-3.5.x

Spark configurations

Key	Value
spark.shuffle.service.enabled	true
spark.shuffle.service.port	7338
spark.plugins	org.apache.gluten.GlutenPlugin
spark.shuffle.manager	org.apache.spark.shuffle.sort.ColumnarShuffleManager
spark.gluten.enabled	true

System information

$ umask
0002

Relevant logs