https://keroseneheaterreview.blogspot.com/2024/02/efficient-column-processing-in-pyspark.html