https://tanvirislam3113.blogspot.com/2023/08/efficient-column-processing-in-pyspark.html