Article
Optimizing Apache Spark Query Performance with Partition Pruning
Partition pruning can dramatically reduce Spark query scan costs when your data layout and filters line up. This article explains how it works, when it helps, how to …