Python, rust and arrow for data processing

Name: Python, rust and arrow for data processing
Start: 2026-04-09T09:00:00+00:00
End: 2026-04-09T09:25:00+00:00
Location: SMK

Talk 25 min April 09, 2026 at 09:00

Paulius Venclovas

Python struggles with heavy data loads. Rust offers speed, and PyO3 makes bridging the two seamless. This talk shows how to build a shared Rust core to avoid code duplication. I will also cover using Apache Arrow for zero-copy data sharing and removing serialization costs entirely. Discover how this stack enables high-performance data processing in Python and Pyspark