Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Have you used it? How does it compare to other Rust-based ETL frameworks like Arroyo?


I haven't personally used it and I believe it's still relatively early in development, but it provides a pyspark compatible python API, so the idea is you should be able to migrate your Spark/Databricks workloads easily. Arroyo seems to be focused on Streaming. Lake Sail targets streaming and batch workloads.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: