Databricks just released the source code for Dicer, its new auto-sharding system that helps databases split data more efficiently. The open-source tool promises easier scaling for developers building data-intensive apps.
https://www.databricks.com/blog/open-sourcing-dicer-databricks-auto-sharder