Daft is a framework for ETL, analytics and ML/AI at scale. Its familiar Python Dataframe API is built to outperform Spark in performance and ease of use. Daft plugs directly into your ML/AI stack through efficient zero-copy integrations with essential Python libraries such as Pytorch and Ray. It also allows requesting GPUs as a resource for running models. Daft runs locally with a lightweight multithreaded backend. When your local machine is no longer sufficient, it scales seamlessly to run out-of-core on a distributed cluster. Underneath its Python API, Daft is built in blazing fast Rust code. Rust powers Daft’s vectorized execution and async I/O, allowing Daft to outperform frameworks such as Spark.
Features
- Integrate with ML/AI libraries
- Go Distributed and Out-of-Core
- Execute Complex Operations
- Native Support for Cloud Storage
- Deliver Unmatched Speed
- Documentation available
Categories
Machine LearningLicense
Apache License V2.0Follow Daft
Other Useful Business Software
Get full visibility and control over your tasks and projects with Wrike.
Wrike offers world-class features that empower cross-functional, distributed, or growing teams take their projects from the initial request stage all the way to tracking work progress and reporting results.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Daft!