Integration with ibis and dato? #69
Description
Thanks for the work on this cool project!
Wes just announced a new open source python distributed/ OOC data analysis framework called Ibis
Not sure if it is just an expression engine, but the workflow does have planned support for native python LLVM UDFs in impala with possible other execution engines. This is great because we will have a native python non JVM distributed solution.
Also Dato announced out of memory numpy arrays that work with scikit learn. Not sure of the license.
The landscape is starting to fragment a bit and I wonder if targeting or working with one of these projects (or dask) would help focus efforts. On the other hand, the distribution helps to prototype different approaches.
Other question: Is bolt going to use the Numpy array protocol? It would be great if we can use bolt as a drop in numpy replacement in legacy python code like the dato arrays.