Peter Cotton Peter Cotton - 1 month ago 9
Scala Question

Scala equivalent to pyTables?

I'm looking for a little assistance in Scala similar to that provided by pyTables. PyTables is a package for managing hierarchical datasets and designed to efficiently and easily cope with extremely large amounts of data.

Any suggestions?

Answer

I had a quick look at pyTables, and I don't think there's anything remotely like it in Scalaland (or indeed Javaland), but we have a few of the ingredients necessary to make it a possibility if you want to invest the time:

  • scala.Dynamic to do idiomatic selection on data-driven structures
  • A bunch of graph databases to provide the underlying navigational persistence substrate (I've had acceptable results from OrientDB, which has a better license than most)