Home - StevenRing/luigi GitHub Wiki

Welcome to the luigi wiki!

FAQ

  • Are there plans to support Hadoop SequenceFile(s) and perhaps compressions in Luigi? If such support is outside the scope of Luigi, would you recommend any of the numerous MapReduce frameworks for python (Dumbo, MRJob, etc)? Do any of them play nicer with Luigi than others?