Shifu 0.2.7 Variable Selection Step Improvement - ShifuML/shifu GitHub Wiki

  1. VarSelect Sensitivity Analysis MapReduce Job Too Manny Mappers https://github.com/ShifuML/shifu/issues/102

  2. Intelligent Variable Detection or Selection Auto de-select id columns Auto detect category variables (if too small distinct values) Auto de-select columns(IV is very bad (iv < 0.02)) Auto de-select columns(too many nulls or empties) https://github.com/ShifuML/shifu/issues/57