• Karpathy's Tips for Training

Feature Engineering

1. Bucketing: Transform a continuous feature into buckets (with similar values in the same bucket) to make it easier for say a linear model to learn the mapping.
2. Feature Crossing: Combine features such that the combination is more informative. Motivation: a linear model can't combine (multiply) features.