[python] remove control characters and all punctuations - dsindex/blog GitHub Wiki

• reference 1
• reference 2
• General Category Values

#!/usr/bin/env python
#-*- coding: utf8 -*-

from   unicodedata import category 

s = s.decode('utf-8')
s = ''.join(ch for ch in s if category(ch)[0] != 'C')
s = ''.join(ch for ch in s if category(ch)[0] != 'P')
    

• remove non-breaking spaces
  • vi editor hex-mode