NOTE: Adobe re-introduced the Oil Paint filter in version cc 2015.1.1. Therefore, this tutorial is only for versions cc ...
You can achieve this by going to Brush settings > Color dynamics > Foreground/Background Jitter and increase this by 2-5 per ...