Learning to take a Second Look