Brown: 'Toss up' whether Patriots missed Ridley