Brady: 'It's never easy against the Ravens'