If its possible in your country to be found of a crime of inaction then yes it is a crime.
If there was realistic possibility of you saving the man without endangering yourself, others or the man in question further, then by common law logic you had a civic duty to save that man.
Unless...