The man’s wife has alleged she was raped and coerced into attending sex parties involving cocaine, according to reports