Other people who had camped out began to get worried when he didn't come right back