I want to get close to him again, is it too risky?

you should just move on. It really doesn't seem like it is worth your trouble especially since you neither know him very well nor live near him. Do yourself a favor and just find someone closer to home.