Weird xNormal Bake

I'm trying to bake to a lower poly object. I cut the back faces off in zbrush to speed up the bake time.

However I'm getting some weird bake results!

There should be 4 pics on this link that show details of my xnormal problem.

http://img857.imageshack.us/g/xnormalproblemhp.jpg/

EDIT: It looks like my bake is "looking" at the back faces of my High poly instead of the front?

Thanks.