I suppose it depends on where and who's land you are on. If you have permission on someone's personal land there should be little worry, but always wear something blaze orange - you can get a cheap Mossy Oak knit cap for $5.00, or could get a cheap vest.
If on public land or just exploring in the woods I would be careful, although you may wear blaze orange, there are hunters out there that don't follow the rules for shooting (like "identify your target" and also "identify your target...and what's beyond it"). You also run the risk of just pi$$ing off a hunter in a tree stand, or someone who's been sitting in the same spot for hours...and then dopey you comes passing through with a metal detector...sometimes just smart to respect someone else's seasonable hobby, but that's just me.
The risk of getting accidently shot (or shot at) or getting into an argument with someone with a rifle for disturbing their hunt just doesn't sit well with me.
But like I said, if you have a personal permission and hunting is forbidden or the owner just says wear blaze orange...game on!