Short answer: you need the license. You can open carry while fishing except on Army Corps of Engineer properties. You can open carry on your property.
Pretty much to carry for general locations you need the license. It's not too expensive. The process is pretty simple. It's good for 5 years, and it makes gun purchases easier.