How much does it cost to smart a small business?

My husband is very good at what he does... drywall. Everyone tells him he should start his own business. We don't know where to start or what it cost. Is it really hard to get a business licensed?