Best thing to do when starting out: Use a complete program, such as ABEKA, or an all inclusive online program such as K12...this will help you break into homeschooling without having to worry about curriculum selection.
Join HSLDA and seek out your local homeschooling community. Find an experienced homeschooling parent that will mentor you. Once you are able to work out your best structure (it's a very personal endeavor as you need to find a curriculum/method that accommodates your strengths/lifestyle AS WELL AS your child's) then you can look at possibly tweaking you curriculum or sticking with a "canned" curriculum. Biggest misstep parents make, especially when you are jumping in feet first without having any pre-planning, is being overwhelmed. I don't don't know your child's ages, but focusing on the basics, reading fluently, writing clearly, and knowing how to manipulate figures (add, subtract, multiply, divide, then percents and consumer math) is the way to start. And, encourage your child to read, read, read! Read good literature. You can even listen to books on tape together and discuss them. I can not overemphasize how powerful focusing on good literature and non-fiction is for kids. Attend the closest state homeschooling convention (usually during the summer) NC has an epic one...they offer terrific sessions on just about everything you may need, as well as gobs and gobs of curricula...my kids also loved attending.

I taught my son and daughter K-12. Had them in a co-op from 7th grade to 12th (I taught there too), and transitioned them to community college for their last few years. They both entered college with college credits. Both graduated on time (4years) and were very well prepared. I ended up teaching public school (middle school math) after they went to college, so I got to see both sides.