Firstly you are young and have lots of time ahead of you so try not to worry. Anxiety about not being or getting pregnant can really put the brakes on things in an otherwise normal healthy person. Hopefully I don't come across as too patronising, but please "just relax and enjoy yourself and things will happen".
If you are really concerned then talk this over with your GP as there are some basic hormone profile tests they can run and likewise a sample from your hubby.
But the advice above from Kate is great; take the time to really clean your body out and maybe see a Naturopath for more specific individual nutritional advice. Many ladies I've seen have found acupuncture for both the Mum AND Dad really helps in synchronising the 2 together.
I think now you are having great fun with your family and wish you a great future ahead.