Good sources besides the allegorical interpretation of the Bible?

You will not find such sources!!

Sure there are.
I have read such sources myself. You will find them mostly in the Gnostic writings and other non-canonical sources that the Catholic Church tried to suppress (and was mostly successful). I have no personal interest in finding them though.

I find it amusing how worked up people get over the very idea that Jesus was married. As you can see this is a VERY hot topic of discussion for this profile.

Here are a couple of informative links:

http://blog.beliefnet.com/markdroberts/pages/series/was-jesus-marri...

http://en.wikipedia.org/wiki/Jesus_bloodline

Personally, I'm disinclined to acknowledge any source that claims Jesus survived the crucifixion and had children later in life. This has nothing to do with any personal religious beliefs (I'm generally agnostic), but there's just too much solid historical evidence of his death to entertain every fanciful theory concocted over the last two millennia.

Having said that, there's no proof that he wasn't married PRIOR to his ministry and subsequent crucifixion, though it seems mighty odd that no written evidence of offspring has survived antiquity.

As a side note, even using only the more traditional lineages, it's still very easy to make a family connection to Jesus (though not a direct line of descent). Nearly all of the royal lineages show descent from the biblical House of David, of which Jesus is also a descendant.