Unless that doctor knows something the rest of the medical community doesn't, there is no proof that gynecomastia is genetic. There are cases in both ways, where a father with gyne has a son who never develops it and vice versa. I wouldn't worry about it.
Also, sexual preference in parents has absolutely no effect physically on the child. Be excited about becoming a Dad! Don't worry about it.