Jesse Palmer says the thing that sets Clayton aside is how much he wants to find love and a family: "There's not an ulterior motive for Clayton"