Even if we assume the universe is infinite in space, it's 14 billion years since the big bang or whatever. That's not long enough for an infinite amount of stars to form. We need an infinite amount of time. I don't think the universe is infinitely old yet.