You can stay CN and help the orphan. After you see to them you just have to go burn down a church or something.

i had a chaotic neutral player once that was trying to convince a lawful evil player that it was wrong to kill a goblin when they both work for some guys who were telling them to kill goblins

LE player remembered CN of his alignment and he intantly killed the goblin

Would it be out of character for a chaotic neutral person to just help someone out on a whim?

As long as they don’t go from a broken begger voice to an aristocratic voice in half a sentence because of a shit voice acting budget.

Sneeze on hanky. Give begger hanky.