TOH- Do you need a permit to put up a NON-LOAD bearing wall?

Before we renovated our house, we had 3 bedrooms. For whatever reason when we renovated we decided to make one bedroom a family room since it let out to a patio.

Here we are 3 years later, with another on the way

We want to put up a small wall (doorway) that would make the family room a separate room. The room has a glass door and a window so it has egress.

I don't foresee us selling our house (we may rent later on when we buy a bigger house) but if its "easy" to just put the wall up (according to code) I would rather do it the right way.

I have a feeling its never easy with the town of hempstead but figured I would ask.

Thanks!