Delete a folder in github, but not in local

I know that if I want to ignore folder that I don't want to push to Github. I could use .gitignore to ignore it.

Now my situation is I had pushed the folder up to Github, now I wish I could ignore it and delete it on Github, but still want the folder in local side.

How could I achieve it?