I used to do that because I thought you had to.
Then I read somewhere(maybe here) that you don't need to do that. So, I researched the issue and found out that indeed, you do NOT need to refridgerate peanut butter after opening. So now I don't do that anymore.