So, the day before yesterday I removed some people and I added some people. Then when I came back online yesterday the friend list was changed back how it was before I removed & added people. Then I removed & added again. And it worked for the time being online.
Now today the list is back how it was. I have to remove & add again.