Items will disappear from the whitelist but after saving the page they reappear.
There is a known issue with removing the very final entry. If you are finding this is the case then please contact Runbox Support with details and we will be able to resolve this for you. Thank you.