Yes just make sure (obviously) that they are rinsed out really well. Tropicals will probably ignore them. Fish like cichlids might want to go inside and that can be dangerous if there isn't an escape hole in the top, but guppies and the like will never care.