If you have a pot big enough to boil them in. That would just make me feel better as I like to make sure the only thing I put in there would be the "rock". Boiling should clean it out well enough and get any loose dirt or debris out of the block. Good idea.
***EDIT**** Just make sure you let them dry before baking them. Wouldn't want the concrete to explode or anything...