Does this sound like a good idea for a book?

It's a great idea! Go mad with your imagination. Really, If people don't like it then just ignore them. If your happy with this then stick with it. Maybe tweak it a bit here and there but whatever! I like unique ideas like this ^_^