I'm the opposite - I hate having cash around because of fear of getting broken into and having it all stolen. About a month ago my purse was stolen. The thief(s?) went on a spending spree and spent between $2-3K on my credit cards (I reported the cards stolen and was deemed not liable for the charges). I was so glad I had less than $5 cash in my wallet for them to steal.
That said, in my first marriage, we had joint accounts. XDH was a smoker and it used to annoy me no end that *I* was paying several thousand a year on tobacco I don't use. One of the best things about becoming single was having total control of my money for the first time in 14 years. I earned it, I spent it - I loved not having to worry about where else it was being spent. So when I remarried, new DH and I decided to maintain separate accounts. This is the best way to go, in my experience. Now he and I can each spend our own money without comment from the other. If I want to spend a huge amount on hatching eggs from eBay, he won't say a word because its mine to do with as I wish. Likewise, I don't comment on, or question any money he spends. When it comes to necessary expenses like groceries, the only argument we have is who *gets* to pay. Our kids laugh at our "fights" because they go something like "No, you paid last time. Its MY turn to pay this time".
I understand the "cash burning a whole in my pocket" mentality because one of my good friends has a DH with the same affliction. More than once she has borrowed money from me to buy groceries so she can feed her kids, and then I go visit and her DH is sitting there playing the newest XBox game (while she is confiding to me their electric may be cut off because they couldn't pay the bill). Yeah, um, I gave up offering advice on that one because it fell on deaf ears.
Not sure what you can do with a DH who doesn't respect boundaries though, other than just hide the money. I'm not an advocate of secrecy within a marriage but this sounds like a situation where you need to open an account (with or without his knowledge but definitely one that he is not a signatory on) and deposit your egg money into it so that he can't steal it from you. I know it makes it less accessible than cash but perhaps making it safer would make up for that?