But you don't carry a handbag in the house, unless, possibly, you are Queen Elizabeth, and your house happens to be a palace or castle.
When fashion provided no pockets, women had to carry their pencils and pens some other way. One of these was the sautoir, a French term for a ribbon with a hook or clasp. They were improved upon to be adjustable, and to fasten in the back, thus preserving one's hairstyle. This one was given as a premium by Needlecraft magazine in the 1910s.
This is an actual vintage sautoir.
Another idea for carrying pens, pencils, or other indispensable items was the pin-on clasp with retractable chain or cord. The New Jersey company of Ketchem & McDougall manufactured these for many years, with various decorations including engine turning, like this one.
Ringtop pens and pencils were made specifically to attach to these sort of ribbons or pins.
Portability is still a popular concept, even though the technology of writing has vastly altered.