Is Gloria in a caste to keep her from romance or flirting with others?

Nope. I just double-checked. There's nothing stopping it on her end. James is set up specifically to flirt/romance the "Active Household", which is of course Gloria. I did that to keep him from messing around with the Town Bike or any of the other bed-hoppers who roam the town.