Even more interestingly, I'm finding when looking at my two regions in my surviving models that've not been torn down yet, I'm finding that there are only two copies of the objects, one in each datacenter, even though it passed the count of 3. I'm wondering if the use of object_head is only querying the container info about the object written and not actually probing the object server for assurance that there is access to the object on that number of servers.
I'm also seeing pending locks on containers that have had no writes on these environments for over 12 hours which concerns me that these tests are not completely ensuring what was assumed to be tested.
Even more interestingly, I'm finding when looking at my two regions in my surviving models that've not been torn down yet, I'm finding that there are only two copies of the objects, one in each datacenter, even though it passed the count of 3. I'm wondering if the use of object_head is only querying the container info about the object written and not actually probing the object server for assurance that there is access to the object on that number of servers.
I'm also seeing pending locks on containers that have had no writes on these environments for over 12 hours which concerns me that these tests are not completely ensuring what was assumed to be tested.