| 2011-09-15 02:05:46 |
Jason Gerard DeRose |
bug |
|
|
added bug |
| 2011-09-15 02:06:05 |
Jason Gerard DeRose |
branch linked |
|
lp:~jderose/filestore/stat |
|
| 2011-09-15 12:46:40 |
Jason Gerard DeRose |
description |
As we're ramping up for calling dmedia "production ready", I've been thinking more on the constant verification dmedia will to do make sure the metadata reflects the reality on the hard drives.
FileStore.verify() is the only hard-and-true reality check possible... either the exact bits are there or not. However, full verification in time consuming so this puts a limit on how often we can do it.
So I'd like to balance this out with some "softer" reality checks that we can run far more often. The soft verification is to make sure the file exists, has the correct size, and has the expected time-stamp.
So I'm adding a rather strict FileStore.stat() method, and making FileStore.__iter__() much stricter plus having it yield `Stat` namedtuples instead of just the id. The `Stat` namedtuple has:
`id` - the file id
`size` - the file size in bytes
`mtime` - the modification time-stamp
This means list(FileStore) gives you a quick and rather through picture of what is contained in the file-store. For example, you can now get total combined size of all the files in a store like this:
>>> from filestore import FileStore
>>> store = FileStore('/media/A')
>>> sum(st.size for st in store)
338015276422 |
As we're ramping up for calling dmedia "production ready", I've been thinking more on the constant verification dmedia will do to make sure the metadata reflects the reality on the hard drives.
FileStore.verify() is the only hard-and-true reality check possible... either the exact bits are there or not. However, full verification in time consuming so this puts a limit on how often we can do it.
So I'd like to balance this out with some "softer" reality checks that we can run far more often. The soft verification is to make sure the file exists, has the correct size, and has the expected time-stamp.
So I'm adding a rather strict FileStore.stat() method, and making FileStore.__iter__() much stricter plus having it yield `Stat` namedtuples instead of just the id. The `Stat` namedtuple has:
`id` - the file id
`size` - the file size in bytes
`mtime` - the modification time-stamp
This means list(FileStore) gives you a quick and rather through picture of what is contained in the file-store. For example, you can now get total combined size of all the files in a store like this:
>>> from filestore import FileStore
>>> store = FileStore('/media/A')
>>> sum(st.size for st in store)
338015276422 |
|
| 2011-09-15 12:47:20 |
Jason Gerard DeRose |
description |
As we're ramping up for calling dmedia "production ready", I've been thinking more on the constant verification dmedia will do to make sure the metadata reflects the reality on the hard drives.
FileStore.verify() is the only hard-and-true reality check possible... either the exact bits are there or not. However, full verification in time consuming so this puts a limit on how often we can do it.
So I'd like to balance this out with some "softer" reality checks that we can run far more often. The soft verification is to make sure the file exists, has the correct size, and has the expected time-stamp.
So I'm adding a rather strict FileStore.stat() method, and making FileStore.__iter__() much stricter plus having it yield `Stat` namedtuples instead of just the id. The `Stat` namedtuple has:
`id` - the file id
`size` - the file size in bytes
`mtime` - the modification time-stamp
This means list(FileStore) gives you a quick and rather through picture of what is contained in the file-store. For example, you can now get total combined size of all the files in a store like this:
>>> from filestore import FileStore
>>> store = FileStore('/media/A')
>>> sum(st.size for st in store)
338015276422 |
As we're ramping up for calling dmedia "production ready", I've been thinking more on the constant verification dmedia will do to make sure the metadata reflects the reality on the hard drives.
FileStore.verify() is the only hard-and-true reality check possible... either the exact bits are there or not. However, full verification is time consuming so this puts a limit on how often we can do it.
So I'd like to balance this out with some "softer" reality checks that we can run far more often. The soft verification is to make sure the file exists, has the correct size, and has the expected time-stamp.
So I'm adding a rather strict FileStore.stat() method, and making FileStore.__iter__() much stricter plus having it yield `Stat` namedtuples instead of just the id. The `Stat` namedtuple has:
`id` - the file id
`size` - the file size in bytes
`mtime` - the modification time-stamp
This means list(FileStore) gives you a quick and rather through picture of what is contained in the file-store. For example, you can now get total combined size of all the files in a store like this:
>>> from filestore import FileStore
>>> store = FileStore('/media/A')
>>> sum(st.size for st in store)
338015276422 |
|
| 2011-09-15 22:08:23 |
Launchpad Janitor |
branch linked |
|
lp:filestore |
|
| 2011-09-16 02:13:18 |
Jason Gerard DeRose |
filestore: status |
In Progress |
Fix Committed |
|
| 2011-09-25 02:07:29 |
Jason Gerard DeRose |
filestore: status |
Fix Committed |
Fix Released |
|
