Activity log for bug #413430

Date Who What changed Old value New value Message
2009-08-14 06:45:06 dbmcclain bug added bug
2009-08-14 07:27:59 Martin Pool summary Bug during commit to lab repository ShortReadvError on tix file
2009-08-14 07:28:04 Martin Pool bzr: status New Incomplete
2009-08-14 07:28:06 Martin Pool bzr: importance Undecided Medium
2011-01-27 02:03:03 Martin Pool summary ShortReadvError on tix file ShortReadvError on index file
2011-01-27 02:04:16 Martin Pool bzr: importance Medium High
2011-01-27 02:04:16 Martin Pool bzr: status Incomplete Confirmed
2011-01-27 02:29:03 Martin Pool description bash-3.2$ bzr commit -m "Mach compiler improvements, Bfly recv takes an optional argument for the received message" Committing to: /Volumes/Repository/srv/bzr/Lispworks/ modified Butterfly/Source/Keep-Alive.lisp modified Butterfly/Source/Standard-Server.lisp modified Butterfly/Source/bfly-mailbox.lisp modified Butterfly/Source/bfly-message.lisp modified Butterfly/Source/bfly-socket2.lisp modified Butterfly/Source/bfly-spawn.lisp modified Butterfly/Source/fru-replace-code.lisp modified Okeanos/lock-daemon.lisp modified Okeanos/remote-access.lisp modified tools/useful-macros/match-macro-ex-opt.lisp bzr: ERROR: bzrlib.errors.ShortReadvError: readv() read 268 bytes rather than 4096 bytes at 171764 for "d0580144782295bf6f36ded8f1415669.tix" Traceback (most recent call last): File "/Library/Python/2.5/site-packages/bzrlib/commands.py", line 729, in exception_to_return_code return the_callable(*args, **kwargs) File "/Library/Python/2.5/site-packages/bzrlib/commands.py", line 924, in run_bzr ret = run(*run_argv) File "/Library/Python/2.5/site-packages/bzrlib/commands.py", line 560, in run_argv_aliases return self.run(**all_cmd_args) File "/Library/Python/2.5/site-packages/bzrlib/builtins.py", line 2937, in run exclude=safe_relpath_files(tree, exclude)) File "/Library/Python/2.5/site-packages/bzrlib/decorators.py", line 192, in write_locked result = unbound(self, *args, **kwargs) File "/Library/Python/2.5/site-packages/bzrlib/workingtree_4.py", line 226, in commit result = WorkingTree3.commit(self, message, revprops, *args, **kwargs) File "/Library/Python/2.5/site-packages/bzrlib/decorators.py", line 192, in write_locked result = unbound(self, *args, **kwargs) File "/Library/Python/2.5/site-packages/bzrlib/mutabletree.py", line 228, in commit *args, **kwargs) File "/Library/Python/2.5/site-packages/bzrlib/commit.py", line 397, in commit self.branch.repository, new_revno, self.rev_id) File "/Library/Python/2.5/site-packages/bzrlib/branch.py", line 821, in import_last_revision_info self.repository.fetch(source_repo, revision_id=revid) File "/Library/Python/2.5/site-packages/bzrlib/repository.py", line 1553, in fetch find_ghosts=find_ghosts, fetch_spec=fetch_spec) File "/Library/Python/2.5/site-packages/bzrlib/decorators.py", line 192, in write_locked result = unbound(self, *args, **kwargs) File "/Library/Python/2.5/site-packages/bzrlib/repository.py", line 3514, in fetch return self._pack(self.source, self.target, revision_ids) File "/Library/Python/2.5/site-packages/bzrlib/repository.py", line 3520, in _pack revision_ids).pack() File "/Library/Python/2.5/site-packages/bzrlib/repofmt/pack_repo.py", line 753, in pack return self._create_pack_from_packs() File "/Library/Python/2.5/site-packages/bzrlib/repofmt/pack_repo.py", line 943, in _create_pack_from_packs new_pack._check_references() File "/Library/Python/2.5/site-packages/bzrlib/repofmt/pack_repo.py", line 189, in _check_references index.iter_entries(external_refs)) File "/Library/Python/2.5/site-packages/bzrlib/repofmt/pack_repo.py", line 188, in <genexpr> k for (idx, k, v, r) in File "/Library/Python/2.5/site-packages/bzrlib/index.py", line 1258, in iter_entries for node in index.iter_entries(keys): File "/Library/Python/2.5/site-packages/bzrlib/index.py", line 626, in iter_entries self._lookup_keys_via_location, self._size, keys)) File "/Library/Python/2.5/site-packages/bzrlib/bisect_multi.py", line 50, in bisect_multi_bytes search_results = content_lookup(search_keys) File "/Library/Python/2.5/site-packages/bzrlib/index.py", line 769, in _lookup_keys_via_location self._read_and_parse(readv_ranges) File "/Library/Python/2.5/site-packages/bzrlib/index.py", line 1138, in _read_and_parse for offset, data in readv_data: File "/Library/Python/2.5/site-packages/bzrlib/transport/__init__.py", line 701, in _seek_and_read c_offset.length, actual=len(data)) ShortReadvError: readv() read 268 bytes rather than 4096 bytes at 171764 for "d0580144782295bf6f36ded8f1415669.tix" bzr 1.16.1 on python 2.5.1 (darwin) arguments: ['/usr/local/bin/bzr', 'commit', '-m', 'Mach compiler improvements, Bfly recv takes an optional argument for the received message'] encoding: 'UTF-8', fsenc: 'utf-8', lang: 'en_US.UTF-8' plugins: bzrtools /Library/Python/2.5/site-packages/bzrlib/plugins/bzrtools [1.16] email /Library/Python/2.5/site-packages/bzrlib/plugins/email [unknown] extmerge /Library/Python/2.5/site-packages/bzrlib/plugins/extmerge [unknown] launchpad /Library/Python/2.5/site-packages/bzrlib/plugins/launchpad [1.16.1] loom /Library/Python/2.5/site-packages/bzrlib/plugins/loom [1.4dev] netrc_credential_store /Library/Python/2.5/site-packages/bzrlib/plugins/netrc_credential_store [1.16.1] qbzr /Library/Python/2.5/site-packages/bzrlib/plugins/qbzr [0.11] rebase /Library/Python/2.5/site-packages/bzrlib/plugins/rebase [0.5.1] search /Library/Python/2.5/site-packages/bzrlib/plugins/search [1.7dev] svn /Library/Python/2.5/site-packages/bzrlib/plugins/svn [0.6.2] *** Bazaar has encountered an internal error. Please report a bug at https://bugs.launchpad.net/bzr/+filebug including this traceback, and a description of what you were doing when the error occurred. Summary: You may encounter a message like this: bzr: ERROR: bzrlib.errors.ShortReadvError: readv() read 268 bytes rather than 4096 bytes at 171764 for "d0580144782295bf6f36ded8f1415669.tix" (This is distinct from the similar bug 413430 where the filename is ends in 'pack'). As far as we know, this is always caused by the file being truncated on disk outside of bzr's control. ext4 seems very prone to do this when a machine crashes or is abruptly halted. However, it is a bug in bzr that the message is opaque and that there's no easy way out. The shortest workaround if you hit this case is: 1- make a new repository directory 2- branch your main branches (trunk etc) into it, either from a backup or another copy of those branches; this will repopulate most of history 3- you should then be able to branch particular newly-changed branches into the new repository too As a fix for this we could do any of: 1- try to force files to disk after writing 2- teach check to detect this situation and rebuild index files ... bash-3.2$ bzr commit -m "Mach compiler improvements, Bfly recv takes an optional argument for the received message" Committing to: /Volumes/Repository/srv/bzr/Lispworks/ modified Butterfly/Source/Keep-Alive.lisp modified Butterfly/Source/Standard-Server.lisp modified Butterfly/Source/bfly-mailbox.lisp modified Butterfly/Source/bfly-message.lisp modified Butterfly/Source/bfly-socket2.lisp modified Butterfly/Source/bfly-spawn.lisp modified Butterfly/Source/fru-replace-code.lisp modified Okeanos/lock-daemon.lisp modified Okeanos/remote-access.lisp modified tools/useful-macros/match-macro-ex-opt.lisp Traceback (most recent call last):   File "/Library/Python/2.5/site-packages/bzrlib/commands.py", line 729, in exception_to_return_code     return the_callable(*args, **kwargs)   File "/Library/Python/2.5/site-packages/bzrlib/commands.py", line 924, in run_bzr     ret = run(*run_argv)   File "/Library/Python/2.5/site-packages/bzrlib/commands.py", line 560, in run_argv_aliases     return self.run(**all_cmd_args)   File "/Library/Python/2.5/site-packages/bzrlib/builtins.py", line 2937, in run     exclude=safe_relpath_files(tree, exclude))   File "/Library/Python/2.5/site-packages/bzrlib/decorators.py", line 192, in write_locked     result = unbound(self, *args, **kwargs)   File "/Library/Python/2.5/site-packages/bzrlib/workingtree_4.py", line 226, in commit     result = WorkingTree3.commit(self, message, revprops, *args, **kwargs)   File "/Library/Python/2.5/site-packages/bzrlib/decorators.py", line 192, in write_locked     result = unbound(self, *args, **kwargs)   File "/Library/Python/2.5/site-packages/bzrlib/mutabletree.py", line 228, in commit     *args, **kwargs)   File "/Library/Python/2.5/site-packages/bzrlib/commit.py", line 397, in commit     self.branch.repository, new_revno, self.rev_id)   File "/Library/Python/2.5/site-packages/bzrlib/branch.py", line 821, in import_last_revision_info     self.repository.fetch(source_repo, revision_id=revid)   File "/Library/Python/2.5/site-packages/bzrlib/repository.py", line 1553, in fetch     find_ghosts=find_ghosts, fetch_spec=fetch_spec)   File "/Library/Python/2.5/site-packages/bzrlib/decorators.py", line 192, in write_locked     result = unbound(self, *args, **kwargs)   File "/Library/Python/2.5/site-packages/bzrlib/repository.py", line 3514, in fetch     return self._pack(self.source, self.target, revision_ids)   File "/Library/Python/2.5/site-packages/bzrlib/repository.py", line 3520, in _pack     revision_ids).pack()   File "/Library/Python/2.5/site-packages/bzrlib/repofmt/pack_repo.py", line 753, in pack     return self._create_pack_from_packs()   File "/Library/Python/2.5/site-packages/bzrlib/repofmt/pack_repo.py", line 943, in _create_pack_from_packs     new_pack._check_references()   File "/Library/Python/2.5/site-packages/bzrlib/repofmt/pack_repo.py", line 189, in _check_references     index.iter_entries(external_refs))   File "/Library/Python/2.5/site-packages/bzrlib/repofmt/pack_repo.py", line 188, in <genexpr>     k for (idx, k, v, r) in   File "/Library/Python/2.5/site-packages/bzrlib/index.py", line 1258, in iter_entries     for node in index.iter_entries(keys):   File "/Library/Python/2.5/site-packages/bzrlib/index.py", line 626, in iter_entries     self._lookup_keys_via_location, self._size, keys))   File "/Library/Python/2.5/site-packages/bzrlib/bisect_multi.py", line 50, in bisect_multi_bytes     search_results = content_lookup(search_keys)   File "/Library/Python/2.5/site-packages/bzrlib/index.py", line 769, in _lookup_keys_via_location     self._read_and_parse(readv_ranges)   File "/Library/Python/2.5/site-packages/bzrlib/index.py", line 1138, in _read_and_parse     for offset, data in readv_data:   File "/Library/Python/2.5/site-packages/bzrlib/transport/__init__.py", line 701, in _seek_and_read     c_offset.length, actual=len(data)) ShortReadvError: readv() read 268 bytes rather than 4096 bytes at 171764 for "d0580144782295bf6f36ded8f1415669.tix" bzr 1.16.1 on python 2.5.1 (darwin) arguments: ['/usr/local/bin/bzr', 'commit', '-m', 'Mach compiler improvements, Bfly recv takes an optional argument for the received message'] encoding: 'UTF-8', fsenc: 'utf-8', lang: 'en_US.UTF-8' plugins:   bzrtools /Library/Python/2.5/site-packages/bzrlib/plugins/bzrtools [1.16]   email /Library/Python/2.5/site-packages/bzrlib/plugins/email [unknown]   extmerge /Library/Python/2.5/site-packages/bzrlib/plugins/extmerge [unknown]   launchpad /Library/Python/2.5/site-packages/bzrlib/plugins/launchpad [1.16.1]   loom /Library/Python/2.5/site-packages/bzrlib/plugins/loom [1.4dev]   netrc_credential_store /Library/Python/2.5/site-packages/bzrlib/plugins/netrc_credential_store [1.16.1]   qbzr /Library/Python/2.5/site-packages/bzrlib/plugins/qbzr [0.11]   rebase /Library/Python/2.5/site-packages/bzrlib/plugins/rebase [0.5.1]   search /Library/Python/2.5/site-packages/bzrlib/plugins/search [1.7dev]   svn /Library/Python/2.5/site-packages/bzrlib/plugins/svn [0.6.2] *** Bazaar has encountered an internal error.     Please report a bug at https://bugs.launchpad.net/bzr/+filebug     including this traceback, and a description of what you     were doing when the error occurred.
2011-02-01 13:33:51 Jelmer Vernooij tags data-integrity
2011-02-01 13:34:02 Jelmer Vernooij tags data-integrity data-integrity ui
2011-02-01 13:48:01 Vincent Ladeuil bug added subscriber Vincent Ladeuil
2017-11-08 22:53:13 Jelmer Vernooij tags data-integrity ui check-for-breezy data-integrity ui
2017-11-12 13:15:31 Jelmer Vernooij tags check-for-breezy data-integrity ui data-integrity ui
2017-11-12 13:15:49 Jelmer Vernooij bug task added brz
2017-11-12 13:15:53 Jelmer Vernooij brz: status New Triaged
2017-11-12 13:15:55 Jelmer Vernooij brz: importance Undecided High
2018-03-29 01:50:30 Jelmer Vernooij tags data-integrity ui bzr-format data-integrity ui