Unable to delete web bibles or more than one bible

When web bible is deleted from the UI, it does not get deleted.
After failed deletion attempt local bibles are not being deleted either.

Deleting normal bibles works for the first bible, but stops working after that.

Win 10, Trunk 2695

The issue seems to be that OpenLP "uses"
the files that are supposed to be deleted:

2016-09-15 17:01:20,489 openlp.core.utils.__init__ ERROR Unable to delete file E:\bzr\data_folder_olp\bibles\Third Millennium Bible.sqlite
Traceback (most recent call last):
  File "openlp\core\utils\__init__.py", line 358, in delete_file
PermissionError: [WinError 32] The process cannot access the file because it is being used by another process: 'E:\\bzr\\data_folder_olp\\bibles\\Third Millennium Bible.sqlite'
2016-09-15 17:01:27,248 openlp.core.utils.__init__ ERROR Unable to delete file E:\bzr\data_folder_olp\bibles\Test.sqlite
Traceback (most recent call last):
  File "openlp\core\utils\__init__.py", line 358, in delete_file
PermissionError: [WinError 32] The process cannot access the file because it is being used by another process: 'E:\\bzr\\data_folder_olp\\bibles\\Test.sqlite'