KarlPGTextIndex is missing index_doc method

This is caused by moving KarlPGTextIndex from karlserve to karl--the dotted path name to the class has changed so we can't unpickle the old index and end up with a broken object. The fix is pretty easy--just instantiate a new index and stick it in the right place. Because we're a little worried about being able to roll back easily, I'll just post this as a snippet that can be run in bin/debug. To roll back just import KarlPGTextIndex from the old location in karlserve and do the exact same thing:

chris@curiosity:~/proj/karl/devless$ bin/debug
Python 2.6.9 (unknown, Mar 21 2014, 10:34:41)
[GCC 4.8.1] on linux3
Type "help" for more information. "app" is the karl Pyramid application.
>>> import transaction
>>> from karl.textindex import KarlPGTextIndex
>>> from karl.models.site import get_weighted_textrepr
>>> root.catalog['texts'] = KarlPGTextIndex(get_weighted_textrepr)
>>> transaction.commit()
>>>

Also, you might end up with more than one text index as a result of past reindex operations. If there is a 'new_texts' index, remove it:

Python 2.6.9 (unknown, Jan 8 2014, 15:38:00)
[GCC 4.5.4] on linux2
Type "help" for more information. "app" is the karl Pyramid application.
>>> root.catalog.keys()
['creator', 'member_name', 'creation_date', 'texts', 'titlestartswith', 'allowed', 'modified_date', 'modified_by', 'content_modified', 'virtual', 'email', 'end_date', 'tags', 'interfaces', 'lastfirst', 'publication_date', 'mimetype', 'name', 'title', 'start_date', 'containment', 'path', 'new_texts']
>>> del root.catalog['new_texts']
>>> import transaction
>>> transaction.commit()
>>>

I've done this on staging and it fixes the problem.

At first I thought this was a re-index of the universe. So this would be a very fast forwards/backwards operation.

--Paul

On Sep 30, 2014, at 5:04 PM, Chris Rossi <email address hidden> wrote:

> This is caused by moving KarlPGTextIndex from karlserve to karl--the
> dotted path name to the class has changed so we can't unpickle the old
> index and end up with a broken object. The fix is pretty easy--just
> instantiate a new index and stick it in the right place. Because we're
> a little worried about being able to roll back easily, I'll just post
> this as a snippet that can be run in bin/debug. To roll back just
> import KarlPGTextIndex from the old location in karlserve and do the
> exact same thing:
>
> chris@curiosity:~/proj/karl/devless$ bin/debug
> Python 2.6.9 (unknown, Mar 21 2014, 10:34:41)
> [GCC 4.8.1] on linux3
> Type "help" for more information. "app" is the karl Pyramid application.
>>>> import transaction
>>>> from karl.textindex import KarlPGTextIndex
>>>> from karl.models.site import get_weighted_textrepr
>>>> root.catalog['texts'] = KarlPGTextIndex(get_weighted_textrepr)
>>>> transaction.commit()
>>>>
>
> Also, you might end up with more than one text index as a result of past
> reindex operations. If there is a 'new_texts' index, remove it:
>
> Python 2.6.9 (unknown, Jan 8 2014, 15:38:00)
> [GCC 4.5.4] on linux2
> Type "help" for more information. "app" is the karl Pyramid application.
>>>> root.catalog.keys()
> ['creator', 'member_name', 'creation_date', 'texts', 'titlestartswith', 'allowed', 'modified_date', 'modified_by', 'content_modified', 'virtual', 'email', 'end_date', 'tags', 'interfaces', 'lastfirst', 'publication_date', 'mimetype', 'name', 'title', 'start_date', 'containment', 'path', 'new_texts']
>>>> del root.catalog['new_texts']
>>>> import transaction
>>>> transaction.commit()
>>>>
>
> I've done this on staging and it fixes the problem.
>
> ** Changed in: karl3
> Status: In Progress => Fix Committed
>
> --
> You received this bug notification because you are subscribed to KARL3.
> https://bugs.launchpad.net/bugs/1375882
>
> Title:
> KarlPGTextIndex is missing index_doc method
>
> Status in KARL3:
> Fix Committed
>
> Bug description:
> When adding a blog post we get this stack trace:
>
>
> Traceback (most recent call last):
> File "/srv/karlstaging/staging/63/eggs/pyramid-1.2.1-py2.6.egg/pyramid/tweens.py", line 17, in excview_tween
> response = handler(request)
> File "/srv/karlstaging/staging/63/eggs/pyramid_tm-0.5-py2.6.egg/pyramid_tm/__init__.py", line 107, in tm_tween
> return response
> File "/srv/karlstaging/staging/63/eggs/pyramid_tm-0.5-py2.6.egg/pyramid_tm/__init__.py", line 75, in __exit__
> return self._retry_or_raise(t, v, tb)
> File "/srv/karlstaging/staging/63/eggs/pyramid_tm-0.5-py2.6.egg/pyramid_tm/__init__.py", line 60, in _retry_or_raise
> reraise(t, v, tb) # otherwise reraise the exception
> File "/srv/karlstaging/staging/63/eggs/pyramid_tm-0.5-py2.6.egg/pyramid_tm/__init__.py", line 100, in tm_tween
> response = handler(request)
> File "/srv/karlstaging/staging/63/eggs/pyramid-1.2.1-py2.6.egg/pyramid/...

Right. There is only a persistent object there because that's how the
catalog finds indexes. It does not store any data in the ZODB.

Chris

On Wed, Oct 1, 2014 at 6:56 AM, Paul Everitt <email address hidden> wrote:

> At first I thought this was a re-index of the universe. So this would be a
> very fast forwards/backwards operation.
>
> --Paul
>
> On Sep 30, 2014, at 5:04 PM, Chris Rossi <email address hidden>
> wrote:
>
> > This is caused by moving KarlPGTextIndex from karlserve to karl--the
> > dotted path name to the class has changed so we can't unpickle the old
> > index and end up with a broken object. The fix is pretty easy--just
> > instantiate a new index and stick it in the right place. Because we're
> > a little worried about being able to roll back easily, I'll just post
> > this as a snippet that can be run in bin/debug. To roll back just
> > import KarlPGTextIndex from the old location in karlserve and do the
> > exact same thing:
> >
> > chris@curiosity:~/proj/karl/devless$ bin/debug
> > Python 2.6.9 (unknown, Mar 21 2014, 10:34:41)
> > [GCC 4.8.1] on linux3
> > Type "help" for more information. "app" is the karl Pyramid application.
> >>>> import transaction
> >>>> from karl.textindex import KarlPGTextIndex
> >>>> from karl.models.site import get_weighted_textrepr
> >>>> root.catalog['texts'] = KarlPGTextIndex(get_weighted_textrepr)
> >>>> transaction.commit()
> >>>>
> >
> > Also, you might end up with more than one text index as a result of past
> > reindex operations. If there is a 'new_texts' index, remove it:
> >
> > Python 2.6.9 (unknown, Jan 8 2014, 15:38:00)
> > [GCC 4.5.4] on linux2
> > Type "help" for more information. "app" is the karl Pyramid application.
> >>>> root.catalog.keys()
> > ['creator', 'member_name', 'creation_date', 'texts', 'titlestartswith',
> 'allowed', 'modified_date', 'modified_by', 'content_modified', 'virtual',
> 'email', 'end_date', 'tags', 'interfaces', 'lastfirst', 'publication_date',
> 'mimetype', 'name', 'title', 'start_date', 'containment', 'path',
> 'new_texts']
> >>>> del root.catalog['new_texts']
> >>>> import transaction
> >>>> transaction.commit()
> >>>>
> >
> > I've done this on staging and it fixes the problem.
> >
> > ** Changed in: karl3
> > Status: In Progress => Fix Committed
> >
> > --
> > You received this bug notification because you are subscribed to KARL3.
> > https://bugs.launchpad.net/bugs/1375882
> >
> > Title:
> > KarlPGTextIndex is missing index_doc method
> >
> > Status in KARL3:
> > Fix Committed
> >
> > Bug description:
> > When adding a blog post we get this stack trace:
> >
> >
> > Traceback (most recent call last):
> > File
> "/srv/karlstaging/staging/63/eggs/pyramid-1.2.1-py2.6.egg/pyramid/tweens.py",
> line 17, in excview_tween
> > response = handler(request)
> > File
> "/srv/karlstaging/staging/63/eggs/pyramid_tm-0.5-py2.6.egg/pyramid_tm/__init__.py",
> line 107, in tm_tween
> > return response
> > File
> "/srv/karlstaging/staging/63/eggs/pyramid_tm-0.5-py2.6.egg/pyramid_tm/__init__.py",
> line 75, in __exit__
> > return self._retry_or_raise(t, v, tb)
> > File
> "/srv/karlstaging/staging/63/eggs/pyramid_t...