sync-monitor

Initial sync of the calendar takes a prohibitive amount of time

Bug #1339016 reported by Pat McGowan on 2014-07-08

This bug affects 2 people

	Status	Importance	Assigned to	Milestone
Canonical System Image	Fix Released	Critical	Unassigned	Canonical System Image ww07-2015
sync-monitor	Fix Released	Critical	Renato Araujo Oliveira Filho
sync-monitor (Ubuntu)	Fix Released	Critical	Unassigned
sync-monitor (Ubuntu RTM)	Fix Released	Critical	Renato Araujo Oliveira Filho
syncevolution (Ubuntu)	Fix Released	Critical	Unassigned
syncevolution (Ubuntu RTM)	Fix Released	Critical	Renato Araujo Oliveira Filho

Bug Description

Mako running 116

Initial sync of default google calendar ran continuously for 90 mins before I terminated it
The ics file grew to 8MB

I can see two major things from the log:
- it syncs all past events (I would suggest starting with the current or previous month if necessary)
- it adds recurring events repeatedly (is the query using the wrong API and receiving events by timeframe rather than as raw event data?)

Tags:

Related branches

lp://staging/~renatofilho/sync-monitor/calendar-start-date

Merged into lp://staging/sync-monitor at revision 42

PS Jenkins bot: Needs Fixing (continuous-integration) on 2014-11-20

Ubuntu Phablet Team: Pending requested 2014-11-18

lp://staging/~renatofilho/sync-monitor/fix-1339016-rtm

Merged into lp://staging/sync-monitor/rtm-14.09 at revision 36

Ubuntu Phablet Team: Pending requested 2015-01-06

Revision history for this message

Pat McGowan (pat-mcgowan) wrote on 2014-07-08:

see https://bugs.freedesktop.org/show_bug.cgi?id=79014

Bill Filler (bfiller) on 2014-07-31

tags:

removed: rtm14

Bill Filler (bfiller) on 2014-09-22

tags:

added: rtm14

Revision history for this message

Bill Filler (bfiller) wrote on 2014-09-22:

see related bug about memory usage by evolution-calendar-factory:
https://bugs.launchpad.net/ubuntu/+source/indicator-datetime/+bug/1342123

Revision history for this message

Bill Filler (bfiller) wrote on 2014-09-22:

We use syncevolution, which communicates with Google on the remote side and evolution-data-server on the local side to store events. There is no API in syncevolution to limit the scope of events retrieved. We need to look into modifying it to do so, and to optimize it's operational time as it's ridiculously slow (this in part is likely due to evolution-calendar-factory using a flat file to store the calendar events).

Renato has indicated there is a newer version of syncevolution which has recently been released that may improve the situation. The next step is to try this new version and see if it helps.

Revision history for this message

Victor Tuson Palau (vtuson) wrote on 2014-09-23:

Can we look at the new version so we can better evaluate the options to fix it

Bill Filler (bfiller) on 2014-09-23

tags:

added: touch-2014-10-02

Bill Filler (bfiller) on 2014-09-25

tags:

added: touch-2014-10-30
removed: touch-2014-10-02

Bill Filler (bfiller) on 2014-09-25

Changed in sync-monitor:
status:	New → Confirmed
Changed in evolution-data-server (Ubuntu):
status:	New → Confirmed
Changed in syncevolution (Ubuntu):
status:	New → Confirmed

Bill Filler (bfiller) on 2014-10-02

tags:

added: touch-2014-11-16
removed: touch-2014-10-30

Joe Odukoya (jodukoya) on 2014-10-10

tags:

added: ota-2
removed: touch-2014-11-16

Bill Filler (bfiller) on 2014-11-22

no longer affects:	evolution-data-server (Ubuntu)
Changed in sync-monitor (Ubuntu):
status:	New → Fix Committed
importance:	Undecided → Critical
Changed in syncevolution (Ubuntu):
status:	Confirmed → Fix Released
importance:	Undecided → Critical
Changed in syncevolution (Ubuntu RTM):
importance:	Undecided → Critical
Changed in sync-monitor (Ubuntu RTM):
importance:	Undecided → Critical
Changed in sync-monitor:
status:	Confirmed → Fix Committed

Revision history for this message

Bill Filler (bfiller) wrote on 2014-11-22:

We were able to improve the situation by limiting how far in the past to sync for calendar events. This was a combination of a new version of syncevolution, and a patch to it and sync-monitor to introduce a "syncInterval" configuration setting (defaults to 90 days) specifiying how many days in the past to go back when syncing. For my caledar, it used to take 20 minutes for initial sync. Now it takes 33 seconds! Will need testing by others but this seems to help greatly.

Bill Filler (bfiller) on 2014-12-19

tags:

added: ww03

Renato Araujo Oliveira Filho (renatofilho) on 2015-01-06

Changed in syncevolution (Ubuntu RTM):
status:	New → In Progress
assignee:	nobody → Renato Araujo Oliveira Filho (renatofilho)

Renato Araujo Oliveira Filho (renatofilho) on 2015-01-06

Changed in sync-monitor (Ubuntu RTM):
status:	New → In Progress
assignee:	nobody → Renato Araujo Oliveira Filho (renatofilho)

Pat McGowan (pat-mcgowan) on 2015-01-13

Changed in canonical-devices-system-image:
importance:	Undecided → High
milestone:	none → ww05-2015
status:	New → Confirmed

Bill Filler (bfiller) on 2015-01-17

tags:

added: ww05
removed: ww03

Bill Filler (bfiller) on 2015-01-27

tags:

added: ww07
removed: ww05

Pat McGowan (pat-mcgowan) on 2015-01-28

Changed in canonical-devices-system-image:
status:	Confirmed → In Progress
milestone:	ww05-2015 → ww07-2015

Revision history for this message

Pat McGowan (pat-mcgowan) wrote on 2015-02-05:

Add to critical per product team

Changed in canonical-devices-system-image:
importance:	High → Critical

Revision history for this message

Launchpad Janitor (janitor) wrote on 2015-02-06:

This bug was fixed in the package sync-monitor - 0.1+15.04.20150127~rtm-0ubuntu1

---------------
sync-monitor (0.1+15.04.20150127~rtm-0ubuntu1) 14.09; urgency=low

[ Ubuntu daily release ]
* New rebuild forced

  [ Renato Araujo Oliveira Filho ]
  * Use the new "startDate" filter to limit the number of events
    retrieved on the first calendar sync. (LP: #1339016)
-- Ubuntu daily release <email address hidden> Tue, 27 Jan 2015 13:43:48 +0000

Changed in sync-monitor (Ubuntu RTM):
status:	In Progress → Fix Released

Pat McGowan (pat-mcgowan) on 2015-02-06

Changed in canonical-devices-system-image:
status:	In Progress → Fix Released

Renato Araujo Oliveira Filho (renatofilho) on 2015-02-07

Changed in sync-monitor:
status:	Fix Committed → Fix Released
Changed in sync-monitor (Ubuntu):
status:	Fix Committed → Fix Released

Pat McGowan (pat-mcgowan) on 2015-06-24

Changed in syncevolution (Ubuntu RTM):
status:	In Progress → Fix Released

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

freedesktop-bugs #79014
[RESOLVED MOVED] Edit

Bug watches keep track of this bug in other bug trackers.