Comments on: Thunderbird full-text search prototype a la SQLite FTS3 http://www.visophyte.org/blog/2008/08/19/thunderbird-full-text-search-prototype-a-la-sqlite-fts3/ visualizing things with python Wed, 07 Jan 2009 19:11:08 +0000 http://wordpress.org/?v=2.7 hourly 1 By: david ascher - » Gearing up http://www.visophyte.org/blog/2008/08/19/thunderbird-full-text-search-prototype-a-la-sqlite-fts3/comment-page-1/#comment-404 david ascher - » Gearing up Wed, 20 Aug 2008 01:53:03 +0000 http://www.visophyte.org/blog/?p=117#comment-404 [...] end-users, from the mundane (a birthday field in the address book, simpler account setup) to some powerful, platform-style [...] [...] end-users, from the mundane (a birthday field in the address book, simpler account setup) to some powerful, platform-style [...]

]]> By: Arthur http://www.visophyte.org/blog/2008/08/19/thunderbird-full-text-search-prototype-a-la-sqlite-fts3/comment-page-1/#comment-402 Arthur Tue, 19 Aug 2008 18:11:35 +0000 http://www.visophyte.org/blog/?p=117#comment-402 Yes, a lot of my messages won't ever be searched simultaneously. They're in different folders and different mail account. The maximum of messages to search at the same time would probably be around 400'000 at the moment. That's still quite a lot and the current subject/sender search field already takes its time. But I'm certainly looking forward to the new search features! Making the handling of mails easier is wonderful. Thank's for the great work. A plot of index disk usage vs. number of mails and search time vs. number of mails would certainly be interesting. Probably interesting enough for an automated regression test like the current performance measurements for FF? Yes, a lot of my messages won’t ever be searched simultaneously. They’re in different folders and different mail account. The maximum of messages to search at the same time would probably be around 400′000 at the moment. That’s still quite a lot and the current subject/sender search field already takes its time. But I’m certainly looking forward to the new search features! Making the handling of mails easier is wonderful. Thank’s for the great work.

A plot of index disk usage vs. number of mails and search time vs. number of mails would certainly be interesting. Probably interesting enough for an automated regression test like the current performance measurements for FF?

]]> By: Andrew Sutherland http://www.visophyte.org/blog/2008/08/19/thunderbird-full-text-search-prototype-a-la-sqlite-fts3/comment-page-1/#comment-400 Andrew Sutherland Tue, 19 Aug 2008 16:44:53 +0000 http://www.visophyte.org/blog/?p=117#comment-400 Right, that's not a limitation on a number of messages it can index or easily handle. The example is to provide an idea of 'bloat' for disk usage for FTS3, mozilla.dev.apps.thunderbird hopefully being near and dear to many hearts. On the other hand, 2 million messages is a lot. I expect that would require extra leg-work to be able to handle that optimally. Are a lot of those messages from mailing lists? More specifically, can they be categorized into different domains, not all of which need to be accessed all simultaneously? We could potentially segment the database along those lines. Right, that’s not a limitation on a number of messages it can index or easily handle. The example is to provide an idea of ‘bloat’ for disk usage for FTS3, mozilla.dev.apps.thunderbird hopefully being near and dear to many hearts.

On the other hand, 2 million messages is a lot. I expect that would require extra leg-work to be able to handle that optimally.

Are a lot of those messages from mailing lists? More specifically, can they be categorized into different domains, not all of which need to be accessed all simultaneously? We could potentially segment the database along those lines.

]]> By: Arthur http://www.visophyte.org/blog/2008/08/19/thunderbird-full-text-search-prototype-a-la-sqlite-fts3/comment-page-1/#comment-397 Arthur Tue, 19 Aug 2008 11:30:38 +0000 http://www.visophyte.org/blog/?p=117#comment-397 4500 is bit low for daily usage. My mail folders have something like 2 million messages in total. I hope it'll be still usable with that many mails. 4500 is bit low for daily usage. My mail folders have something like 2 million messages in total. I hope it’ll be still usable with that many mails.

]]>