{"id":117,"date":"2008-08-19T05:59:11","date_gmt":"2008-08-19T10:59:11","guid":{"rendered":"http:\/\/www.visophyte.org\/blog\/?p=117"},"modified":"2009-04-01T08:36:45","modified_gmt":"2009-04-01T13:36:45","slug":"thunderbird-full-text-search-prototype-a-la-sqlite-fts3","status":"publish","type":"post","link":"https:\/\/www.visophyte.org\/blog\/2008\/08\/19\/thunderbird-full-text-search-prototype-a-la-sqlite-fts3\/","title":{"rendered":"Thunderbird full-text search prototype a la SQLite FTS3"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-118\" title=\"tb-fulltext-proto-1\" src=\"http:\/\/www.visophyte.org\/blog\/wp-content\/uploads\/2008\/08\/tb-fulltext-proto-1.png\" alt=\"\" width=\"664\" height=\"156\" srcset=\"https:\/\/www.visophyte.org\/blog\/wp-content\/uploads\/2008\/08\/tb-fulltext-proto-1.png 664w, https:\/\/www.visophyte.org\/blog\/wp-content\/uploads\/2008\/08\/tb-fulltext-proto-1-600x140.png 600w, https:\/\/www.visophyte.org\/blog\/wp-content\/uploads\/2008\/08\/tb-fulltext-proto-1-300x70.png 300w\" sizes=\"auto, (max-width: 664px) 100vw, 664px\" \/><\/p>\n<p>Full-text search using FTS3.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/www.visophyte.org\/blog\/wp-content\/uploads\/2008\/08\/tb-fulltext-proto-2.png\" alt=\"\" width=\"663\" height=\"147\" \/><\/p>\n<p>Full-text search with a contact constraint.<\/p>\n<p>The global database sqlite file resulting from indexing all of mozilla.dev.apps.thunderbird is about 13M for something like 4500 messages.\u00a0 We&#8217;re providing FTS3 with the bodies (but not attachments!) of all the newsgroup messages and the subjects of the messages which initiate new threads.\u00a0 For real usage, we will need to also index the subjects of each message.<\/p>\n<p>Note that the message bodies have not been processed at all by the Thunderbird\/gloda code before handing them off to FTS3.\u00a0 So quoted messages get indexed even though it&#8217;s a lot of excess data.\u00a0 We&#8217;re relying on FTS3 to do all stop-words, etc.\u00a0 FTS3&#8217;s Porter stemming\/tokenization is in use.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Full-text search using FTS3. Full-text search with a contact constraint. The global database sqlite file resulting from indexing all of mozilla.dev.apps.thunderbird is about 13M for something like 4500 messages.\u00a0 We&#8217;re providing FTS3 with the bodies (but not attachments!) of all &hellip; <a href=\"https:\/\/www.visophyte.org\/blog\/2008\/08\/19\/thunderbird-full-text-search-prototype-a-la-sqlite-fts3\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[3,6],"tags":[38,19,126],"class_list":["post-117","post","type-post","status-publish","format-standard","hentry","category-mozilla","category-thunderbird","tag-exptoolbar","tag-gloda","tag-thunderbird"],"_links":{"self":[{"href":"https:\/\/www.visophyte.org\/blog\/wp-json\/wp\/v2\/posts\/117","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.visophyte.org\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.visophyte.org\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.visophyte.org\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.visophyte.org\/blog\/wp-json\/wp\/v2\/comments?post=117"}],"version-history":[{"count":5,"href":"https:\/\/www.visophyte.org\/blog\/wp-json\/wp\/v2\/posts\/117\/revisions"}],"predecessor-version":[{"id":291,"href":"https:\/\/www.visophyte.org\/blog\/wp-json\/wp\/v2\/posts\/117\/revisions\/291"}],"wp:attachment":[{"href":"https:\/\/www.visophyte.org\/blog\/wp-json\/wp\/v2\/media?parent=117"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.visophyte.org\/blog\/wp-json\/wp\/v2\/categories?post=117"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.visophyte.org\/blog\/wp-json\/wp\/v2\/tags?post=117"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}