{"id":318,"date":"2009-06-05T08:34:31","date_gmt":"2009-06-05T13:34:31","guid":{"rendered":"http:\/\/www.visophyte.org\/blog\/?p=318"},"modified":"2009-06-05T08:34:31","modified_gmt":"2009-06-05T13:34:31","slug":"devmoxhibit-exhibit-on-devmo-deki-wiki-results","status":"publish","type":"post","link":"https:\/\/www.visophyte.org\/blog\/2009\/06\/05\/devmoxhibit-exhibit-on-devmo-deki-wiki-results\/","title":{"rendered":"DevMoXhibit: Exhibit on DevMo (Deki Wiki) results"},"content":{"rendered":"<p><a href=\"http:\/\/www.visophyte.org\/blog\/wp-content\/uploads\/2009\/06\/devmo-search-customize-toolbar.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-thumbnail wp-image-319\" title=\"devmo-search-customize-toolbar\" src=\"http:\/\/www.visophyte.org\/blog\/wp-content\/uploads\/2009\/06\/devmo-search-customize-toolbar-600x397.png\" alt=\"devmo-search-customize-toolbar\" width=\"600\" height=\"397\" srcset=\"https:\/\/www.visophyte.org\/blog\/wp-content\/uploads\/2009\/06\/devmo-search-customize-toolbar-600x397.png 600w, https:\/\/www.visophyte.org\/blog\/wp-content\/uploads\/2009\/06\/devmo-search-customize-toolbar-300x198.png 300w, https:\/\/www.visophyte.org\/blog\/wp-content\/uploads\/2009\/06\/devmo-search-customize-toolbar-1024x679.png 1024w, https:\/\/www.visophyte.org\/blog\/wp-content\/uploads\/2009\/06\/devmo-search-customize-toolbar.png 1434w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><\/a><\/p>\n<p>The above screenshot is of a normal search query on <a href=\"https:\/\/developer.mozilla.org\/\">DevMo<\/a> for &#8220;customize toolbar&#8221;.\u00a0 I see 2.5 results, and I honestly have no interest in the first item at all.\u00a0 (It&#8217;s a page that only advanced DevMo authors would care about, for those who refuse to squint or click on images to see bigger versions of images.)<\/p>\n<p><a href=\"http:\/\/www.visophyte.org\/blog\/wp-content\/uploads\/2009\/06\/devmoxhibit-search-customize-toolbar-corrected.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-thumbnail wp-image-321\" title=\"devmoxhibit-search-customize-toolbar-corrected\" src=\"http:\/\/www.visophyte.org\/blog\/wp-content\/uploads\/2009\/06\/devmoxhibit-search-customize-toolbar-corrected-600x384.png\" alt=\"devmoxhibit-search-customize-toolbar-corrected\" width=\"600\" height=\"384\" srcset=\"https:\/\/www.visophyte.org\/blog\/wp-content\/uploads\/2009\/06\/devmoxhibit-search-customize-toolbar-corrected-600x384.png 600w, https:\/\/www.visophyte.org\/blog\/wp-content\/uploads\/2009\/06\/devmoxhibit-search-customize-toolbar-corrected-300x192.png 300w, https:\/\/www.visophyte.org\/blog\/wp-content\/uploads\/2009\/06\/devmoxhibit-search-customize-toolbar-corrected-1024x656.png 1024w, https:\/\/www.visophyte.org\/blog\/wp-content\/uploads\/2009\/06\/devmoxhibit-search-customize-toolbar-corrected.png 1434w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><\/a><\/p>\n<p>The above screenshot is of the same query using DevMoXhibit.\u00a0 You will note you can see more things, and the first result from the other page is completely elided because we filter by default so that only &#8220;Real&#8221; result pages are shown.\u00a0 (In general, I am not looking for talk pages or user pages or meta-pages.)<\/p>\n<p>But enough about my interpretations of pictures, why don&#8217;t you:<\/p>\n<ul>\n<li><a href=\"http:\/\/clicky.visophyte.org\/tools\/devmoxhibit\/devmoxhibit.html?qs=customize+toolbar\">Try looking at the above results yourself.<\/a><\/li>\n<li><a href=\"http:\/\/clicky.visophyte.org\/tools\/devmoxhibit\/devmoxhibit.html\">Go formulate your own query and examine the results.<\/a><\/li>\n<\/ul>\n<p>Neat things we do that may not be immediately obvious:<\/p>\n<ul>\n<li>We flatten the score into deciles, and then within each decile range we sort based on the view count for the page.\u00a0 The theory is that, given equally likely results, the one that more people have looked at is probably more interesting to you, roughly speaking.<\/li>\n<li>We use a simple heuristic to figure out the page type, as mentioned above (&#8220;Real&#8221;, &#8220;Talk&#8221;, &#8220;User&#8221;, etc.)<\/li>\n<li>We try and hide all things related to the language, as we explicitly query on a language which means it&#8217;s just noise.\u00a0 Right now, that language is always english, but the code uses a variable if you want to write the code to hook that up and expose it in the UI.<\/li>\n<li>We produce a &#8220;smart&#8221; snippet.\u00a0 The snippets provided by the search results naively will include &#8220;chrome&#8221; that is part of the document, which makes for a nearly useless snippet.\u00a0 For example, take a gander at XUL\/toolbar:\n<ul>\n<li>Plain old snippet:\n<ul>\n<li>\u00ab XUL Reference home \u00a0\u00a0 [ Examples | Attributes | Properties | Methods | Related ]      A container which typically contains a row of buttons. It is a type of box that defaults to horizontal orientation. &#8230;<\/li>\n<\/ul>\n<\/li>\n<li>Smart snippet:\n<ul>\n<li><span class=\"snippet\"><span>A container which typically contains a row of buttons. It is a type of box that defaults to horizontal orientation. &#8230;<\/span><\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<li><span class=\"snippet\"><span>We produce a sometimes over-zealous smart snippet.\u00a0 If you were to keep reading both of those snippets, you would notice that the smart snippet eats a bit that the non-smart-snippet does not.\u00a0 That is because the smart snippet is based on looking at a version of the snippet which has HTML tags in it, and then it tries to nuke those HTML tags out of existence using simple regexps.<br \/>\n<\/span><\/span><\/li>\n<\/ul>\n<p>Implementation notes:<\/p>\n<ul>\n<li>This probably should work on other deki wikis if so adapted, but I don&#8217;t use any others, so YMMV.<\/li>\n<li>We actually issue two search queries because there are two result formats that can be produced.\u00a0 &#8220;xml&#8221; is an inexplicable mixture of too much data and too little data.\u00a0 Namely, it does not tell you the tags on a document, which is basically the most useful piece of info, but it does tell you every link to and from that page (which we expose, although I doubt it will be useful enough to justify it).\u00a0 It does give you a link to be able to get the tags, but that&#8217;s a costly operation when you have to perform it for each search result.\u00a0 In contrast, &#8220;search&#8221; gives you the tags; they are only space-delimited, but that&#8217;s fine.\u00a0 (&#8220;Inexplicable&#8221; may be a bit harsh; looking at the source, it&#8217;s just dumping the page info without further processing\/lookups, but arguably it would be very useful if they made the effort to fetch that data.)<\/li>\n<li>Because of cross-site XHR issues, this is not quite as hackable as I would like.\u00a0 My demo server above is using mod_proxy (with a very specific constraint) to proxy the search to DevMo.\u00a0 When I develop locally, I have to do the same thing.\u00a0 Presumably if you are using Firefox 3.5 and devmo is set up correctly, then this would not be a problem.\u00a0 But, 1) for no good reason, I only use Firefox 3.0 and 2) have no clue whether devmo is emitting the headers that would enable that to work.\u00a0 I strongly encourage someone to look into #2 and fix it if not.<\/li>\n<li>As with BugXhibit, the sliders are totally broken for me and it&#8217;s sad, but I left them in there in the hopes that they work for someone, somewhere.\u00a0 Alternately, I would not complain if someone, somewhere, fixed them.<\/li>\n<\/ul>\n<p>The hg repo is <a href=\"http:\/\/hg.mozilla.org\/users\/bugmail_asutherland.org\/devmoxhibit\/\">here<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The above screenshot is of a normal search query on DevMo for &#8220;customize toolbar&#8221;.\u00a0 I see 2.5 results, and I honestly have no interest in the first item at all.\u00a0 (It&#8217;s a page that only advanced DevMo authors would care &hellip; <a href=\"https:\/\/www.visophyte.org\/blog\/2009\/06\/05\/devmoxhibit-exhibit-on-devmo-deki-wiki-results\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[3],"tags":[62,61,60],"class_list":["post-318","post","type-post","status-publish","format-standard","hentry","category-mozilla","tag-devmo","tag-exhibit","tag-simile"],"_links":{"self":[{"href":"https:\/\/www.visophyte.org\/blog\/wp-json\/wp\/v2\/posts\/318","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.visophyte.org\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.visophyte.org\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.visophyte.org\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.visophyte.org\/blog\/wp-json\/wp\/v2\/comments?post=318"}],"version-history":[{"count":3,"href":"https:\/\/www.visophyte.org\/blog\/wp-json\/wp\/v2\/posts\/318\/revisions"}],"predecessor-version":[{"id":324,"href":"https:\/\/www.visophyte.org\/blog\/wp-json\/wp\/v2\/posts\/318\/revisions\/324"}],"wp:attachment":[{"href":"https:\/\/www.visophyte.org\/blog\/wp-json\/wp\/v2\/media?parent=318"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.visophyte.org\/blog\/wp-json\/wp\/v2\/categories?post=318"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.visophyte.org\/blog\/wp-json\/wp\/v2\/tags?post=318"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}