about summary refs log tree commit homepage
path: root/lib
DateCommit message (Collapse)
2015-09-15extmsg: wire up to use msgmap for prefixes
DBI + DBD::SQLite has much better handling of prefix lookups than Xapian. While we're at it, avoid linking blatantly wrong Message-IDs to external services.
2015-09-15searchidx: sync Msgmap database along with Xapian
We can avoid duplicating work of extracting messages from git if we tie this to Xapian. Of course, this ties the two features together, but it's probably reasonable to expect that anybody who wants to use public-inbox to serve messages to front-end users will have both.
2015-09-15searchidx: hoist out rlog code
We'll be reusing this for loading msgmap.
2015-09-15msgmap: add message mapping via SQLite
This will allow us to maintain stable article numbers for an NNTP server independently of Xapian.
2015-09-14searchview: do not link Atom feed by relevance
Atom feeds only make sense when sorted by time, not when our search indexing rules change and affect relevance. So do not include the relevance option when linking to Atom feeds. However, we shall still honor the 'r' query parameter in case somebody wants to manually include that in the URL for testing/experimental purposes. We simply will not advertise it.
2015-09-13view: jump to anchor of current message on References
Otherwise it could be a bit disorienting to jump to the first message in the thread without navigation context.
2015-09-13view: do not show References unless a message has them
It's a waste of space and potentially confusing.
2015-09-13view: use header_obj to avoid extra method calls
Email::MIME will call the header_obj each time anyways, avoid the extra method lookups and hit header_obj directly for the header lookup.
2015-09-13view: extra Atom feed link in standalone message view
It might be helpful if user agents do not display the <link> element in <head>.
2015-09-13view: add Atom links in headers for per-message links
Some user agents will advertise the presence of a feed this way for users to subscribe to individual topics.
2015-09-13searchview: implement Atom feed for search results
This can be helpful for folks who want to subscribe to a particular topic or keyword.
2015-09-13feed: consolidate updated tag generation
We'll be reusing this code further in the next commit.
2015-09-12searchview: support displaying entire threads
This hopefully makes it easy to perform queries to display an entire thread. Raise the limit in the threaded view to display more results and hopefully improve the output of thread display.
2015-09-12searchview: hoist out subroutines for clarity
We'll be expanding the search view to handle expanded views.
2015-09-12view: more consistent prefix for ghost links
This will be reused for search views.
2015-09-10constent X?HTML MIME type filtering
Filter and View should reject X?HTML the same way.
2015-09-07view: change References link to expand thread
The expanded thread view is generally more useful. Having links to more links at the bottom seems to a waste of navigation time. However, keep the '#r' anchor in case people rely on it for links.
2015-09-06update copyright headers and email addresses
In the future, it should be possible to use this: git ls-files | UPDATE_COPYRIGHT_HOLDER='all contributors' \ UPDATE_COPYRIGHT_USE_INTERVALS=2 \ xargs /path/to/gnulib/build-aux/update-copyright
2015-09-05extmsg: add note about the deficiency of the implementation
ref: http://public-inbox.org/meta/20150905091457.GA27857@dcvr.yhbt.net/
2015-09-05searchview: link users to permalink instead of thread
The permalink should load faster if the user had a good query and users can easily find the rest of the message in the thread.
2015-09-05extmsg: fall back to partial Message-ID matching
In case a URL gets truncated (as is common with long URLs), we can rely on Xapian for partial matches and bring the user to their destination.
2015-09-05search: tweak parsing for internal queries
We should not need to use QueryParser for internal queries, but rather for external ones. We'll also be exposing searching Message-IDs with the "mid:" prefix for broken mids on some servers, and enabling partial searching with 'm' to help with URL truncations. Since thread IDs may be volatile, they cannot be exposed to the public, there's no reason to expose them to the query parser, either. Also, add 's:' as an alternative probabilistic prefix to 'subject' as it is shorter.
2015-09-05search: note why we do not support FLAG_PURE_NOT
Perhaps this can be optionally enabled in the future for smaller sites.
2015-09-05searchview: error description for invalid queries
Xapian may raise exceptions on some queries. Pass the error along to the user so they can read Xapian documentation.
2015-09-05search: use relevance as secondary sort by default
Might as well give relevance some weight if the timestamp is tied.
2015-09-05searchview: factor out dump_mset subroutine
We'll be moving atom and thread display support inline and reducing endpoints. Maybe it makes sense, maybe not.
2015-09-05searchview: improve footer navigation
Aallow navigating backwards and forwards, as some pages will be bookmarked or some browsers may not have history. Also add a link back to the index where they presumably came from. While we're at it, limit the number of results we have to 25 for now to avoid making the page too big and wasting clients memory for irrelevant results.
2015-09-05view: preliminary HTML search interface
This hopefully makes it easier to find things without resorting to proprietary external services.
2015-09-04view: fix broken link to ghost fallback
Once again, the regression was introduced in commit 16ca6b7a57266fcb466ffff005bc1d644bad14c1 (view: avoid attempting to find "subject dummy")
2015-09-04www: extra redirects for the '/'-challenged
Omitting a slash should not be fatal if unambiguous. Add fallbacks so users who expect a directory structure-like experience can have it at the cost of one extra HTTP request/response pair. This matches behavior of static sites.
2015-09-04view: thread view expands focused message
Non-top-level messages still deserve to be shown in full if they're the message in the URL.
2015-09-04view: indentation adjustments for collapsed headers
This makes the layout between the permalink threads and index threads more consistent; hopefully.
2015-09-04view: reduce redundant attributions in permalink refs
No point in repeating authorship when PATCH messages are threaded and it's obvious from the top message who the author is of the series: [this message] - John Smith @ 2015-09-04 00:04:20 UTC ` [PATCH 1/4] view: eliminate redundant [threaded|flat] link ` [PATCH 2/4] view: one line for thread subjects ` [PATCH 3/4] view: adjust spacing and indentation of index threads ` [PATCH 4/4] view: add missing newline to inline dump
2015-09-04view: add missing newline to inline dump
This fixes a regression introduced in commit 16ca6b7a57266fcb466ffff005bc1d644bad14c1 (view: avoid attempting to find "subject dummy")
2015-09-04view: adjust spacing and indentation of index threads
Avoid wasting precious horizontal space by indenting children excessively relative to the top-level parent.
2015-09-04view: one line for thread subjects
We truncate subjects in the Xapian document anyways, so lines should not be too long and it hopefully won't throw off the vertical display.
2015-09-04view: eliminate redundant [threaded|flat] link
We do not need to waste space with that link when we have it conveniently placed where every message is located.
2015-09-04view: do not generate anchors in thread views
They're unused, and they can have namespace conflicts if there's multiple full messages in the thread view.
2015-09-04SearchMsg: avoid encoding Message-IDs
Spaces may be added when using header_str with Email::MIME->create, so use the normal "header" parameter when setting Message-IDs and References.
2015-09-04view: avoid attempting to find "subject dummy"
This is an internal Message-ID used by Mail::Thread, to group messages with identical subjects but common parent. Don't attempt to redirect users to external sites when we cannot find it.
2015-09-04extmsg: close HTML tag in response
Oops, browsers normally render this fine, though.
2015-09-04consolidate thread sorting in view
This is a display subroutine so it should not be in our thread monkey-patching package, but instead in the view package. Hopefully one day in the future, Mail::Thread will be maintained again and we'll no longer need PublicInbox::Thread at all.
2015-09-04index: use message threading if search is available
This lets us merge topics with different subjects with a common parent (common in "[PATCH 0/X]" threads). This also lets us avoid forking for the HTML index page, too.
2015-09-03www: move fallback after legacy matches
We do not want to get legacy URLs swallowed up by our workaround for weird and wonky servers that attempt to unescape PATH_INFO before the app sees it.
2015-09-03feed: use application/atom+xml for Content-Type
This is the correct Content-Type for Atom feeds, especially since we updated to use ".atom" as the suffix.
2015-09-03www: attempt to handle Message-IDs with slashes
Unfortunately, some HTTP servers will try to be clever with %2F and escape it to '/', making life difficult for us. Fortunately, not many Message-IDs have slashes in them.
2015-09-03get rid of Message-ID compression entirely
Provide a fallback for legacy SHA-1 messages, but do not advertise shorter URLs anymore for data portability concerns. This fixes a regression introduced in commit 81a9c1b476987d845b340ab9013d26cf4487cb9a ("search: disable Message-ID compression in Xapian") which ended up breaking thread-related endpoints for large Message-IDs, as lookups on the SHA-1 message no longer worked.
2015-09-03ExtMsg: 300 to external mailing list archives
Since cross-posting is inevitable, we shall link to external message archives for interopability.
2015-09-03search: disable Message-ID compression in Xapian
We'll continue to compress long Message-IDs in URLs (which we know about), but we will store entire Message-IDs in the Xapian database to facilitate ease-of-lookups in external databases.
2015-09-03view: include ghost messages in thread views
We'll be expanding our ghost message lookup facilities, so it makes sense to generate links to them even if they are currently unknown.