How the Lobsters front page works

62 points by atharva


pushcx

I'm not the author of this code, but I've been maintaining it for a while. This is a great writeup. I'm pretty sure it's based on the Reddit link ranking algorithm, which was well-described by Evan Miller here and in a followup.

It would be great to see a similar writeup and simulator for comment ranking ("confidence"), which is a different algorithm. It's been tinkered with a lot over the years. I'm not sure it makes much sense anymore, and I'm pretty sure the tag weighting is just applied wrong with addition instead of multiplication. And I covet a very clever HN feature for getting attention to new threads where (at least for the first couple days) the threads are sorted best-first, but with the newest interleaved, so it goes (newest comment, top thread, 2nd newest comment, 2nd thread, etc). We haven't seen the unfortunate Reddit gaming of "hijacking the top comment to say..." but I'd like to encourage late comments more. (This is also why /active is next to the logo.)

I'm open to improvements on these. One big difference between us and Reddit/HN is that we don't have downvotes to indicate disagreement. jcs required that downvoters pick a from a list of predetermined reasons, but the familiar UI didn't work out. Commenters can see the flags on their comments, so we had a lot of discussions immediately distracted into meta conversations about why a comment was flagged. I changed the UI to move it from a down arrow over to "flagging" and spent a lot of time emphasizing in comments and messages that it should be used for things that need mod attention rather than disagreeing. Even a pretty recent change to enforce that users can reply to or flag a comment but not both (stream 1 and 2).

I'm also open to improvements on improving the tone and quality of conversations, though that's harder to nudge than a couple lines of javascript.

Forty-Bot

I've given up on the front page algorithm. Popular stories stay on top for way too long before getting demoted. It's common for a story to stay on the front page for days, and it's pretty annoying to have to scroll past the same story for the 3rd or 4th time. At this point I only browse new, which frustratingly takes two clicks to get to from the front page.