Comments on: tag clouds for insight and knowledge.

By: cgc373

cgc373 — Fri, 04 May 2007 12:56:50 -0800

It'd be interesting to see such a display. I vote "Yes, please!"

By: CKmtl

CKmtl — Fri, 04 May 2007 12:59:40 -0800

Wouldn't that just result in a big cloud of "I" "a" "the" "and" and so forth?

By: and hosted from Uranus

and hosted from Uranus — Fri, 04 May 2007 13:00:45 -0800

You mean a cloud of all the tags of all threads we've commented in and/or created?

Would be interesting, yes.

By: thirteenkiller

thirteenkiller — Fri, 04 May 2007 13:01:12 -0800

I would like to have a parts of speech cloud for my profile please.

By: ND¢

ND¢ — Fri, 04 May 2007 13:07:18 -0800

Don't bother with all that coding mumbo-jumbo. Here you go:

meh Iraq asshat circumcision cockpunch cat douchebag yawn Bush

By: pb

pb — Fri, 04 May 2007 13:10:19 -0800

You'd have to come up with a big list of little words to ignore, or use something like Yahoo's term extraction service to pick out keywords. But crunching that much text for thousands of users would be a bit resource intensive no matter which way you go.

By: Joey Michaels

Joey Michaels — Fri, 04 May 2007 13:26:29 -0800

ND¢ - You left out "batshitinsane."

By: inigo2

inigo2 — Fri, 04 May 2007 13:26:45 -0800

NDcentsign -- you forgot the "."

By: popechunk

popechunk — Fri, 04 May 2007 13:36:12 -0800

At least just do one for quonsar.

By: cortex

cortex — Fri, 04 May 2007 13:38:20 -0800

Man. I like that. Putting it on my big list of Things To Do With The DB Eventually Maybe, that's for sure.

By: snsranch

snsranch — Fri, 04 May 2007 13:41:02 -0800

I don't like to post negative comments, but I don't like this idea. If you're curious about a persons posting history, comments, etc, just check the profile.

Derail: Matt's time would be better spent creating MeRe (Metafilter Reviews). Just my very humble opinions.

By: snsranch

snsranch — Fri, 04 May 2007 13:42:14 -0800

Oh, and that should be pronounced, Mee Ree, not Mee Reh.

By: cgc373

cgc373 — Fri, 04 May 2007 13:44:11 -0800

Why wouldn't it be MeViews, snsranch?

By: carsonb

carsonb — Fri, 04 May 2007 13:49:38 -0800

Why can't we stick with the current heuristics we have to help us relate to one another? Why does anyone need good information to make bad judgements about those with whom we disagree? Let's just keep on with the half-remembered grievances and square holes we already have winnowed out for anyone we don't really know (or even care to know) crossing our path. If you need a crib, ND¢ has given you a good start.

By: Dave Faris

Dave Faris — Fri, 04 May 2007 13:51:27 -0800

Maybe this can be a side project for someone. I don't think it would need to be updated constantly. Once a day, failing that, week/month would work, too.

By: snsranch

snsranch — Fri, 04 May 2007 13:51:40 -0800

cgc373: Ok!

carsonb: I agree.

By: cortex

cortex — Fri, 04 May 2007 13:57:30 -0800

(I should maybe clarify that what I like is the idea of the analysis itself. The autoposting on everybody's profile, not so much, though it might be a fun optional widget.)

By: Dave Faris

Dave Faris — Fri, 04 May 2007 13:59:24 -0800

Actually, just looking over my posts, I already see a fly in the ointment. A lot of my posts include quotes from websites, news stories, or other posters, which would really skew the results.

By: cgc373

cgc373 — Fri, 04 May 2007 14:16:41 -0800

Huh, yep, you're right about that fly, Dave Faris. And how would y2karl's tooltip text be read or imaged in a tag cloud? This is probably a nifty thing if it can be accomplished by magic, but maybe not so nifty that it needs to be engineered.

By: vacapinta

vacapinta — Fri, 04 May 2007 14:17:03 -0800

I fail to see anything interesting about this and I'm a data nerd myself. The reason tagclouds are interesting for presidential speeches is that they are focused deliveries and this helps pull out that focus and make it more obvious. A scattershot summation of comments which span thousand of different topics seems utterly useless.

By: Afroblanco

Afroblanco — Fri, 04 May 2007 14:17:30 -0800

I think this would be a fun random nonsequitur generator, but it would tell you absolutely nothing about the user's personality.

By: monju_bosatsu

monju_bosatsu — Fri, 04 May 2007 14:39:12 -0800

I miss GeneFilter.

By: Mister_A

Mister_A — Fri, 04 May 2007 14:41:44 -0800

I'd be embarrassed to see a graphical depiction of how frequently I use the word "fucktard". So let's do this thing!

By: languagehat

languagehat — Fri, 04 May 2007 14:51:39 -0800

I miss GeneFilter.

Me too. That was a thousand times better than this could ever be. Bring back GeneFilter!

By: cortex

cortex — Fri, 04 May 2007 14:57:12 -0800

A scattershot summation of comments which span thousand of different topics seems utterly useless.

Maybe, but it'd reveal some fun idiosyncracies if done right, and give a reasonable view into topics of interest.

It seems like one way to make the analysis more interesting is to get away from the idea of just emphasizing words in a cloud only according to raw frequency, and instead hilight those words for each user which appear more often than compared to a normalized mefite baseline.

So we count the total number of occurances of token "terror" in all mefi comments, and the total number of comments, and get our mefi-specific word frequency. And then compare each specific mefite's frequency for that word to the baseline, and hilite the outliers. (Would take some futzing with thresholds to get it looking good, especially accounting for mefites with small total word counts, but that's all just polish.)

And yeah, it's a silly thing, but silly things are awesome.

By: cgc373

cgc373 — Fri, 04 May 2007 15:02:29 -0800

MetaFilter: yeah, it's a silly thing, but silly things are awesome.

By: cgc373

cgc373 — Fri, 04 May 2007 15:03:01 -0800

Too soon?

By: vacapinta

vacapinta — Fri, 04 May 2007 15:12:38 -0800

And then compare each specific mefite's frequency for that word to the baseline, and hilite the outliers.

That sounds good. It would catch all the people who write "dependant" instead of "dependent" as well as all the people who use in-jokes way too much.

By: juv3nal

juv3nal — Fri, 04 May 2007 15:15:53 -0800

I'd just like even to see a list of tags for my own comments. Not any kind of nitty gritty text crunching like you guys seem to be talking about here, but just a list of tags attached to posts which I've commented on. AFAIK, as things stand you can only see the top few tags for things where you're the original poster, right?

By: quin

quin — Fri, 04 May 2007 15:44:07 -0800

I think it's a pretty nifty idea. I wonder how much mine would reveal about me, that even I don't know. Like; "Hey, I had no idea that used the term 'pig-fucker' that often. What does that say about me?.."

I say bring it on. Self examination should always be a source of amusement.

By: timeistight

timeistight — Fri, 04 May 2007 15:50:08 -0800

But crunching that much text for thousands of users would be a bit resource intensive no matter which way you go.

Okay, how about just giving me everything I've written and let me do the crunching?

By: LarryC

LarryC — Fri, 04 May 2007 16:06:48 -0800

What we need is a Firefox extension that generates a popup tag cloud when you mouse over a user name. I have no idea how to produce such magical goodness, but someone here can do it.

By: Kwine

Kwine — Fri, 04 May 2007 16:27:15 -0800

Metafilter: In-joke dependant.

By: amyms

amyms — Fri, 04 May 2007 16:37:16 -0800

How about a tag cloud for people who use "cloud" as a tag?

By: Abiezer

Abiezer — Fri, 04 May 2007 17:04:35 -0800

Through a cloud, not of war only, but detractions rude.

By: miss lynnster

miss lynnster — Fri, 04 May 2007 17:34:52 -0800

Uh oh. I can see that whole topless phase o' mine is going to continue to haunt me...

By: mdevore

mdevore — Fri, 04 May 2007 18:02:12 -0800

What we need is a Firefox extension that generates a popup tag cloud when you mouse over a user name

Would an extension which lets you select and set various tags for individual users be sufficient? 'Cuz yesterday I was reading through AskMe and ran across a virulently stupid remark and thought, "hmmm, now I remember, this person has idiot trended for a while now and it isn't even me." Which made me think creating an extension to tag users per post might be handy to better track different users' credibility or interests or whatever. And then I took a nap and got over it. But it's still an idea.

Otherwise, an automatic tag cloud extension as you describe would probably need to accrete tags over a period of time due to the multiple page hits/lookups necessary to grow it, as post history is slowly mined out. You also couldn't do it for every single member simultaneously without carting around a prohibitive amount of data in the browser session, but there are ways around that, e.g. limiting to particular members or day counts. Possible. Just hard.

By: maxwelton

maxwelton — Fri, 04 May 2007 18:31:52 -0800

OK, OK, OK! Yes! You caught me! Fine! Christ! Sure, Seventeen year old girls shows up a lot in the cloud! So what? I'm just being honest, unlike the rest of you horny old goats (I saw you looking, don't deny it).

And I have no idea how pubic hair, ferret-legging, and where-is-the-rainbow-party got in the cloud, but it's a LIE propagated by the CABAL to DISCREDIT me.

By: Firas

Firas — Fri, 04 May 2007 18:54:52 -0800

So, what did GeneFilter do before extinction?

By: euphorb

euphorb — Fri, 04 May 2007 19:19:42 -0800

The first Genefilter thread.

By: Firas

Firas — Fri, 04 May 2007 19:50:11 -0800

Interesting. I wonder what the algorithm behind it was? It doesn't look like it's plugged into a language parser... looks like it's:

Grab a handful of comments
Split them by periods, randomly pick one of the resulting segments (ie. a sentence) from each
Concatenate the sentences, in random order

The difficult part is the first step of course.

By: Firas

Firas — Fri, 04 May 2007 19:53:49 -0800

No, wait... it's splicing sentence fragments together.

By: jbickers

jbickers — Fri, 04 May 2007 19:59:21 -0800

When Web 3.0 arrives next month, clouds are going to start to look ridiculous.

By: Alvy Ampersand

Alvy Ampersand — Fri, 04 May 2007 20:28:49 -0800

I've looked at tag clouds from both sides now.
I really don't know tag clouds at all.

Still, it's a really neat idea, even if I'd be kind of scared to see my results.

By: klangklangston

klangklangston — Fri, 04 May 2007 20:38:50 -0800

Fuck fucking farfegnugen Federov filibuster Faberge Holocaust infinitesmimal Appallonia Prince

By: klangklangston

klangklangston — Fri, 04 May 2007 20:39:28 -0800

The lack of BIG tag makes that less funny; just imagine where appropriate.

By: cgc373

cgc373 — Fri, 04 May 2007 21:33:06 -0800

"Appallonia" is worth the price of a cloud on its own, klangklangston.

By: taosbat

taosbat — Fri, 04 May 2007 23:07:51 -0800

Braaaiiinnnzzz...drool...

By: cortex

cortex — Fri, 04 May 2007 23:08:05 -0800

Firas: google "Markov Chains". Probabilistic regurgitation of source material according to a frequency table of expected cooccurances. Neat shit.

By: hoverboards don't work on water

hoverboards don't work on water — Sat, 05 May 2007 02:42:27 -0800

OK, so... is there any reason the MeFi database should not be made publicly available? Like the Wikipedia database. Is it full of secret information that is not already visible across the site? Could that not be easily stripped out before distributing, say, monthly snapshots?

This tag cloud idea is exactly the kind of really-time-consuming-but-kinda-interesting thing which is crying out for a third party with too much time on his hands to do.

By: klangklangston

klangklangston — Sat, 05 May 2007 06:34:03 -0800

"Is it full of secret information that is not already visible across the site?"

It has Matt's comments about all the users plastered across so only he and Jessamyn can see (sorry cortex, you're too new), in order to keep us straight.

Allowing us to see how the MeFi sausage is made would lead to tears.

By: cortex

cortex — Sat, 05 May 2007 07:27:30 -0800

I've always been for a db dump of some sort. Matt was talking about it as a possibility months back, in a thread in the grey, but I don't think we quite got him to critical mass on making it happen.

It's got to be a hefty chunk of data, though, and once we're talking about handing over essentially 8 years of what mefi is, arguing toward a more closed, opt-in, state your intentions release starts to sound like a good idea.

Is it full of secret information that is not already visible across the site?

There's stuff that would need to be scrubbed for general release, I think.

(sorry cortex, you're too new)

So you think, Mister 'doesn't play well with others; see medical report viz. sexual difficulties; rated C-14 on bannability scale; lousy at badminton'.

By: klangklangston

klangklangston — Sat, 05 May 2007 07:50:25 -0800

You're obviously not seeing the real info, cortex— You'd know that my sexual difficulties are directly related to being lousy (also indecent) at badminton. Or "bad mitten," as I like to think of it.

By: timeistight

timeistight — Sat, 05 May 2007 09:51:18 -0800

I've always been for a db dump of some sort.

Goody!

Matt was talking about it as a possibility months back, in a thread in the grey, but I don't think we quite got him to critical mass on making it happen.

It's got to be a hefty chunk of data, though, and once we're talking about handing over essentially 8 years of what mefi is, arguing toward a more closed, opt-in, state your intentions release starts to sound like a good idea.

Okay, where do I sign up?

By: Kwine

Kwine — Sat, 05 May 2007 11:49:05 -0800

*fails to think of a funny joke involving "shuttlecock"*

By: klangklangston

klangklangston — Sat, 05 May 2007 13:55:52 -0800

It's the fastest moving ball of any sport!

By: terrapin

terrapin — Sat, 05 May 2007 14:04:24 -0800

I think pb and matt should work on all the cool things they were discussing in podcast #6. Especially the admin ponies.

By: infini

infini — Sat, 05 May 2007 18:47:31 -0800

Oh, and that should be pronounced, Mee Ree, not Mee Reh.
posted by snsranch at 1:42 PM on May 4 [+]
[!]

Oh thank you kindly, I had just finished say May ray in my head...

By: davy

davy — Thu, 10 May 2007 00:15:59 -0800

Why yes, I think it should be easy for anybody who's interested to keep even closer tabs on us and everything we post here. Why don't we share our credit card numbers and ATM PINs too? Dave Daris, you first!

By: davy

davy — Thu, 10 May 2007 00:16:56 -0800

(Dave Faris, I meant. I.e. the OP)

By: Dave Faris

Dave Faris — Thu, 10 May 2007 04:58:18 -0800

Take your meds.