When it was time to settle down with the right man, Amy Webb joined two dating sites, created a profile, and went on some horrible dates. Her solution was to create fake male profiles and then scrape and analyze data to find out how she could improve her chances.

Posing as these men, I spent a month using JDate. I interacted with 96 women, cataloging how they behaved and presented themselves online and scraping data from their profiles (such as the language they used or the number of hours they waited before emailing back one of my profiles). Wanting to learn everything I could about my competition, I kept a detailed database, and I recorded which female profiles were popular. While JDate doesn’t publicly release its algorithms, at the time of my experiment I observed that the more popular profiles come up higher in search results, allowing one to get a quick-and-dirty ranking of who’s hot (or not). I quickly realized that the popular women seemed to know something I didn’t; they were clearly attracting the sort of smart, attractive professionals who had been ignoring my profile. Being hypercompetitive, I wasn’t about to let some bubblegum-popping blonde steal the neurotic Jewish doctor of my mother’s dreams.

Basically, she pulled an OKCupid for herself. It worked.

Jeff Clark took a detailed look at Victor Hugo’s Les Miserables via character mentions, word connections, and word usage. The above is character mentions with color showing sentiment. Red means negative, and blue positive.

Characters are listed from top to bottom in their order of appearance. The horizontal space is segmented into the 5 volumes of the novel. Each volume is subdivided further with a faint line indicating the various books and, finally, small rectangles indicate the chapters within the books. In the 5 volumes there are a total of 48 books and 365 chapters. The height of the small rectangles indicate how frequently that character is mentioned in that particular chapter.

There’s a good amount of blue towards the end, when everyone decides everyone else isn’t so bad.

See the full version and other views here.

The Lotr Project breaks down the thought process in the magical mind.

Run for your lives. The red concentric circles on the green squiggly are headed your way. From The Onion:

[via @civilstat]

By Francisco Javier Aragón Artacho, “This is a walk made out of the first 100 billion digits of pi in base 4 with the following rules for the steps: 0 right, 1 up, 2 left, 3 down.” [via]

I made a graphic a while back that showed traffic fatalities over a year. John Nelson extended on that, pulling five years of data and subsetting by some factors: alcohol, weather, and if a pedestrian was involved. And he aggregated by time of day and day of week instead of calendar dates.
Read More

The Chronicle of Higher Education has a look at the percentage of academic papers published by women, over the past five centuries.

The articles and authors described in this data were drawn from the corpus of JSTOR, a digital archive of scholarly papers, by researchers at the Eigenfactor Project at the University of Washington. About two million articles, representing 1765 fields and sub-fields, were examined, spanning a period from 1665 to 2011. The data are presented here for three time periods, the latest one ending in 2010, and a view that combines all periods.

Percentage of female authors is on the horizontal, and each bubble is a subfield sized by total number of authors. The graphic starts with publishing for all years, but be sure to click on the tabs for each time span to see changes.

The data is based on the archive of about two million articles from JSTOR, and a hierarchical map equation method is used to determine subfields.

The gender classification they used for names seems like it could be nifty for some applications. Gender is inferred by comparing names against the ones kept by the U.S. Social Security Administration, which includes gender. If a name was used for female at least 95 percent of the time, it was classified as a female name, and the same was done with male. Anything ambiguous was not included in the study.

From the 1932 Atlas of the Historical Geography of the United States, these maps paint the picture of transportation in the 1800s. Each line represents how far one could travel in some amount of time, starting from New York. For example, it took about a month to get to Louisiana.
Read More

Below the Boat produces beautiful laser-cut wood maps:

Starting with a bathymetric chart (the underwater equivalent of a topographic map), the contours are laser-cut into sheets of Baltic birch and glued together to create a powerful visual depth. Select layers are hand-colored blue so it’s easy to discern land from water, major byways are etched into the land, the whole thing’s framed in a custom, solid-wood frame and protected seamlessly with a sheet of durable, ultra-transparent Plexiglas.

They should go all the way with it and do “above sea level.” [via kottke]