Entries Tagged 'tech' ↓

Google Voice, which lets users consolidate all their phones under one number, archive your texts and voicemails, and much, much more, is two things to most people: vaguely promising, and totally confusing. Here’s how to make the switch, in plain English.

The Pitch

It doesn’t really help to describe Google Voice in terms of what it is—a bizarrely fragmented hodgepodge of different telecom and internet technologies, drawn together by Google—so you just have to start with what it does. In short, it can completely change how you use your phones, more or less for free.

• It can give all of your phones the same number for incoming calls. Google will assigned you a new, Google Voice-specific phone number for free, which you can forward to as many phones as you want. What always drives the point of Google Voice home for people is when I have them call my number, which causes three of my phones to ring at once. You can keep this number forever, too, without ever having to worry about porting it from carrier to carrier.
• It can give your phones the same outgoing number as well, with which you can make free domestic calls (well, sort of—more on that later), and very cheap international calls. Since Google Voice routes your calls through their phone system, they can connect you directly to cheap VoIP services to the rest of the world. It seems like you're just making a regular call, but behind the scenes you're doing something more akin to Skyping. End result: money saved.
• You can send and receive unlimited text messages for free. To make things even better, they’re all all archived in your online Google Voice account, where they’re fully searchable.
• It's got the best voicemail system in the world. Leaving a message at a Google Voice number is nothing like leaving your voice on a regular voicemail service—that is to say, it's not like sending your voice into a barely accessible technological horror pit where it might get listened to, but will probably be ignored. No, Google Voice is different: It stores your messages online, and converts them to text (which can then be sent to you as an SMS or an email). You can archive, forward, delete or save these messages from a simple interface on your phone or computer. Think of it as Gmail, except with voices. Plus, it's flexible in lots of little ways—you can change your voicemail greetings on a per caller basis, for example, or opt to listen to voicemails as they're being recorded.
• This voicemail system isn't just for Google Voice numbers, either—you essentially replace your carrier voicemail with Google Voice voicemail, without using a new number. It's brilliant.
• You have full control over your calls. You can record them for later listening, and have them transcribed into text.
• You can screen callers. You can block numbers, or have callers record their names for your approval. You can have certain contacts only forwarded to certain phones,

Each of these features is compelling enough on its own—together, they'll totally change how you use your phones, changing you from a mere mobile customer to a full-on switchboard operator, self-spy, info hoarder and telco executive. It's like you run your own little phone company, just for yourself. For free. Spectacular.

The Catch(es)

Now that I’ve got you all riled, it’s time for me to pour an icy bucket of water down the front of your pants. Google Voice, as incredible a concept and service as it is, isn’t perfect. In fact, there are a few things you need to know and accept before taking the dive, and they might be dealbreakers:

• You can't use your own phone number. At least, not in the way you wish you could. In an ideal world, you'd be able to port your old cellphone number to Google Voice, and have that—the digits people have been using to get in touch with you for years—be your new all-inclusive point of contact. You can't do this yet. For now, the closest you can come is to port your voicemail to Google Voice. That means that your T-Mobile, AT&T, Verizon or Sprint number's voicemail can be outsourced to Google, but not its calls. You can unify all your phones under your new Google Voice number, but that means you have to switch. Along with the basic inconvenience of telling everyone about your new number, you’re trusting an awful lot in a beta service, the terms of which could change quickly and without notice. It’s not something I worry about, but it’s not nothing, either.

• You can’t record calls that you’ve placed, just calls that you’ve received. And every time you initiate recording, Google Voice notifies the other person on the line. This is all makes perfect moral and procedural sense, but just in case you had the impression that there were no limits on your recording abilities, well, there are.

• The mobile app situation isn't ideal. There are apps for Android, BlackBerry, Windows Mobile and iPhone via jailbreak, and they all work. That said, they're not perfect—they can be slow, poorly integrated, glitchy, or hard to figure out. And since they're supposed to replace the dialer on your phone entirely, this isn't wonderful. The online mobile interface is a good fallback for placing calls and sending texts, but navigating to that adds an extra step to any call or text that can get tiresome after a while.

• Lastly, the way American phones work, you’re still going to end up paying for your minutes, somehow. Just because Google Voice says you can make free domestic calls and cheap international calls doesn’t mean that you actually can: in both cases, you need to dial out to Google Voice’s external system in the first place, which means you’re still using your monthly minute allotment. There are ways around this which I’ll discuss later, but Google Voice, as good as it is, isn’t magic.

Discouraged? Don’t be. Google Voice is still well worth you time and effort, and it’s only going to get better. Now, for God’s sake let’s get started already.

The Process

Signing up. This is simultaneously the easiest and most irritating part of Google Voice: It’s still invite only. Lucky for you, “Invite” in this case doesn’t mean you actually have to wait for an individual to select you from the masses; it’s just Google’s way of saying their keeping the signup pace down at manageable levels while the service is still in beta. Just submit your address, after which Google “anticipate[s] that it will be a short wait before you receive your invitation.”

What's a short wait? My invite took about four days. Some come within 48 hours. At worst, they take about two weeks. Lots of you will have already received your invite, and just not done a whole lot with it—you guys can keep reading—while the rest of you should just bookmark this post, and come back to it once you get your invite. Protip: check your spam filters.

—

Ok, hello again, people I was talking to anywhere between two seconds and two weeks ago! How are you? Now that you’ve got your invite, you can log in to your Google Voice Dashboard. It’ll look familiar if you’ve used any Google Service before:

Logging in. Follow your confirmation link, or navigate here. Click around for a while to get a feel for the interface. This is how you’ll manage your phones from now on. It’s liberatingly simple.

Picking your number. You’ll be given a choice of numbers, which you can choose from practically any available area code. Choose wisely: this will be your primary number from here on out. Choosing your first number is free; changing it in the future will cost you $10. Boo, waah, etcetera! But really not a huge deal.

Adding your phones. This is assuming you want to forward a single number to all your phones, which is kind of the point here, so: Go to the Google Voice settings page (up in the upper right-hand corner of the screen. In the first section, called “Phones,” click “Add a Phone” or “Add Another Phone.” Give it a name “My iPhone” and enter its phone number. That’s it.

Now you’ll be given a passcode, which you’ll use to authenticate your existing phone. Clicking “Connect” will call your phone from your Google Voice number, and a friendly robot will ask for you code. Enter it. That’s it!

Setting up your voicemail. Now that the phone is added, it can accept calls directed to your Google Voice number. If the call is ignored, it will forward the voicemail to Google Voice, where it will be stored online. Alternately, if you only want to use Google Voice for voicemail, you can disable the calling feature (by unchecking the box next to the phone), and set up the service to hijack your actual cellphone number’s voicemails—even when the call didn't get routed through Google Voice.

This is much easier that it sounds: Just click “Activate Google Voicemail” next to your newly-added phone, and enter the number they give you exactly as it’s written, symbols and all. Once you “call” that number, you’ll get some kind of message on your phone. On the iPhone, it looks like this.

Your voicemail has been switched—all you need to do now is set up a quick bookmark in your mobile phone to Google Voice, which provides a functional, if sparse, interface for your Google Voice messages. It's like visual voicemail, except through your browser. (Or a mobile app, which I'll get to soon.)

Choosing the rest of your settings. Now you’ll see your phone listed under the “Phones” settings tab. The other tabs contain a few pages of settings for your Google Voice account. How you toggle these is up to you, but here are the most important ones: If you want to forward SMSes to email, you’ll have to enable that in the “Voicemail and SMS” tab; call screening settings are located under the “Calls” tab; and international call credit can be added under the “Billing” tab, from a credit card.

Finding your feet. Take some time to experiment with some of Google Voice's core features now. Place a call using the button at the top left of the Google Voice homepage. Enter your recipient's number, and choose which of your phones you'd like to place the call with. Google Voice will call your phone first, which upon answering will immediately call your recipient's phone, which will think it's getting a call from your new Google Voice number. It might sound odd in writing, but once you see it work, it just kind of clicks. You can also place these calls from the mobile web interface, without a computer. Texting is more direct—you can send those directly from the web interface without any intervention from your phone.

Placing calls. The aforementioned methods is the most obvious, and it will reliably work. It’s a little cumbersome, especially if you’re used to just tapping on a contact and placing a call. Thankfully there are a few more ways to place calls from your phone, and have it routed through Google Voice:

• Apps: This is by far the best way to use Google Voice. Android has an official Google Voice app, as does BlackBerry.These automate the dialing/texting out process, so you don't need to mess with a web interface—you just opt to make some or all of your calls through Google Voice, and the app takes care of the rest. Windows Mobile has unofficial clients that do the job pretty well, as does the Pre, in the App Catalog. iPhone clients are available, but they’re not approved by Apple: You’ll need to jailbreak your phone and install them from Cydia.

• The call-in method: Simply dial your new Google Voice number from your cellphone or landline, press 2 once it’s connected, then enter the number you want to dial. This is less convenient than the web interface method, even, but it’s vital to the next one:

• The contact method: This is a little cheat to automate the aforementioned process. What you’re doing, basically, is saving your Google Voice number, a pause, the number 2 (which selects “call another phone” from the Google Voice automated menu tree), a pause, then your recipient’s number.

Adding a pause is different on each phone—on the iPhone, for example, you need to save a number as a contact, and in the number editing screen, press the "+*#" button at the bottom left of the keypad. The zero will be replaced with a "pause" button, which when pressed inserts a comma into the number. Google is your friend for this one, though most smartphones make the option available in their respective contact editing screens.

• The 406 method: Have the person you want to text send a message to your Google Voice account. When you receive the message, it will be from a number you don't recognize, with the area code 406. It will be labeled with the sending contact's name, and any replies to that number will return to the person who sent them, but the number is completely new. This is a Google Voice alias, which you can use forever: Just save it as part of your friend's contacts—perhaps as a secondary cellphone or a work number, whatever you can remember—and use it as their primary contact number when call through GV.

Sending Texts. Again, using the web interface is a great way to send texts, as are the mobile apps. But the best solution? The 406 trick listed above works for SMSes too.

The Hacks

As you've probably noticed, Google Voice is kind of a loose system—and a system that's ripe for a little gaming. There are two methods that currently work for getting truly unlimited, free calls over Google Voice. This is where things get really interesting. Interesting in a good way for you; interesting in a terrifying way for the phone companies.

• The Calling Circle Method: You know how some carriers let you designate a few contacts that don't count toward your monthly allotment of minutes, like T-Mobile MyFaves, or the AT&T A-List? By making your Google Voice number one of your friends, you can filter all your calls through Google, whether they be free domestic calls or cheap international calls. Once your Google number is added to your circle, making free calls is simply a matter of dialing into your Google Voice number and, using Google's audio menu system, dialing through to your recipient. (The contact method listed above will work too.)

To make incoming calls—including outgoing calls initiated from the Google Voice web interface—free, you'll need to change your Google Voice settings under the "Calls" tab. Select "Display my Google Voice Number" under the "Caller ID (in)" setting, and you're good to go. A full setup guide for the calling circle method can be found here.

Note: Designating Google Voice as one of your preferred contacts may be against your carrier's user policies—check with them if you're concerned.

• The VoIP method: By signing up for a number with free VoIP service Gizmo5 and adding to to your Google Voice account as a phone, you can place unlimited free calls from your VoIP number to landlines. You can also forward the calls through to Skype, if you’d prefer. This isn’t a solution for mobile phones, but it’s a great way to make yourself an effectively unlimited VoIP landline for free. Lifehacker’s got the whole rundown here. UPDATE: Registrations for Gizmo5 have been closed. Sorry!

Easing the Transition

Lifehacker has assembled a fantastic guide for easing the transition from many numbers to one, covering everything from how to convince people not to call your old numbers, to coping with voice latency.

That’s pretty much it! If you have any tips to tricks for getting the most out fo Google Voice, please drop some links in the comments-your feedback is hugely important to our Saturday How To guides.

And if you have any topics you’d like to see covered here, please let me know. Happy Voicing, folks!

It’s called ProFORMA, or Probabilistic Feature-based On-line Rapid Model Acquisition, but it is way cooler than it sounds. The software, written by a team headed by Qui Pan, a student at the Department of Engineering at Cambridge University in England, turns a regular, cheap webcam into a 3D scanner.

Normally, scanning in 3D requires purpose-made gear and time. ProFORMA lets you rotate any object in front of the camera and it scans it in real time, building a fully 3D texture mapped model as fast as you can turn an object. Even more impressive is what happens after the scan: The camera continues to track the objsct in space and matches it’s movement instantly with the on-screen model. Here’s a video of it in action:

It works by generating a 3D point cloud from the image coming through the camera and then uses some clever math to both ignore the occasional occlusion of the model by a hand and to work out where the surfaces are. Then things go over my head, involving a process called Delaunay tetrahedralisation to turn the 2D surfaces into a 3D model.

Like I said: clever math. But imagine, for a second, the uses. Forget Nintendo’s Mii avatars, for instance. Instead you could make a 3D version of yourself, or add your favorite household items into a game of Mario Kart. You could quite possibly hook this rig up to a 3D printer and make fast facsimiles of almost anything. And remember, this is all done using a single camera, just like the one that’s probably staring from the top of your laptop screen as you read this. I want to play with this right now.

ProFORMA product page [Cambridge University via Core77 via BoingBoing]

The first and last time I’ll cut and paste a press release on this blog. Casey Reas writes:

We’ve just posted Processing 1.0 at http://processing.org/download. We’re so excited about it, we even took time to write a press release.

CAMBRIDGE, Mass. and LOS ANGELES, Calif. – November 24, 2008 – The Processing project today announced the immediate availability of the Processing 1.0 product family, the highly anticipated release of industry-leading design and development software for virtually every creative workflow. Delivering radical breakthroughs in workflow efficiency – and packed with hundreds of innovative, time-saving features – the new Processing 1.0 product line advances the creative process across print, Web, interactive, film, video and mobile.

Whups! That’s not the right one. Here we go:

Today, on November 24, 2008, we launch the 1.0 version of the Processing software. Processing is a programming language, development environment, and online community that since 2001 has promoted software literacy within the visual arts. Initially created to serve as a software sketchbook and to teach fundamentals of computer programming within a visual context, Processing quickly developed into a tool for creating finished professional work as well.

Processing is a free, open source alternative to proprietary software tools with expensive licenses, making it accessible to schools and individual students. Its open source status encourages the community participation and collaboration that is vital to Processing’s growth. Contributors share programs, contribute code, answer questions in the discussion forum, and build libraries to extend the possibilities of the software. The Processing community has written over seventy libraries to facilitate computer vision, data visualization, music, networking, and electronics.

Students at hundreds of schools around the world use Processing for classes ranging from middle school math education to undergraduate programming courses to graduate fine arts studios.

+ At New York University’s graduate ITP program, Processing is taught alongside its sister project Arduino and PHP as part of the foundation course for 100 incoming students each year.

+ At UCLA, undergraduates in the Design | Media Arts program use Processing to learn the concepts and skills needed to imagine the next generation of web sites and video games.

+ At Lincoln Public Schools in Nebraska and the Phoenix Country Day School in Arizona, middle school teachers are experimenting with Processing to supplement traditional algebra and geometry classes.

Tens of thousands of companies, artists, designers, architects, and researchers use Processing to create an incredibly diverse range of projects.

+ Design firms such as Motion Theory provide motion graphics created with Processing for the TV commercials of companies like Nike, Budweiser, and Hewlett-Packard.

+ Bands such as R.E.M., Radiohead, and Modest Mouse have featured animation created with Processing in their music videos.

+ Publications such as the journal Nature, the New York Times, Seed, and Communications of the ACM have commissioned information graphics created with Processing.

+ The artist group HeHe used Processing to produce their award-winning Nuage Vert installation, a large-scale public visualization of pollution levels in Helsinki.

+ The University of Washington’s Applied Physics Lab used Processing to create a visualization of a coastal marine ecosystem as a part of the NSF RISE project.

+ The Armstrong Institute for Interactive Media Studies at Miami University uses Processing to build visualization tools and analyze text for digital humanities research.

The Processing software runs on the Mac, Windows, and GNU/Linux platforms. With the click of a button, it exports applets for the Web or standalone applications for Mac, Windows, and GNU/Linux. Graphics from Processing programs may also be exported as PDF, DXF, or TIFF files and many other file formats. Future Processing releases will focus on faster 3D graphics, better video playback and capture, and enhancing the development environment. Some experimental versions of Processing have been adapted to other languages such as JavaScript, ActionScript, Ruby, Python, and Scala; other adaptations bring Processing to platforms like the OpenMoko, iPhone, and OLPC XO-1.

Processing was founded by Ben Fry and Casey Reas in 2001 while both were John Maeda’s students at the MIT Media Lab. Further development has taken place at the Interaction Design Institute Ivrea, Carnegie Mellon University, and the UCLA, where Reas is chair of the Department of Design | Media Arts. Miami University, Oblong Industries, and the Rockefeller Foundation have generously contributed funding to the project.

The Cooper-Hewitt National Design Museum (a Smithsonian Institution) included Processing in its National Design Triennial. Works created with Processing were featured prominently in the Design and the Elastic Mind show at the Museum of Modern Art. Numerous design magazines, including Print, Eye, and Creativity, have highlighted the software.

For their work on Processing, Fry and Reas received the 2008 Muriel Cooper Prize from the Design Management Institute. The Processing community was awarded the 2005 Prix Ars Electronica Golden Nica award and the 2005 Interactive Design Prize from the Tokyo Type Director’s Club.

The Processing website (www.processing.org) includes tutorials, exhibitions, interviews, a complete reference, and hundreds of software examples. The Discourse forum hosts continuous community discussions and dialog with the developers.

Extremely well done and congratulations to all involved!

Hoover’s, the business information company, has released their own Hoover’s API, aka “HAPI”. This new API enables developers to create applications that utilize Hoover’s database of 27 million companies and 34 million business executives (details at our Hoover’s API profile). This is certainly useful data for a variety of enterprise applications.

Hoover’s VP of Business Development Heidi Tucker gave a presentation titled “Hoover’s – API Strategy – Open Access to Business Intelligence” at Mashery’s recent Business of APIs Conference in San Francisco, CA. Heidi highlighted several current implementations of the Hoover’s API:

• CRM application with “company look up and list build” and “data enrichment upsell”
• Address verification: Shipping department checks address info against Hoover’s to reduce bad address non-deliverables
• Outbound telemarketing: Hoover’s info populates predictive dialer contact info
• Web analytics publisher: Users see traffic and corresponding basic business information

Interestingly Heidi outlined some of the risks involved in opening up this valuable data via an API

• Keys to the Kingdom
• Search Results Relevancy
• Scalability
• Cannibalization
• Brand Compliance
• Reputational Risk
• Pricing

Technically, the Hoover’s API is SOAP-based with data returned in XML. There is a free testing API key; production API keys are available for a fee. Pricing of the API can be done as: per user per month; per API call; or flat content license fee.

The API is well-documented. The WSDL is available for review, and the development team provides sample code for .NET, Java, and PHP developers. The Hoover’s API Developer Blog and Hoover’s API Forums are available.

As more and more of this class of valuable business data becomes available via open APIs we should expect to see new interesting enterprise mashups appearing soon.

Share This

Sometimes you stumble across something that really makes you say “wow” and reminds you that there’s so much more to this internet thing than just the latest web app. Case in point is this article describing some of the visual resources available on the web. The deep web. These images won’t show up in search engines’ image searches or on Flickr (save one exception), but instead can only be accessed via the links below.

The images are a part of online collections created by institutions in the U.S. Some of the images may be a part of the public domain, but many will require permission or accreditation in order to use. So, no, these aren’t necessarily images you can use in your next blog post, but that doesn’t mean they’re not useful. Instead, if given permission, these images could be used in the classroom, in private study, or even included in a media project or publication.

Collaborative digital collections

• Alabama Mosaic: Thousands images that can be searched by keyword. Images are from historical collections featureubg content from libraries, archives and museums from across Alabama.
• Alaska Digital Archives: More than 5,000 quality digital images of Alaska’s heritage in a searchable online database.
• Calisphere: A free online collection of more than 150,000 digitized primary materials contributed by libraries, archives, and museums from all over California. Search for content by keyword, by browsing the alphabetized subject list and exploring theme collections, such as the Gold Rush Era and World War II. Lesson plans are also available for elementary and secondary schoolteachers.

Calisphere

• Library of Congress American History and Culture Collections:  These collections began as a pilot project in 1990 to provide middle school as well as high school teachers and students with digital surrogates of collection material on CD-ROM. Over the years, the collection has become a "National Digital Library" with diverse institutions from all across the United States contributing content. Search or browse alphabetized subject lists, time periods, and geographical locations. American Memory Historical Collections features more than 100 thematic subjects ranging from advertising to maps to women's rights.
• Library of Congress International Collections: Access content from American Memory Historical Collections as well as international visual resource collections, such as the Abdul Hamid II collection of photographs of the Ottoman Empire and the Prokudin-Gorskii collection of photographs of the Russian Empire. Additionally, through partnerships with national libraries in other countries, you can access collections that highlight the history of the United States in relation to other nations, such as “France in America” and “The Meeting of Frontiers: Siberia, Alaska and the American West.”
• University of Washington Digital Collections: Access to tens of thousands of digital images covering a wide variety of subjects, but with an emphasis on the Pacific Northwest. The digital collections include image-heavy resources, such as the J. Willis Sayre Photographs of actors, vaudeville performers, and movie stills; the Washington Women’s History Consortium Fashion Plate Collection; the Dearborn-Massar Photographs of Architecture; and the Seattle Photographs Collection.
• Photomuse: A research resource for the history of photography. Features online exhibitions, a chronology of the evolution of photography complete with visuals and historical information, as well as an image database.

Photomuse

University digital image collections

• Duke Digital Collections: Featured collections are freely available on the Internet and include the Emergence of Advertising in America, Ration Coupons on the Home Front (1942-1945), and the 50,000 item William Gedney Photographs and Writings collection.
• Yale University Library Digital Collections: More than 100,000 digital images are searchable and viewable by the public.
• Harvard University Library: A Selection of Web-Accessible Collections: A list of visual resource collections that are unique to Harvard University, but reside in different repositories on the Harvard campus. Collections include the Harvard Daguerreotype Collection, the Hedda Morrison Photographs of China, Immigration to the United States (1789-1930), Legal Portraits Online, and the Latin American Pamphlet Digital Collection.

Harvard

Digital image collections at public libraries and archives

• Historical Photograph Collections at the Arizona State Archives: 33,000 digital images of primary materials from the historical photograph collections. Most of the photographs available through the public online database date to before 1940 and include examples of all types of photographic processes, including tintypes, glass lantern slides, and photographic postcards.
• Library of Congress Prints and Photographs Online Catalog: Get access to more than 1 million digital images via one of the largest digital image databases in the world. Search for images by keyword, by browsing lists of alphabetized subjects, or by choosing a collection and looking through individual image records.
• Los Angeles Public Library: More than 60,000 images featuring the work of many notable photographers active in the Los Angeles area over many decades, including some contemporary photographers. Search by keyword or photographer.
• New York Public Library Digital Gallery: One of the largest open-access image databases available on the Internet featuring more than 600,000 digital images, including all kinds of primary materials, such as manuscripts, maps, photographs, prints, restaurant menus, sheet music covers, and much more.

NY Public Library

Digital image collections at historical societies

• Indiana Historical Society: An extensive collection, covering topics ranging from architecture to railroads to sporting events.
• Wisconsin Historical Society: A visual resource for Wisconsin history containing 35,000 photographs. Of special interest is the Wisconsin Historical Museum’s Children’s Clothing Collection where visitors may browse images of more than 2,000 articles of children’s clothing dating back to the 18th century.

Other

• Institute of Museum and Library Services (IMLS): Through this database, it is also possible to carry out federated searching across the hundreds of digital collections that received support from IMLS. Adding “image” to the keyword search will retrieve digital images and their corresponding metadata.
• OK, not exactly “deep web,” but you can’t leave this one out. The Library of Congress Photostream on Flickr: More than 3,000 images on Flickr. The Library of Congress is the flagship partner for the site’s project known as The Commons, which aims to increase exposure to public image collections housed at civic institutions around the world and to facilitate knowledge about the collections.

Library of Congress

You can learn more about the history of these collections and get details on how to search them from the article here.

Today marks another milestone for San Francisco based contextual search engine Powerset. They’ve launched a showcase for their user search experience – effectively the search engine minus the web crawl. For now, Powerset queries only Wikipedia and augments results with data from Freebase. The product launch comes just a day after reports that the company is being shopped to potential buyers by investment bank Allen & Co.

I have been able to test Powerset via their labs site for the last few weeks. I wrote about it last month, and the version that just launched is very similar.

There is no way to look at Powerset today and determine if it can be as disruptive to search as Google was when it launched almost a decade ago. That’s because it only queries Wikipedia, and so there is little need for proper ranking algorithms to sort the good from the bad results.

But what user can see is how effective a way it is to gather information quickly. For someone doing research, Powerset effectively removes a number of steps towards getting to the final information. It is particularly effective when the information needed is on many different web pages.

For example, a query on Powerset of “when did earthquakes hit tokyo” yields stunning results. Try this query at Google or even wikipedia to compare – instead of just picking out keywords that are in your query and on a web page, Powerset is actually making some sense of the content included in the wikipedia pages:

The way that Powerset returns queries means that answers are often found in the result snips, as above. They are also structuring a lot of the Wikipedia and (and already structured Freebase) data and inserting it into results. So a search for “Bill Clinton” shows results, but also shows Freebase structured data along with additional query refinements to get to more information. The important thing below isn’t the structured data in the results, its the fact that you can click on the action words and drill down into very specific queries (to find, for example, what bills he signed, or which Supreme Court justices he nominated, or who he slept with).

Powerset is indexing web pages much differently than normal search engines, which generally just record content to match against keyword queries. Instead, Powerset is trying to understand the content on the page so that it can be matched meaningfully to queries later. Even queries that don’t use matching words.

Indexing the web is expensive, though, and Powerset’s way of doing it requires even more time and computing power dedicated to a web page. That’s why they say they aren’t indexing the entire web yet – the company has raised just $12.5 million (plus another $8 million or so in bridge loans from investors). To index the web will require a new round of financing (see the first paragraph above about their sale/financing efforts).

Powerset is has taken a lot of criticism for their goal of trying to redefine how people search the web (including from us). But their lofty goals are what makes Silicon Valley so great – succeed or fail, Powerset is trying to do something pretty spectacular.

The company has also created a demo overview video – see below.

Crunch Network: CrunchGear drool over the sexiest new gadgets and hardware.

ZeroTurnaround has announced the final release of JavaRebel 1.1. JavaRebel is a JVM plugin (-javaagent) that enables reloading changes made to Java class files on-the-fly, saving developers the time that it takes to redeploy an application or perform a container restart. In addition to changes like the provision for dynamic proxies, full SDK availability, and full class reloading, ZeroTurnaround is offering a free license for bug reports.

As the national library of the United States, the Library of Congress has created vast amounts of metadata to describe books and other documents in its collection. Among this metadata is the Library of Congress Subject Headings (LCSH), a “controlled vocabulary” for classifying documents by subject. In order words, experts at the Library of Congress have come up with a (large) list of subject headers from which catalogers of documents can choose. As an example, if you look at the Library of Congress record for Tim Berners-Lee’s book Weaving the Web, you’ll that it is classified under “World Wide Web“, specifically “World Wide Web–History“.

Since the Library of Congress isn’t the only entity that classifies documents, you can imagine that other entities (and not just libraries) would interested in reusing the LCSH vocabulary. But how should the Library of Congress make LCSH available so that it can be easily reused?

That’s where the recent release of lcsh.info comes in (see also the lcsh.info ProgrammableWeb Profile):

This is an experimental service that makes the Library of Congress Subject Headings available as linked-data using the SKOS vocabulary. The goal of lcsh.info is to encourage experimentation and use of LCSH on the web with the hopes of informing a similar effort at the Library of Congress to make a continually updated version available. More information about the Linked Data effort can be found on the W3C Wiki.

Let’s look at what you can do with lcsh.info through a couple of examples. First, we return to the subject heading World Wide Web, this time accessible from lcsh.info as

http://lcsh.info/sh95000541

Note the form of the URL: http://lcsh.info/{lccn} where lccn refers to the Library of Congress Control Number (LCCN), an identifier of the subject heading. In this case, the LCCN for World Wide Web is sh95000541.

If you drop this URL into your browser, you’ll get the default format or representation of the information lcsh.info has about the World Wide Web subject header, including:

• broader terms (e.g., Hypertext systems)
• narrower terms (e.g., Semantic Web)
• related terms (e.g., Internet)
• alternative label — (e.g, W3 (World Wide Web))

The diagram below illustrates some of these relationships

To facilitate reuse of the data, lcsh.info offers its data a variety of formats that can be accessed via content negotiation. That is, you use the Accept HTTP header to specify which of the following content type you want:

• XHTML (with embedded RDFa), which is the default value (application/xhtml+xml)
• JSON (application/json)
• RDF/XML (application/rdf+xml)
• N3 (text/n3)

For example, you can use curl to get JSON representation of the World Wide Web subject header:

curl -v -L -H “Accept: application/json” http://lcsh.info/sh85062913

By looking at the RDF/XML and N3 representations, you can see a concrete example of semantic web approaches to express notions of broader, narrower, and related terms as well as alternative labels using

• Simple Knowledge Organization System (SKOS), which is “a model for expressing the basic structure and content of concept schemes such as thesauri, classification schemes, subject heading lists, taxonomies, folksonomies, and other types of controlled vocabulary”
• designs rules for linked data to represent the network of interconnected subject headings

This experimental but promising service may soon pave the way for full production level web services from the Library of Congress.

Share This

Developers today are constantly creating applications that consume services of other web sites. Consuming these services requires figuring out and understanding the sometimes complex Application Programming Interfaces (APIs). By Robert Bazinet

Today, a story on Techmeme caught our eye. It was entitled "We Need a Wikipedia for data," and the article, written by X-Googler Bret Taylor, discussed the difficulty of finding open data sets on the internet, something which could spur innovation, allowing programmers to build new applications the likes of which have never been seen before. What was interesting about this story, in addition to, obviously, the concept of a Data Wiki itself, was the amazing and insightful commentary around this concept, not just on the blog, but all over the net, something which led to the discovery of some pretty good data sources that are already available.

In Bret’s story, he mentioned some of the common data sources currently available, like the US Census Bureau’s map data and the Reuters corpus, but his commenters came up with a few more. (See? This is why blog comments matter).

In addition, as CNet and Ryan Stewart’s blog spread the story, more people chimed in with suggestions. And of course, the Hacker News guys had some more ideas themselves.

So what did everyone come up with? A lot of data sources are already freely available on the net, as it turns out, if you just know where to look. Here’s a summary, do you have anything to add?

CKAN (Comprehensive Knowledge Archive Network)

The CKAN site is a registry of open knowledge packages and projects. Here, you can find open knowledge resources or register one of your own. What kind of stuff can you find at CKAN? They mention a set of Shakespeare’s works, a global population density database, the voting records of MPs, or 30 years of US patents as some examples, but they also point you to some useful URLs, like flickr’s Creative Commons page, where photos can be searched by license type.

CKAN

Infochimps.org

This project is attempting to assemble and interconnect the world’s best repository for raw data – like a giant, free, open almanac. The best way to describe it comes from MetaFilter, where the project was spotted recently: "Just as Wikipedia will help you find out something about everything, infochimps.org will help you find out everything about something." What can you find there? Every wikipedia infobox, each infobox type in its own table, 50 years of global hourly weather data, all the tables from the US Census Statistical Abstract, oh and 100,000 official crossword words, too.

Infochimps.org

OpenStreetMap

Not a data set in the traditional sense, but definitely a useful tool, OpenStreetMap is a free, editable map of the world where you can view, edit, and use your own geographical data. The project was started because most maps actually have legal or technical restrictions on their use.

OpenStreetMap

MusicBrainz

A user-maintained community metadatabase site which collects music "metadata" like artist name, release title, list of tracks, etc. You can browse through the site or you can use a client program, like their own taggers, to help identify music collections. 

Musicbrainz

Jigsaw

Dismissed by the blogosphere as a bad idea, if not downright evil, Jigsaw, the marketplace that pays you to give up other people’s contact info now boasts 7 million complete contacts for the taking.

DBpedia

This site is a community effort to extract structured info from Wikipedia and make that data publicly available on the web, essentially turning Wikipedia into a database you can query. Is this the beginnings of a semantic web? Check out their downloads section for the datasets and then scroll to the bottom for even more links to data sources on the web.

DBpedia

flickr wrappr

Where DBpedia takes Wikipedia and makes it semantic, flickr wrappr extends DBpedia with RDF links to photos posted on flickr. Here’s an example. Here’s another. This is pure geek hotness.

Freebase

Freebase, an open, shared database of the world’s knowledge, received a lot of mentions in the comments, so this must be a good one. Community built and maintained, it pulls from open data sources like Wikipedia, MusicBrainz, and the SEC archives to create structured information on many topics, including more popular ones like movies, music, people, and locations. The site, unlike some of the others in this list, is also easy to navigate and well-designed, which makes it that much better to use.

Freebase

Opentick

Perhaps one of the less interesting items due to its dry subject matter – financial data – it’s certainly worth a mention because a free database of real-time and historical market data for trading systems and platforms is the kind of thing that really floats some people’s boats.

ThingISBN

Thanks to LibraryThing, ThingISBN is the site’s first API, and even though its competitor became a paid service, ThingISBN is still free for non-commercial use. The API doesn't just return the usual book data, but also something called "edition disambiguation," meaning it also returns a list of "related" ISBNs—other editions, other media, and translations.

Numbrary

Like the title suggests, Numbrary is a library for numbers. This free service helps you find, use, and share numbers from public record data sets, like census data or the CIA World Factbook.

Numbrary

theinfo.org

This site isn’t just a place to build or collect data sets, of which they have quite a nice list, but a place where you can interact with other number-lovin’ folks like yourself.

theinfo.org

The Data Wrangling blog

This blog post lists a bunch, and I mean a bunch, of open datasets on the web, which just goes to show how much of a cursory list my post really is.