AADL.org upgrades to Drupal 4.7

A little over a year after launch, AADL's Drupal-powered site has been upgraded to 4.7 from 4.6. Those familiar with Drupal's release schedule and changelog will know that this is a substantial upgrade that puts us in a good position to be ready for the touted and forthcoming 5.0 release (for which there is now a code freeze).

Drupal 4.7 sports a number of great new features. I'm most excited about the new search engine which does a much better job of indexing the site and allows users to do an advanced search. Searches now actually return meaningful results. Other features include a new Ajax-enabled content creation system with nifty improvements such as re-sizable text fields, collapsible elements, a file upload system that doesn't require authors to leave their work, and live menu updates. On the development side, these new features are accessible via the new form-handling system. In other words, coders can easily incorporate these new Ajax elements in their own work. Theme developers will be happy with the ability to create an infinite number of regions--nice to achieve that highly-polished CSS look. I think a couple new block types were added as well.

Another great feature is the wiki-style revision system that allows editors to roll-back their work and leave editorial log messages (a very useful feature in large, collaborative environments). Commenting benefits, as well, with the ability of site administrators to manage and moderate multiple entries at once. Finally, Drupal 4.7 supports free tagging. Not something we're using at this point, but, from my point of view, it means that the engine is there for future module work. I have a feeling I'll be using those hooks for some forthcoming feature upgrades on the website itself...

The upgrade was fairly smooth. Drupal ships with an update script which ran flawlessly, but that's the easy part. A fair amount of prep-work was done ahead of time to ensure that all of our custom modules were 4.7-compatible. Basically, this meant updating all of our form-handling code to handle the new system. We also segregated all of our own code and theme information from Drupal's using the multi-site capability. This means that we can easily keep track of our own work without it getting mixed up with the vanilla code-base. This wasn't completely necessary, but it was worth the work because it'll make all future upgrades much easier to do. Doing things this way is also in-line with my philosophy of never touching stock code unless you absolutely have to.

The long and the short of this whole upgrade means that our users will probably not notice a lot of difference, but we're now in a good position to work on AADL 3.2. And that they will notice.

For more info, check out these Drupal videocasts:

[tags] AADL, AADL.ORG, Drupal, CMS, PHP, Library, Web [/tags]

Google Gadget Update & PatREST changes

I've made a little update to two of the PatREST Google gadgets (top and new items)--partly due to the insistance of a certain Superpatron, but mostly because I was planning on doing it anyway.

The new versions allow users to display cover images along with the records. A new option gives you the choice of text only, images only, or images and text. Not a major change, but noteworthy. Also, in case you missed the update in my previous post, the new items gadget can now match subject headings--useful if you want to be notified about new items on a particular topic.

For the purposes of the Talis mashup competition (for the judges), the original xml files are still available under a different name (tops-v1.xml and new-v1.xml). Everyone else, here are the new ones:

(FYI, it's the same URL as the previous version. If you've already added it to your Google page, the update will be automatic)

While working on this little project, I became painfully aware of PatREST's limitations when dealing with asynchronous execution -- like that of Google gadgets. I previously thought it would be better to limit the amount of data returned in an XML hit-list and use a second record query for and detailed info. I think I may have been a little short-sighted. At any rate, the lesson learned is that the more practical experience I have with PatREST, the more I'll know what works and what doesn't.

The upshot of all this is that I've expanded the result objects in any PatREST function that returns multiple records to include more information, such as ISBN, cover image, author, and record link. For those asynchronous folks, this will make life a lot easier. The new additions have been added to an updated specification. Existing PatREST applications (I don't think there are many at this point) will continue to work, of course.

PatREST Enhancements & Documentation

A couple of notes regarding the status of PatREST.

First, two new functions have been added to the service. One provides access to tops (or popular items) lists. The other provides access to the new materials lists. I believe these are significant-enough additions to the service that they merit the 1.1 version number.

The top items query is scalable by result size and can be paginated, just like the search results. In addition, it can be scoped by material type: books, cd, dvd, or bocd (books on CD). When applied to the AADL XSLT, it looks something like this:

The new items query is similar to the top query in that it can be scaled by material type, size and be paginated. You can also search new items using their subject headings--useful for querying those new knitting books, Ed... It looks something like this:

Second, and probably more importantly, I've finally drafted a specification for PatREST which includes an explanation of it's XML schema and some documentation for it's various functions. It's about time, I know. It can be found in the files section, or downloaded here. (PDF)

I'm not going to go in to too much detail about the two new functions in this post because the new documentation contains everything you need to know to get started with them.

OPACs in the frying pan, Vendors in the fire

An interesting week, this was, in the blogosphere as it pertained to vendors, ILSs and OPACs. I'm not sure if the moon is crossing some strange celestial tract or if library bloggers are particularly sensitive to sunspots lately, but a number of people have been putting the screws to their vendors (III, in particular) and a righteous smack-down on their OPACs. At any rate, I've received a lot of linkage to the "ILS Customer Bill of Rights", including some criticism. Enough so that I feel the need to gather these into some sort of usable nebulae...

Vendor's in the hot-seat

June 1 - Touched a Nerve - An account by Nicole Engard of a run-in with some III folks at IUG (Innovative Users Group meeting). Her post seems to be the one that kicked off this particular vendor roast. Essentially, She mentions an incident at this year's Denver IUG in which a III employee expressed displeasure at her post, State of the ILS. I agree with Nicole that it's probably a good thing that III employees are a little upset with some of these assessments. I'll also stand by my comments on Nicole's post--I'm among the first to admit that III can be infuriating to work with and I would not recommend it to any library interested in doing heavy customization. I'd caution all parties, however, to address the problems and not their emotions associated with this hot potato.

June 14 - Attention Innovative: Get a Clue(train)! - Michael Stephens weighs in, responds to Nicole.

June 14 - Squashing Criticism vs. Improving Products - Casey Bisson reacts to Nicole's Post and follows up on his previous post, The ILS Brick Wall. I didn't read Nicole's June 1 post the same way as Casey--that is to say that I don't see any indication that III was squashing criticism directed at them. They may be upset, but that doesn't, in my mind, seem to indicate that III was trying to silence anyone. I mention this because if we (mis)interperate what III does or says and take it at anything but face-value, we run the risk of alienating them which is not at all productive. I have a suspicion that they're already starting to feel a little like the family stone. The very fact that someone at III is reading blogs like Nicole's is actually heartening to me since there's been little evidence to suggest they're even aware of a librarian's blogosphere.

June 16 - Empathy, But Not Sympathy for Innovative - Pegasus Librarian (not sure who this is), gathers a number of these posts together as well and recalls from IUG:

These users all wanted to be able to do stuff with the catalog... web 2.0 stuff, fun stuff, necessary stuff, stuff that should be do-able. And Dinah's response was always the same. She's been wanting to do all that, too, but there's no time, and they aren't allowed to fix stuff unless they're actively supposed to be working on that module or code. Her refrain was (and I quote), "As we touch it, we can fix it.

To be blunt, I don't care what's going on inside Innovative. If I go to Burger King and get a raw hamburger, the last thing I want them to tell me is that they're short-staffed and one of the grills is broken. In fact, reports like this make me more cognizant of the fact that Innovative's house is is complete disarray. Half-a-million dollars should get us more than a dysfunctional family. Hearing something like this just makes me angry.

OPAC under fire

Sometime last week - What if Amazon sucked like our OPAC - a la David Walker - You just have to see it if you haven't yet.

June 13 - Is the Writing on the Wall for the Integrated Library System? - OhioLINK's Peter Murray muses on the future of the ILS and the OPAC. This is a good post that I'd recommend, even though I disagree with some of it. Murray has drawn from the newly formed Next Generation OPACs mailing list to discuss the relevancy of the OPAC in today's library. He believes that the OPAC is barely utilized--I suppose he believes that to be the case in most libraries. He also seems to suggest that the "ILS/OPAC" (Which I take to mean the ILS with OPAC) should be considered an asset management system. In a way he's correct, but fundamentally, the ILS is much more than that. The ILS is a suite of applications that, hopefully, facilitate everything from the art of cataloging (not inventorying) to finding material and information. I also do not see any evidence to support his claim that patrons do not use the OPAC. He writes, "I would challenge the notion that the OPAC is a 'useful tool' -- if it was, our patrons would still be using it. As it is, anecdotal evidence suggest that the OPAC is the last thing they would choose to use." We've got logs that prove that the OPAC is used heavily in our organization--it always has been. Perhaps the situation is different in academia where databases rule the roost, but the OPAC is the primary search tool for the public library patron, both in our buildings and from home. In many ways, the OPAC represents our double-doors--if there were no OPAC, we could not conduct business, and it's very much alive. Where I do agree with him is in his remarks about libraries getting themselves in to trouble, though it's not because we listened to ourselves as he suggests, but because there has never been a change-agent-inducing catalyst to light a fire under our collective behinds. In fact, the libraries who have been successful at transitioning into this "2.0 era" have largely been lucky in that they simply were in possession of the right people at the right time. The combination of vision, passion, and expertise is what makes a 600,000-ton tanker full of institutional inertia change course--not software suites.

June 14 - Are we really ready to say goodbye to the Sucky OPAC - Jennifer over at Life as We know It asks whether, in general, libraries are ready to chuck their existing OPACs and slide in shiny new replacements. Her concern is that we're just not ready for a step like this. She makes a good point--one that I'd say is very valid considering the state of technology in many libraries. I've been contacted a number of times by individuals at other libraries who want to do what AADL has done with Drupal. I explain that Drupal is not the answer--it was a means to an end for us--so when they ask, "Ok, now I just need to get a copy of Drupal, install Linux somewhere and learn PHP?", I try to make it clear that there is also an ocean of experience to cross because the answer is not in a book, nor is it in any particular software product. I hate to bring bad news to bear with some folks, but in many cases, libraries are just not ready yet.

The issue at hand here is really about redefining purpose within the library and staffing your technology department with passionate creators--employees who are extremely knowledgeable, technically, and driven to pursue a vision. Essentially, we need to be grokking the entire Library 2.0 meme. Pragmatically, if you look at the alternative, you've got a situation that does not diverge, at all, from the present vendor-centric model. Say, for the sake of argument, that NCSU's Endeca model becomes the next gold standard as far as OPACs are concerned. Average, across-the-board OPAC quality may very well benefit in the short term, but you still have not addressed the fact that as libraries, we cannot shape the systems into new and unique forms. Turn-key implementation comes at the cost of innovation and ingenuity at the micro level which, in today's world, can have a profound influence over the macro level. In other words, we shrink the pool of potential innovators by an order of magnitude and continue to forfeit control over our collective institutional destiny.

I'm glad Jennefer turns the argument back on ourselves because we are, after all, the other side of this equation. Every day we have another chance to address the technology deficit in our libraries and we can either choose to or not. Last week, I spent two days at the Darien Public Library in Darien Connecticut--a library full of people with vision, passion, and courage. I'm convinced that they'll be able to do anything they want, simply because of their drive to get there and their willingness to make radical change. At any rate, I was having dinner with Alan Gray and he made a fabulous comment. He said, "power is 20% given and 80% taken." I couldn't agree more. I'd like to see libraries take a firmer hand in letting vendors know what we need, not just want from them. We need to take our 80 and stop giving them their 20.

But there is work to be done before we can do that.

A "Bill of Rights" questioned

June 15 - The Problem with the ILS Bill of Rights - Daniel Chudnov's (Dchud) takes on my manifesto. There's quite a bit here so I suggest reading his post. Drawing directly from my "ILS Customer's Bill-of-Rights", Dan makes the case that we do not need a Bill-of-Rights (the Rights). Aside from the fact that I believe his arguments never intersect with my original intent for the Rights, there are several problems with the points he makes. There are also several very good points. Dan's main argument is that, as libraries and customers, we don't have to sign a contract for something we don't want. Ultimately, he's right, but there is a difficult and very involved transitional period between the world he's talking about and the one we live in now.

Libraries are like anyone else buying something--they need to be educated buyers. Until libraries can make truly informed decisions about the systems they purchase, we need discussion like the constellation of posts I'm outlining here as well as touchstones like the Rights post I wrote last November. Also, Dan's suggestion that libraries just not sign a contract they're not happy with presupposes that there are better alternatives waiting in the wing. What choice have libraries had, really? Can you say with all honesty that libraries have been in much of a bargaining position. Yes, vendors want our money, but they are also the power-brokers in these transactions until we change that. Dan also mentions the Open Source route as an alternative and points to the State of Georgia as a case for consideration in his follow-up post. Well yes, the State of Georgia can consider a home-grown, OS-based solution because they have the resources to make it happen. For most libraries, however, there is a severe tech-deficit that makes them blind with terror at the prospect of maintaining multiple points of contact for their ILS. Libraries are fully aware that they have, for years, been getting fleeced by vendors. He also suggests lawsuits as a mechanism for change. Perhaps he's right, but lawsuits are costly and have no guarantee of success and would leave libraries in the same position as a diner who sends back a plate of food--will there be something nasty in it when it comes back?

Focusing on contracts and lawsuits is not the answer here. Focusing on ourselves is--bettering ourselves to the point of technical excellence is a must when you're talking about the David and Goliath standoff between us and them. It's a showdown that's inevitable, we just better not show up to the party with poor aim. That's why the time-line between now and the the future Dan talks about needs to be filled, not just with changes on the vendor side, but within libraries as well. Infrastructure upgrades, organizational restructuring, strategic planning, intensive education, and vision building need to proceed in tandem with our efforts to lobby change from our vendors. Otherwise, we'll just be demanding something we can't handle yet and our vendors will know it.

I mentioned that Dan's post doesn't really intersect with the purpose of the "ILS Bill of Rights". That's because it's intended to provide a set of standards by which we, as libraries, consider potential new systems. It's not for the vendors, it's for us. I never thought that someone at Innovative might read it and think, "Uh oh, they're on to us!" I'm not presenting it for ratification by anyone, anywhere. It's sole purpose is to educate and promote discussion, which it has done beautifully, this past week.

More follow-up on Dan's post:

June 15 - Wait a minute: you mean the OPAC doesn't suck? *We* suck? Colorado College's Steve Lawson addresses Dchus's post.

June 15 - It's not that simple - We're back to Nicole who also takes on Dchud's post.

FYI: I'll be speaking about this next Sunday, June 25 in New Orleans on a panel, aptly named, "Catalog Transformed". Hope to see you there!

Addressing the permanence issue

As I was saving a document in Writely the other day, I thought, I've got a lot of stuff in here, I hope they don't lose it! In fact, I've got a lot of content squirreled away in a number of Web 2.0 sites scattered about the net. This isn't necessarily a bad thing, but thinking about it made me have a moment or two of anxiety which I allayed by doing a mental audit of everything I have squirreled away. I then thought that I ought to consolidate some of it.

This was around about the same time that Steve Wilson published his Squidoo lens entitled "Library 2.0 in three easy steps" which I thought was a great, comprehensive resource for people interested in Library 2.0. Shortly thereafter, Michael and Jenny's lens was published which is truly a great document. A great document indeed, but, legally, who owns the rights to it? Luckily for Steve, Michael and Jenny, they own the copyright for their lenses. It seems that Squidoo, "an old-fashioned corporation, with real employees and investors", has a workable business model based on truly shared content. Not so with all Web 2.0 companies.

Choose your twos

I mention Squidoo as an example of good 2.0. There are a lot of Web 2.0 services out there with a fair amount of overlap--some good and some not-so-good. In some cases, the choice is clear--for instance, most people use flickr for photo sharing--it's become the de facto, on-line standard for maintaining photo archives with associated metadata. I use it for a number of images used on my blog (as do others). As mashups become more in-style and their usefulness evolves, we'll see a lot of cross-pollination between library websites, themselves, and Web 2.0 apps. While I'm all for this type of innovation, my systems-admin side of me sends up some red-flags that make me a little wary of following this trend blindly. Let's be realistic and acknowledge that the Web 2.0 market will correct itself--some of these companies are not going to be around forever--therefore, we need to be choosy.

Longevity

As libraries, we are far more concerned about longevity of data and content than commercial entities. The major difference being that when a company goes belly-up, they no longer care what happens to their data. They will either destroy it or sell it to the highest bidder where who-knows-what will happen to it. Libraries--or librarians, on the other hand, care very much about information and it's longevity. Show me a red-blooded librarian who doesn't want to pass the flame of knowledge on to the next generation and have it burn as brightly--if not brighter--as it did for them. I think a certain amount of reluctance within libraries may be attributed to an uncertainty about the future of Web 2.0 technology. As such, we need to seek out stable, working companies to work with as we integrate with 2.0.

Responsibility

There are a number of key indicators we can use to gauge the level of responsibility a company takes toward it's content and it's business process. The first, in my mind, is to examine that company's relationship with copyright. I think it would be smart to beware of companies that play fast and loose with copyrighted material. Another indicator would be to look at the type of customers the company targets. Try to get a sense of what kind of people use the service. Is their behavior in-line with what you would like to do with your own systems? Some other indicators may be financial standing. How much money does the company have? Are they in serious debt? Are they just starting up? How do they make money? Remember, by incorporating a service into our web sites, we are, for all intents and purposes, endorsing that company. I behooves us to make sure we're doing the right thing.

Exploitation

I seem to recall a bit of a flap over Google's decision to apply an algorithm against mail received and sent by Gmail. The issue was that some people who used the service felt it was a violation of their privacy. Google, on the other hand, said that it was just a piece of software scanning through the mail for the purpose of displaying targeted advertisement. At the end of the day, the choice is up to the consumer as to whether they'll use Gmail or not. Some would call what Google is doing a form of exploitation. Exploitation or not, any commercial Web 2.0 service has got to make money. As consumers of this new medium, it's sometimes very difficult for us to discern how the money is being made. As libraries, we have a responsibility to know this before we integrate it with our own systems.

Privacy

Several months ago, I mentioned that I thought that a social OPAC and patron privacy were not mutually exclusive. I still believe that. I think we can give our patrons clear choices regarding their privacy. There is no need for us to obfuscate the ramifications of participating in a larger social network. In order to provide that kind of transparency, however, we need to make sure our Web 2.0 partners are compliant with our privacy goals. We can do this by knowing what will happen to all data entered into their systems and disclosing that to our users in plain language. Again, all users need to be given the choice of participating, or not. We need to know, at all times, what information is private and what isn't.

Stability

Can I just say that I feel terrible for all those poor folks using BlogSpot? Maybe it's just me, but it seems like their servers are frequently unavailable. At any rate, from what I've experience with them, I'd never use the service. The Web 2.0 "API" has given rise to an entirely new distributed computing environment. Unbeknown to most web surfers, when they load a page, they may be querying five or six different servers. Those servers, in turn, may be querying five or six different servers, and so on and so forth. This allows developers to pull together content in new and exciting ways, but the drawback is that the entire system is a house of cards. A single server outage anywhere in the chain can have a significant impact on the entire system. Luckily this doesn't happen very often because most mission-critical services are bolstered by "high-availability" technologies. Looking at a company's track record (Netcraft can help) makes sense when choosing a service.

Search-ability

From a practical point-of-view, how good is a service's search capabilities? Does it's API do a good job of searching as well? Naturally, we want to be able to access the data we put in. You'll want to look to see if the data can be scoped to include information for just your organization. Are search results fast enough or clear enough to be useful to you? After all, we are libraries and we're only as good as our search capabilities.

Portability

What if you want to bail on a service? If you've been using a service for several years, you've undoubtedly accumulated a fair amount of data during that time. Whatever your reasons for ditching a service, you're likely going to want to get an export of the data. It would be disheartening to find out that it's not possible, so it makes sense to make exportability (in any usable format) a stipulation of usage. This could be as simple as spidering the data--as long as you can get at it. You can always massage the data back into something useful. You can't always get it out.

Legality

Ever notice that whenever you sign up on a Web 2.0 site, you are asked to agree to their terms of service? Well, you might want to print that out and run it under your library lawyer's eyes if you plan to integrate the service. I doubt most people do this.. we sure don't here at AADL. I've also never seen anything untoward in those agreements, but then again, I'm no lawyer. At AADL, we do not entrust patron-added data to any Web 2.0 company--not because we do not trust any of them--we've just got other plans.

There is no escaping the usefulness and the power of this new generation of web-based social software. As libraries, we can take advantage of this model through the judicious application of these services. Better yet, we can start to produce our own software so that we never have to worry about where the data goes. Social software allows us to take "snapshots" in time. It produces a legacy of its users that, as it evolves, will become a resource full of ever-increasing richness. There is no reason why we should treat it any differently than we would our books, movies, and music.