This page provides quick links for the Registered FRBR Element Sets and Value Vocabularies.

This essay—part of a series of OCLC Research projects to mobilize unique materials synthesizes evidence of what descriptive information people say they need for research.

This document specifies an abstract model for Dublin Core metadata. The primary purpose of this document is to specify the components and constructs used in Dublin Core metadata. It defines the nature of the components used and describes how those components are combined to create information structures. It provides an information model which is independent of any particular encoding syntax. Such an information model allows us to gain a better understanding of the kinds of descriptions that we are encoding and facilitates the development of better mappings and cross-syntax translations.

...we can see the outlines for how we might curate oral history that offers a richer perspective on sound. These points of agreement might include some of the following: a) recognition that oral history is fundamentally an aural experience and not just a text; b) oral history should be evaluated for meaning at a clip or segment level, not just at the level of the 60-minute or 90-minute interview; c) clips and segments should be connectable across interview or even collection; d) our metadata schemes, as well as our work in representing oral history to public audiences, have to account such rich metadata schemes; e) collecting oral history is one thing, making it open and accessible is another goal that the oral history community should embrace; f) efforts at linked open data have to account for segment and clip-level metadata; g) and, it is vital that we involve communities in processing and connecting to oral history.

We don’t live in the binary producer/consumer world anymore. Even if we did, there is simply too much data to deal with. Its stewards simply do not have all necessary expertise or resources to organize it most effectively and flexibly. Without doubt, this involves plenty of technical challenges (standards, interfaces, infrastructure). But these are trivial in comparison to the real challenge: shifting community expectations that erroneous metadata can and should be edited by researchers themselves. And while we’re at it, we might broaden our view of metadata to include not only the usual fields (author, date, etc), but additional description as well (abstracts, section headings, keywords, etc) that makes the texts more findable.

The biggest difference here is that element sets are available for all items, while item type elements are available only to those items that belong to that item type. So, if you need a standardized set of elements that is available across all item types, an element set is the way to go.

It also seems to me that we have everything to gain by beginning our work on a data format with no particular serialization in mind. We could go from RDA to RDA-as-data and then on to RDA-as-RDF. I see some dangers in skipping the middle step, mainly that we could end up making some decisions that fit RDA into RDF but that are problematic for other serializations.

This document describes a core ontology for organizational structures, aimed at supporting linked-data publishing of organizational information across a number of domains. It is designed to allow domain-specific extensions to add classification of organzations and roles, as well as extensions to support neighbouring information such as organizational activities.

This document defines a set of terms for describing people. It defines how to describe people's characteristics such as names or addresses and how to relate people to other things, for example to organizations or projects. For each term, guidance on the usage within a running example is provided. This document also defines mappings to widely used vocabularies to enable interoperability.

There are many situations where it would be useful to be able to publish multi-dimensional data, such as statistics, on the web in such a way that it can be linked to related data sets and concepts. The Data Cube vocabulary provides a means to do this using the W3C RDF (Resource Description Framework) standard. The model underpinning the Data Cube vocabulary is compatible with the cube model that underlies SDMX (Statistical Data and Metadata eXchange), an ISO standard for exchanging and sharing statistical data and metadata among organizations. The Data Cube vocabulary is a core foundation which supports extension vocabularies to enable publication of other aspects of statistical data flows.

DCAT is an RDF vocabulary designed to facilitate interoperability between data catalogs published on the Web. This document defines the schema and provides examples for its use.

By using DCAT to describe datasets in data catalogs, publishers increase discoverability and enable applications easily to consume metadata from multiple catalogs. It further enables decentralized publishing of catalogs and facilitates federated dataset search across sites. Aggregated DCAT metadata can serve as a manifest file to facilitate digital preservation.

The New York Public Library recently launched its first foray into crowd sourcing metadata by exposing 40,000 image pages of turn of the century restaurant and cruise ship menus: “What’s On the Menu?” The goal of the project was to widely distribute the transcription of the menu items into a structured and reusable form. The site was exceedingly popular in its first few months.
Recent activity has flattened somewhat, raising issues regarding the public’s appetite for these projects. More importantly, the menus project raised hard questions about the quality of the crowd sourced content, the longevity of the data, and the disposition of the data (e.g. What is it? Is it good enough for our purposes? Should we keep it? If yes, where does it belong?).
This presentation will discuss these issues and propose some alternative views on metadata, user-generated content, and the intersection of the two.

"In controlled environments, e.g. on a single site, or in a single person's
media library, or within a small coherent community where all the
participants have compatible goals, it is possible to get enough
discipline that metadata is both reliable and useful. And for such
communities we have a raft of extension mechanisms, and clashes can be
avoided easily by simply using names that nobody in the community is
already using.

"But as soon as this kind of thing is applied to people outside the
tightnit community, the metadata becomes an utter mess, misused, wrong,
missing, syntactically incorrect, semantically incorrect, unusable. We
have shown time and time again that when metadata mechanisms face the
wider Web community, they fail. Ignoring this doesn't make it go away."

This is a suggestion to consider @resource as preferable over @about. The purpose is to promote a slightly simpler and more uniform practice of RDFa use, especially in the RDFa Lite subset.

Microformats, RDFa and microdata all enable consumers to extract data from HTML pages. This data may be embedded within enhanced search engine results, exposed to users through browser extensions, aggregated across websites or used by scripts running within those HTML pages.

This guide aims to help publishers and consumers of HTML data use it well. With several syntaxes and vocabularies to choose from, it provides guidance about how to decide which meets the publisher's or consumer's needs. It discusses when it is necessary to mix syntaxes and vocabularies and how to publish and consume data that uses multiple formats. It describes how to create vocabularies that can be used in multiple syntaxes and general best practices about the publication and consumption of HTML data.

Includes an implementation of PLDA.

Partially Labeled Dirchlet Allocation (PLDA) [paper] is a topic model that extends and generalizes both LDA and Labeled LDA. The model is analogous to Labeled LDA except that it allows more than one latent topic per label and a set of background labels. Learning and inference in the model is much like the example above for Labeled LDA, but you must additionally specify the number of topics associated with each label.

Much of the world's electronic text is annotated with human-interpretable labels, such as tags on web pages and subject codes on academic publications. Effective text mining in this setting requires models that can exibly account for the textual patterns that underlie the observed labels while still discovering unlabeled topics. Neither supervised classification, with its focus on label prediction, nor purely unsupervised learning, which does not model the labels explicitly, is appropriate. In this paper, we present two new partially supervised generative models of labeled text, Partially Labeled Dirichlet Allocation (PLDA) and the Partially Labeled Dirichlet Process (PLDP). These models make use of the unsupervised learning machinery of topic models to discover the hidden topics within each label, as well as unlabeled, corpus-wide latent topics. We explore applications with qualitative case studies of tagged web pages from del.icio.us and PhD dissertation abstracts, demonstrating improved model interpretability over traditional topic models. We use the many tags present in our del.icio.us dataset to quantitatively demonstrate the new models' higher correlation with human relatedness scores over several strong baselines.

Although fully generative models have been successfully used to model the contents of text documents, they are often awkward to apply to combinations of text data and document metadata. In this paper we propose a Dirichlet-multinomial regression (DMR) topic model that includes a log-linear prior on document-topic distributions that is a function of observed features of the document, such as author, publication venue, references, and dates. We show that by selecting appropriate features, DMR topic models can meet or exceed the performance of several previously published topic models designed for specific data.

This class loads data into the format for the MALLET Dirichlet-multinomial regression (DMR). DMR topic models learn topic assignments conditioned on observed features.

All you have to do is view source on any nytimes.com article published on or after January, 23 2012. In the HTML you will see new attributes like ‘itemtype’, ‘itemprop’ and ‘itemid’. If you paste an article URL into the Google Rich Snippets tool, you can see a parse of the structured data now embedded into every nytimes.com article,

Only a small subset of MARC 21 fields are used in WorldCat. Even when considering the MARC fields that are heavily used in non-book formats, there are
only 21 to 30 tags that occur in 10% or more records.

Conditional random fields (CRFs) are a probabilistic framework for labeling and segmenting structured data, such as sequences, trees and lattices. The underlying idea is that of defining a conditional probability distribution over label sequences given a particular observation sequence, rather than a joint distribution over both label and observation sequences. The primary advantage of CRFs over hidden Markov models is their conditional nature, resulting in the relaxation of the independence assumptions required by HMMs in order to ensure tractable inference. Additionally, CRFs avoid the label bias problem, a weakness exhibited by maximum entropy Markov models (MEMMs) and other conditional Markov models based on directed graphical models. CRFs outperform both MEMMs and HMMs on a number of real-world tasks in many fields, including bioinformatics, computational linguistics and speech recognition.

Web Data Commons will extract all Microformat, Microdata and RDFa data that is contained in the Common Crawl corpus and will provide the extracted data for free download in the form of RDF-quads as well as CSV-tables for common entity types (e.g. product, organization, location, ...).

"The Milkmaid," one of Johannes Vermeer's most famous pieces, depicts a scene of a woman quietly pouring milk into a bowl. During a survey the Rijksmuseum discovered that there were over 10,000 copies of the image on the internet—mostly poor, yellowish reproductions. As a result of all of these low-quality copies on the web, according to the Rijksmuseum, "people simply didn't believe the postcards in our museum shop were showing the original painting. This was the trigger for us to put high-resolution images of the original work with open metadata on the web ourselves. Opening up our data is our best defence against the 'yellow Milkmaid.'"

Topic models are learned via a statistical model of variation within document collections, but designed to extract meaningful semantic structure. Desirable traits include the ability to incorporate annotations or metadata associated with documents; the discovery of correlated patterns of topic usage; and the avoidance of parametric assumptions, such as manual specification of the number of topics. We propose a doubly correlated nonparametric topic (DCNT) model, the first model to simultaneously capture all three of these properties. The DCNT models metadata via a flexible, Gaussian regression on arbitrary input features; correlations via a scalable square-root covariance representation; and nonparametric selection from an unbounded series of potential topics via a stick-breaking construction. We validate the semantic structure and predictive performance of the DCNT using a corpus of NIPS documents annotated by various metadata.

This tutorial will guide you through the key steps to build, test, and publish your first Open Graph app. We will build a sample app that allows users on your website to publish stories about cooking recipes.

This post attempts to clarify those technical issues by providing an easy-to-read list of similarities and differences between RDFa, Microdata and Microformats. A simple table summarizing all features across each structured data syntax is listed below. Each feature is linked to a brief explanation of the feature toward the bottom of the page.

In summary the key benefits of using Semantic Web technology for Volkswagen were as follows:

A standardised interface to data and content, accessible to developers with different skillsets, using different technologies within and without the organisation.
Separation of concerns between information and application, both logically and physically.
Increases value, reusability and accessibility of data.
Very powerful federation features.
Adoption and use didn't necessitate process or change management. It could be leveraged at any stage within the product lifecycle painlessly and gracefully, both internally and externally.

Fascinating post on the complexities of music identification and #metadata: #inls520

Discover what hashtags really mean, and add your own definitions in seconds.

From a Stanford Libraries newsletter: "Linked Data could provide the antidote to the chaos and complexity of the current overabundant array of too simple search mechanisms with too little precision and too short recall of relevant results."

Archivematica is a comprehensive digital preservation system. Archivematica uses a micro-services design pattern to provide an integrated suite of free and open-source tools that allows users to process digital objects from ingest to access in compliance with the ISO-OAIS functional model.

The Apache Tika™ toolkit detects and extracts metadata and structured text content from various documents using existing parser libraries.

@BerkeleyISchool grad Stephanie Collett is the technical lead for #HathiTrust's #metadata management system:

CitationStyles.org is the home of the Citation Style Language (CSL), an open XML-based language to describe the formatting of citations and bibliographies.

This course comprises a critical, comparative examination of the concept of description and its institutionalization, in the form of metadata standards, rules, and formats, in three primary contexts: libraries, archives, and museums. We will investigate the conceptual foundations and goals of description in each context and the structures (guidelines, technologies) that have been developed to facilitate institutional goals. We will also explore emerging challenges to traditional models of description, including new forms of complex, dynamic entities (for example, continually updated documents, such as blogs), new technologies for searching, browsing, and describing (such as user-generated descriptive tags), and new ways of viewing the descriptive enterprise (via critical theory, for example).

The course will not emphasize the practice of creating descriptive metadata in any current environment (that is, you will not learn how to create library catalog records or archival finding aids according to existing content and technical standards). Instead, the course will focus on understanding and interrogating the conceptual foundations of existing standards and guidelines for such descriptions. We will emphasize rigorous and spirited analysis of these descriptive paradigms and their continued utility in a rapidly changing information landscape.

AIMS supports the implementation of structured and linked information and knowledge by fostering a community of practice centered on the themes of interoperability, reusability and cooperation. It shares vocabularies, methodologies, tools and services in order to promote coherence in agricultural information.

The VMF matrix is a tool which can be used to automatically compute the "best fit" mappings between terms in controlled vocabularies in different metadata schemes and messages of interest to the educational, bibliographic and content publishing sectors.

This page contains tables of known HTML rel values from specifications, formats, proposals, brainstorms, and non-trivial POSH usage in the wild. In addition, dropped and rejected values are listed at the end for comprehensiveness

Acoustid is an open source project that aims to create a free database of audio fingerprints with mapping to the MusicBrainz metadata database and provide a web service for audio file identification using this database.

VoID is an RDF Schema vocabulary for expressing metadata about RDF datasets. It is intended as a bridge between the publishers and users of RDF data, with applications ranging from data discovery to cataloging and archiving of datasets. This document is a detailed guide to the VoID vocabulary. It describes how VoID can be used to express general metadata based on Dublin Core, access metadata, structural metadata, and links between datasets. It also provides deployment advice and discusses the discovery of VoID descriptions.

DSPL is the Dataset Publishing Language, a representation language for the data and metadata of datasets. Datasets described in this format can be processed by Google and visualized in the Google Public Data Explorer.

The MADS/RDF (Metadata Authority Description Schema in RDF) vocabulary, a data model for authority and vocabulary data used within the library and information science (LIS) community, which is inclusive of museums, archives, and other cultural institutions.

SiLCC is a cloud based service for parsing text and extracting relevant keywords.

It must be simple for Web developers to extract and utilize structured information from a Web document. This document details such a mechanism; an RDFa Document Object Model Application Programming Interface (RDFa DOM API) that allows simple extraction and usage of structured information from a Web document.

This vocabulary enables providers of Web data to publish provenance-related metadata about their data.

The new Graph API attempts to drastically simplify the way developers read and write data to Facebook. It presents a simple, consistent view of the Facebook social graph, uniformly representing objects in the graph (e.g., people, photos, events, and fan pages) and the connections between them (e.g., friend relationships, shared content, and photo tags).

The ontology is supposed to foster the interoperability among various kinds of metadata formats currently used to describe media resources on the Web.

GeoJSON is a geospatial data interchange format based on JavaScript Object Notation (JSON).

The mission of the Media Fragments Working Group, part of the Video in the Web Activity, is to address temporal and spatial media fragments in the Web using Uniform Resource Identifiers (URI).

Talk given at the 2nd Linked Data on the Web workshop (LDOW) co located with WWW 2009, Madrid.

Our goal is to understand what is being seen through the lens of a camera. Through the integration of diverse skills from many disciplines, ranging from cartographic projection, advanced 3D computer graphics and cutting-edge machine vision algorithms we hope to automatically align, generate and visualize geo-referenced meta-data.

This service will attempt to download a given ORE Resource Map, either from the aggregation URI (if it resolves correctly to a resource map) or from the resource map's URI.

What Google does with embedded metadata.

If you were at ALA Midwinter in Denver (January, 2009) you may have been in one of the meetings where the Library of Congress announced its intention to atone for the lcsh.info fiasco. In case you missed that, Ed Summers of LC created an online version of the Library of Congress Subject Heading authority records, re-organized as a SKOS vocabulary and available for linking on the open Web. After being available for about six months (beginning in May of 2008), Ed was asked by his employer to take down the site on December 18, 2008. This was in spite of the fact that the data had been out there long enough to have a number of users, and that the removal broke existing systems that had developed around the data.[Note, lcsh.info has been re-born as http://lcsubjects.org/, hosted by Talis.]The outcry in the community was strong, including a reply to Ed's lcsh.info blog post by Sir Web himself, Tim Berners-Lee. Library of Congress must have been suitably embarassed.Thus the announcement at Midwinter that LC not only understands the value of linked open access to LCSH, but that all of the vocabularies managed by LC -- from the name authorities to the lists of document types, languages, locations, etc., -- need to be openly available in a format suitable for inclusion in Web services. LC has created a web site to host these vocabularies: id.loc.gov. On that site they say:Initially, within 6 to 8 weeks, the Library of Congress will release its first offering: the Library of Congress Subject Headings. This will be an almost verbatim re-release of the system and content once found at the popular prototype lcsh.info service.They also say:We aim to make resources available on this site within 6-8 weeks. Check this site regularly for more updates as we continue to develop this service!The page is dated 1/22/09. My calculations show that 9 weeks have passed. OK, that's only one week over their stated deadline. But nothing on the page has changed. No resources have been made available. An "almost verbatim" release of lcsh.info should not be too hard given that Ed had code written that he has made publicly available.But even today, the promised service is 6-8 weeks away. It may stay that way for a long time. Maybe even forever.Why does this matter? It matters because the availability of these vocabularies is essential for the library world to move forward. Some of us have been asking LC to put the vocabularies online in a machine-actionable format for a very long time. The Dublin Core community worked with LC to create a machine-actionable and URI-identified version of the MARC role terms as early as 2005. You can't find this linked from any of the MARC documentation. Some of us brought up the topic ad nauseum at MARBI meetings, but to no avail. Now LC seems to have "gotten it" conceptually but they have yet to show us that they can deliver.I may seem to be undeservedly impatient on this score, but it's not that we have been waiting for this for 9 weeks: we've been waiting for years. And quite honestly, this is not rocket science, nor does LC have no guidance for how to manage this data. In fact, they could use the NSDL Metadata Registry, or, if they insist on hosting this themselves, the Registry's source code is available. Quite frankly, if LC does not prove to us soon that it can perform this necessary function, I feel that we are quite justified in going forward without them, registering the vocabularies where they can be used and managed by anyone who needs them, and going forward with a transformation of library data that will meet 21st century needs.

voiD is a vocabulary and a set of instructions that enables the discovery and usage of linked datasets.

Documents Compass provides non-profit assistance to those who are engaged in or planning documentary editing projects in the electronic age.

The premise behind dynamic bindings is that any search engine, even one that existed prior to development of the standard, need only to provide a dynamic binding - a self-description. It need make no other changes in order to be accessible. A client will be able to access any search engine that provides a description, if only it implements the capability to read and interpret the description and use it to formulate a request (including a query) and interpret the response.

The OASIS Search Web Services Technical Committee is developing search and retrieval web services, integrating various approaches under a unifying model, an Abstract Protocol Definition.

It would seem important that the Web easily enable small-time users of data to efficiently communicate with one another, without the need to have one of the giants as an intermediary.

CSS is an external file that specifies how your document should look; RDF-EASE is an external file that specifies what your document means.

We might need a few more buttons on objects we allow for sale by when this becomes ‘common fashion’, don’t you think? Suggestions: ‘This may (not) be transferred on the hypergrid.’ ‘This is ‘all ages’ / ‘mature’. (And then hypergrid enabled sims could block incoming ‘mature’ items if they wished.

SLurl provides direct teleport links to locations in Second Life. If you have Second Life installed, clicking on the map link will automatically teleport you to that location in-world.

With JeromeDL's social and semantic services every library user can bookmark interesting books, articles or other materials in semantically annotated directories.

Whilst there are many ways to publish metadata, we're going to focus on the use of RDFa, and how to either embed the information in web-pages, or provide a separate XML feed.

Package for image-based editing, including overlapping two images and encoding their differences; encoding script; encoding variant manuscripts; collating different manuscripts; gathering statistical data; searching all structural and non-structural data.

Narrow by image similarity or tags.

This online publication provides access to both the full and concise versions of the MARC 21 Format for Authority Data.

The purpose of adapting the LCSH with a simplified syntax to create FAST is to retain the very rich vocabulary of LCSH while making the schema easier to understand, control, apply, and use.

Bottom-up mapping, driven by locals, who decide what's important enough to be mapped. Constrast it with the centralized, top-down, privacy-invading Google Maps/Streetview approach.

Libraries for constructing, parsing, manipulating and serializing OAI-ORE Resource Maps.

The Kernel vocabulary, based on a subset of the Dublin Core (DC) metadata element set, aims to describe objects of any form or category, but its reach is limited to a small number of fundamental questions such as who, what, when, and where.

Douglas Tudhope leads the research on Knowledge Organisation Systems and Services.

Finding the Celtic is an experiment to create an online digital humanities collaboratory for Celtic Studies funded by the National Endowment for the Humanities.

The Bibliographic Ontology Specification provides main concepts and properties for describing citations and bibliographic references (e.g. quotes, books, articles, etc.).

This is an experimental service that makes the Library of Congress Subject Headings available as linked-data using the SKOS vocabulary.

Submit an OCLC number to this service, and it returns a list of related OCLC numbers and selected metadata.

The hub for developers working with the Talis Platform. The Talis Platform is a hosted system which provides an efficient, robust storage infrastructure for documents and metadata.

We consider the use of Semantic Web technologies for improving the multimedia user experience on the Web.

hkit is a simple PHP5 tool for extracting common microformats from a page.