Commented on a colleague's blog
Commented on a colleague's blog
Sunday, November 9, 2008
Thursday, November 6, 2008
Unit 10: Reading notes
David Hawking, Web Search Engines: Part I and II, IEEE Computer, June 2006
- Interesting point - today's search engines not only index many more sites, they provide "much higher quality" answers to queries.
- "For redundancy and fault tolerance, large search engines operate multiple, geographically distributed data centers"
- Crawling algorithms are used to search webpages in incredibly high numbers
- "If each HTTP request takes one second to complete—some will take much longer or fail to respond at all—the simple crawler can fetch no more than 86,400 pages per day. At this rate, it would take 634 years to crawl 20 billion pages. In practice, crawling is carried out using hundreds of distributed crawling machines." Wow.
- "Search engines use an inverted file to rapidly identify indexing terms—the documents that contain a particular word or phrase"
- Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) - means to federate access to diverse e-print archives through metadata harvesting
- OAI-PMH was initially designed to meet the needs of the e-print archives community - and could be applicable in a broad range of communities, including libraries, museums, and archives.
- "Searching on the Internet today can be compared to dragging a net across the surface of the ocean"
- Survey in 2000 concluded that public information on the deep Web was 400 to 550 times larger than the commonly defined World Wide Web - what about today?
- Deep Web documents are on average 27% smaller than surface Web documents
- Largest deep web site: National Climatic Data Center (NOAA)
- "These observations suggest a splitting within the Internet information search market: search directories that offer hand-picked information chosen from the surface Web to meet popular search needs; search engines for more robust surface-level searches; and server-side content-aggregation vertical "infohubs" for deep Web information to provide answers where comprehensiveness and quality are imperative."
Unit 9: Muddiest point
I'm intrigued by the idea of comments embedded within XML. Is it common to use this function? Is it something programmers and webpage authors actually use?
Friday, October 24, 2008
Unit 9: Reading notes
Introduction to XML, by Martin Bryan
- XML = eXtensible Markup Language
- start and end of elements in documents are clearly marked
- XML is not a predefined set of tags like HTML
- flexible enough to use for any logical text structure
- "XML differs from other markup languages in that it does not simply indicate where a change of appearance occurs, or where a new element starts. XML sets out to clearly identify the boundaries of every part of a document, whether it be a new chapter, a piece of boilerplate text, or a reference to another publication."
- "All the technologies I present here are standards, although that word is itself a bit slippery. Standards come in all forms, and multiple standards often compete in the same space. I follow the practical approach of defining a standard as any specification that is significantly adopted by a diversity of vendors, or is recommended by a respectable, vendor-neutral organization."
- This article was a bit over my head, but it would be a good resource to come back to if I was confronted with an XML standard I didn't know much about.
- This article is also a good source for tutorials and additional resources on XML
- "Both SGML and HTML heavily influenced the development of the Extensible Markup Language (XML), a semantic language that lets you meaningfully annotate text. Meaningful annotation is, in essence, what XML is all about." This puts XML in context better than the previous articles.
- DTD = document type definition
- example of a prologue:
- These examples more clearly illustrate the functions of XML
- "The purpose of an XML Schema is to define the legal building blocks of an XML document, just like a DTD."
- XML Schemas are written in XML and secure data communication by standardizing elements
- Must conform to XML syntax rules
- Schema element:
Unit 8: Muddiest point
Regarding website editors: I haven't used these programs before, but I'm hoping to use Dreamweaver for Assignment 6. Are all website editing programs using HTML under the surface? Is it just the user interface that is different?
Sunday, October 19, 2008
Subscribe to:
Posts (Atom)
