...interpretation of term specificity and its application in retrieval Karen Spärck Jones Computer Laboratory, University of Cambridge, Cambridge, UK Abstract: The exhaustivity of document descriptions and the specificity of index terms are usually regarded as independent. It is suggested that specificity should be interpreted statistically, as a function of term use rather than of term meaning. The effects on retrieval of variations in term specificity are examined, experiments with three test collections showing, in particular, that frequently-occurring terms are required for good overall performance. It is argued that terms should be weighted according to collection frequency, so that matches on less frequent, more specific, terms are of greater value than matches on frequent terms. Results for the test collections show that considerable improvements in performance are obtained with this very simple procedure. Exhaustivity and specificity We are familiar with the notions of exhaustivity and specificity: exhaustivity is a property of index descriptions, and specificity one of index terms. They are most clearly illustrated by a simple keyword or descriptor system. In this case the exhaustivity of a document description is the coverage of its various topics given by the terms assigned to it; and the specificity of an individual term is the level of detail at which a given concept is represented. These features of a document retrieval system have been discussed by Cleverdon et al. (1966)...
Words: 2963 - Pages: 12
...1 Ontology Based Web Searching Mechanism for Information Retrieval W.A.C.M. Wickrama Arachchi & K.L. Jayarathne University of Colombo School of Computing, Sri Lanka chamil.madusanka@gmail.com & klj@ucsc.cmb.ac.lk Abstract—The largest data repository, World Wide Web is being a popular research domain where many experiments carry on various types of search architectures. This paper explore the ability of applying concept to concept mapping to the search architecture that applied to a semantic model of given domain. This novel search architecture combines classical search techniques with ontological approach. This research presents effective mechanism to represent the result of meaningful web search. For the simplicity, the breast cancer domain has been used. Index Terms—ontology, semantic web, web search, Semantic Search, concept, keyword extraction I. I NTRODUCTION T HE World Wide Web has been grown up as tree which has spread its branches in all the areas. Thus it can be identified as the largest data repository in the world that presents key driving force for large scale of information technology. With the increase of the amount of content it has been difficult to build an interactive web search with traditional keyword search. The idea presented here is improve the searching process with information extracted from the semantic model of the domain. Ontology is the backbone of semantic web technologies. One of the greatest problems of the...
Words: 5464 - Pages: 22
...Correlation Based Dynamic Clustering and Hash Based Retrieval for Large Datasets ABSTRACT Automated information retrieval systems are used to reduce the overload of document retrieval. There is a need to provide an efficient method for storage and retrieval .This project proposes the use of dynamic clustering mechanism for organizing and storing the dataset according to concept based clustering. Also hashing technique will be used to retrieve the data from the dataset based on the association rules .Related documents are grouped into same cluster by k-means clustering algorithm. From each cluster important sentences are extracted by concept matching and also based on sentence feature score. Experiments are carried to analyze the performance of the proposed work with the existing techniques considering scientific articles and news tracks as data set .From the analysis it is inferred that our proposed technique gives better enhancement for the documents related to scientific terms. Keywords Document clustering, concept extraction, K-means algorithm, hash-based indexing, performance evaluation 1. INTRODUCTION Now-a-days online submission of documents has increased widely, which means large amount of documents are accumulated for a particular domain dynamically. Information retrieval [1] is the process of searching information within the documents. An information retrieval process begins when a user enters a query; queries are formal statements of...
Words: 2233 - Pages: 9
...DESIGN AND OPERATION OF TYPICAL SEARCH ENGINE INTRODUCTION Design of information retrival system to find out the stored information on a computer system is known as search engine. It is used to links to documents, web sites, text snippets, images, videos etc. first they have to process hundreds of millions of issues and searches every day and answer to the queries in milliseconds. Search engine is a general class of program. Many key factors and requirement of the user should be taken into account by the search engine secondly the resources on world wide web must be update constantly. Wheather it may continuously add of data, removed or change of data( the overall changing is upto 8% a week). Third the user express should be make use of available syntactic features with limited express power of that language. As we know that search engine is a designed program which help the user to retriev data stored in the computer such as world wide web or from a personal computer. The user can retriev the data with list of references which match the criteria of the user quickly and efficently this can done only by search engine with reguarly updated indexes. In other words search engine is a sophisticated peace of software which can access on a website which allows user to access the web page by entering the queries in the search box. There are two types of search indexes which will be access for the web search directories crawler-based search engine Directories : unlike...
Words: 2233 - Pages: 9
...1 Basic concepts of information retrieval systems Introduction The term ‘information retrieval’ was coined in 1952 and gained popularity in the research community from 1961 onwards.1 At that time the organizing function of information retrieval was seen as a major advance in libraries that were no longer just storehouses of books, but also places where the information they hold is catalogued and indexed.2 Subsequently, with the introduction of computers in information handling, there appeared a number of databases containing bibliographic details of documents, often married with abstracts, keywords, and so on, and consequently the concept of information retrieval came to mean the retrieval of bibliographic information from stored document databases. Information retrieval is concerned with all the activities related to the organization of, processing of, and access to, information of all forms and formats. An information retrieval system allows people to communicate with an information system or service in order to find information – text, graphic images, sound recordings or video that meet their specific needs. Thus the objective of an information retrieval system is to enable users to find relevant information from an organized collection of documents. In fact, most information retrieval systems are, truly speaking, document retrieval systems, since they are designed to retrieve information about the existence (or non-existence) of documents relevant to a user query. Lancaster3...
Words: 5238 - Pages: 21
...EBizPort: Collecting and Analyzing Business Intelligence Information Byron Marshall, Daniel McDonald, Hsinchun Chen, and Wingyan Chung Artificial Intelligence Lab, Management Information Systems Department, University of Arizona, Tucson, AZ 85721. E-mail: {byronm, dmm, hchen, wchung}@eller.arizona.edu To make good decisions, businesses try to gather good intelligence information. Yet managing and processing a large amount of unstructured information and data stand in the way of greater business knowledge. An effective business intelligence tool must be able to access quality information from a variety of sources in a variety of forms, and it must support people as they search for and analyze that information. The EBizPort system was designed to address information needs for the business/IT community. EBizPort’s collection-building process is designed to acquire credible, timely, and relevant information. The user interface provides access to collected and metasearched resources using innovative tools for summarization, categorization, and visualization. The effectiveness, efficiency, usability, and information quality of the EBizPort system were measured. EBizPort significantly outperformed Brint, a business search portal, in search effectiveness, information quality, user satisfaction, and usability. Users particularly liked EBizPort’s clean and user-friendly interface. Results from our evaluation study suggest that the visualization function added value to the search and...
Words: 14368 - Pages: 58
...non-trivial knowledge or information from unstructured text data. Text mining is the multidisciplinary field which draws on data mining, machine learning, information retrieval, computational linguistics and statistics. This research paper discussed about one of the text mining preprocessing techniques. The initial process of text mining systems is preprocessing steps. Pre-processing reduces the size of the input text documents significantly. It involves the actions like sentence boundary determination, natural language specific stop-word elimination, tokenization and stemming. This research paper established the comparative analysis of document tokenization tools. I. Introduction Tokenization...
Words: 1209 - Pages: 5
...Authorities, Australia 2012 This publication is protected by copyright under the Commonwealth of Australia Copyright Act 1968. NATA’s accredited facilities or facilities seeking accreditation may use or copy this publication or print or email this publication internally for accreditation purposes. Individuals may store a copy of this publication for private non-commercial use or copy a reasonable portion of this publication in accordance with the fair dealing provisions in Part III Division 3 of the Copyright Act 1968. You must include this copyright notice in its complete form if you make a copy of this publication. Apart from these permitted uses, you must not modify, copy, reproduce, republish, frame, upload to a third party, store in a retrieval system, post, transmit or distribute this content in any way or any form or by any means without express written authority from NATA. May 2012 Page 2 of 3 Policy Circular 15 - Recognition of ISO 9001 certification at NATA assessments Recognition of ISO 9001 certification at NATA assessments NATA is frequently contacted, by both facilities operating within a management system certified to ISO 9001 and customers seeking technical services from accredited facilities, for guidance regarding the relevance of certification to the assessment of the management systems elements of its facilities. Facilities accredited to ISO/IEC 17025 Clause 1.6 of ISO/IEC 17025 states that laboratories that comply with ISO/IEC 17025 meet the “principles of...
Words: 503 - Pages: 3
...Google, according to estimates of total Global market share is a leading search engine company with its highest 86% of market share, but looking in a smaller perspective, Google, have another regional biggest competitor in Russia – Yandex. Yandex is an internet technology company that operates in Russia and Turkey. It is the largest Russian and fifth-largest world internet search engine. As of December 2011, Yandex had 60.9% of the Russian search market. Yandex mission is to give the answer to the user anytime and anywhere. Company, similar to Google provides its services for desktop and mobile users and develops embedded solutions as well. The company specializes on highly-targeted sophisticated web search and information retrieval services. Yandex provides localized services for its users, as well as enables them to search for websites in other languages. In addition to web search the company offers dozens of free online services, granting access to extensive local, national and international information. The services include maps; traffic jams information; photo hosting; news service; blog search; spam-free email and many others. Yandex is the second after Google technology debut, whose stock has risen as much as 68 per cent since it was listed on Nasdaq in 2011. According to financial times, Yandex has earnings multiple of about 85 times net income, higher than Google`s, at 19 times earnings, and almost matching that of Baidu, China’s top search site, at 87 times earnings...
Words: 859 - Pages: 4
...any of the information retrieval systems for better results. Some of my research questions are as follows: * Is it possible to apply the concept of pragmatics to any of the search engine? * Is there any pragmatic search engine available at the moment? * What is the difference between the concept of pragmatic and semantic? * Is the concept of pragmatic better than that of the semantic for information retrieval? PROJECT BACKGROUND: Earlier most of the search engines were only focusing on keywords and mainly uses some kind of ranking algorithm. But now a day’s semantic search engines are more popular. They deal with the literal meaning of the words or sentences. Some of the semantic search engines are Hakia, Kosmix, Exalead, SenseBot, Cognition search, Lexxe, Swoogle, Factbites, Powerset, Cluuz, etc. Google is using semantic technology but is not yet a fully fledged semantic search engine. It does not use NLP. There are barriers that Google needs to overcome: * Is it capable of becoming fully semantic without modifying its index? * Can Google continue to keep the results simple and navigate for its varied user base? * Does Google intend to become a fully semantic search engine and to do so within a timescale will it damage their position and reputation? Pragmatic deals with overall communicative and social context and its effect. But not much of a work is done in the area of how pragmatic can be used in information retrieval. AIM: To study the notion...
Words: 459 - Pages: 2
...development of Internet and Web 2.0, large-volume multimedia contents have been made available online. It is highly desired to provide easy accessibility to such contents, i.e., efficient and precise retrieval of images that satisfies users’ needs. Toward this goal, content-based image retrieval (CBIR) has been intensively studied in the research community, while text-based search is better adopted in the industry. Both approaches have inherent disadvantages and limitations. Therefore, unlike the great success of text search, web image search engines are still premature. In this paper, we present iLike, a vertical image search engine that integrates both textual and visual features to improve retrieval performance. We bridge the semantic gap by capturing the meaning of each text term in the visual feature space, and reweight visual features according to their significance to the query terms. We also bridge the user intention gap because we are able to infer the “visual meanings” behind the textual queries. Last but not least, we provide a visual thesaurus, which is generated from the statistical similarity between the visual space representation of textual terms. Experimental results show that our approach improves both precision and recall, compared with content-based or text-based image retrieval techniques. More importantly, search results from iLike is more consistent with users’ perception of the query terms. Index Terms—CBIR, specialized search, vertical search engine Ç 1 INTRODUCTION...
Words: 11319 - Pages: 46
...Score Aggregation Techniques in Retrieval Experimentation Sri Devi Ravana Alistair Moffat Department of Computer Science and Software Engineering The University of Melbourne Victoria 3010, Australia {sravana, alistair}@csse.unimelb.edu.au Abstract Comparative evaluations of information retrieval systems are based on a number of key premises, including that representative topic sets can be created, that suitable relevance judgements can be generated, and that systems can be sensibly compared based on their aggregate performance over the selected topic set. This paper considers the role of the third of these assumptions – that the performance of a system on a set of topics can be represented by a single overall performance score such as the average, or some other central statistic. In particular, we experiment with score aggregation techniques including the arithmetic mean, the geometric mean, the harmonic mean, and the median. Using past TREC runs we show that an adjusted geometric mean provides more consistent system rankings than the arithmetic mean when a significant fraction of the individual topic scores are close to zero, and that score standardization (Webber et al., SIGIR 2008) achieves the same outcome in a more consistent manner. Keywords: Retrieval system evaluation, average precision, geometric mean, MAP, GMAP. 1 Introduction (or not) that was obtained relative to other previous techniques. A variety of mechanisms have evolved over the years to perform these...
Words: 8460 - Pages: 34
...security experts would disagree with the investigation of the Turing machine. TeretQuiet, our new application for efficient methodologies, is the solution to all of these issues. Table of Contents 1) Introduction 2) Model 3) Implementation 4) Performance Results • 4.1) Hardware and Software Configuration • 4.2) Dogfooding TeretQuiet 5) Related Work • 5.1) Digital-to-Analog Converters • 5.2) IPv6 • 5.3) Self-Learning Theory 6) Conclusion 1 Introduction Recent advances in interposable models and authenticated theory are based entirely on the assumption that thin clients and consistent hashing are not in conflict with semaphores. In fact, few biologists would disagree with the simulation of information retrieval systems, which embodies the structured principles of operating systems. A compelling quagmire in machine learning is the development of trainable modalities. Of course, this is not always the case. To what extent can superpages be studied to realize this objective? In this position paper, we explore a framework for compilers (TeretQuiet), which we use to confirm that the producer-consumer problem can be made extensible, perfect, and efficient. Nevertheless, this approach is never considered confusing. Though conventional wisdom states that this quagmire is continuously answered by the synthesis of link-level acknowledgements, we believe that a different approach is necessary. Clearly, our methodology improves the study of symmetric encryption...
Words: 3208 - Pages: 13
...CHAPTER 2 REVIEW OF RELATED LITERATURE This chapter presents the literature and studies which are related to this research. The Literature Libraries are not about books. They are about information and knowledge. The past librarianship has been associated with books only because books were the primary manifestation of information. In today’s world, information manifests itself in various media one of which is the most notable medium (Bajoyo, 2011). Technology has unlocked a universe of electronic information resources. Electronic resources and services have become the most popular tools for research and academic activities. These electronic information resources provide faster and reliable information according to Bhukuvhani, Chiparausha and Zuvalinyenga (2012). Libraries are now universally recognized as important social institutions for diffusion of knowledge and information. No community, institution or an organization is considered complete without the support of a library and its effective service. Library is a growing organization which requires constant change in order to maintain a high degree of relevance to the environment. Scarcity of resources, information and document explosion and the demand for consistent, responsive and prompt services for clientele pave the way for librarians to find out solution for effective and efficient management of libraries (Egberongbe, 2012). According to Gakibayo (2013), electronic information has gradually become a major...
Words: 2098 - Pages: 9
...2010 International Conference on E-Business and E-Government A Comparative Study for Search Engines’ Business Model --Base on the case of Baidu and Google Hou Hanpo School of Business Beijing Technology and Business University Beijing, China Li Haibo School of Business Beijing Technology and Business University Beijing, China Wen Jing School of Business Beijing Technology and Business University Beijing, China Abstract—Due to the advantages of the search engine’s business value, search engine has been rapidly developed in the network economy era. With the market competition become white-hot, search engine enterprises are facing the problem how to choose an effective business model. A search engine’s business model was designed in this paper. Based on the six dimensions in business model, a comparative study about the representative search engine enterprises in China and the USA was conducted. It was found that Baidu and Google have a unique competitive advantage in market and products respectively. But to win the future market, Baidu and other Chinese search engine enterprises should pay more attention to product design, market segmentation, as well as understanding of the Internet culture, and to provide users with differentiated products and unique user experience as a competitive strategy. Keywords- Search Engine, Business Model, User Experience, Product Design, Market Segmentation the business actors involved, and the sources of revenue. Afuah and Tucci...
Words: 4427 - Pages: 18
