information retrieval techniques problem solving task

Question 1:  (15 marks)

Suppose you have joined a search engine development team to design a search algorithm based on both the Vector model and the Boolean model. You have collected the following documents (unstructured) and plan to apply an index technique to convert them into an inverted index. 

Doc 1:Information retrieval is the activity of obtaining information resources relevant to an information need from a collection of information resources. Searches can be based on full-text or other content-based indexing.

Doc 2:Information retrieval is finding material of an unstructured nature that satisfies an information need from within large collections

Doc 3:Information systems is the study of complementary networks of hardware and software that people and organizations use to collect, filter, process, create, and distribute data. In the process of creating the inverted index, please complete the following steps: 

a. Remove all stop words and punctuation, and then apply Porter’s stemming algorithm to the documents. The list of stop words for this task is provided as follows: Is, The, Of, To, An, A, From, Can, Be, On, Or, That, Within, And, Use

b. Create a merged inverted list including the within-document frequencies for each term.

c. Use the index created in part (b) to create a dictionary and the related posting file. 

 d. You may like to test the inverted index by using the following keywords: information, system, index 

 e. Please design three Boolean queries, (for example, web AND search) and list the relevant documents for each query.

 f. Please use the Vector model to query on the inverted index, and compare the result with the Boolean model. (Hint: you can use cosine similarity and set a similarity threshold). Question 2 (IR Evaluation) (15 marks)

Question 2 (IR Evaluation) (15 marks) 

In this question, you are required to evaluate the performance of different search engines. 

 First, please find two search engines you are familiar with, such as Google, Bing, Yahoo!, etc. 

 Second, please choose one target from the following list, and design two queries to search in both search engines. So both query 1 and query 2 have to be tested in both search engines. 

 i. Target 1: obtain the course information for S779. 

 ii. Target 2: obtain the price of the new Samsung Tablet. 

 iii. Target 3: obtain the manual of installing tera term. 

 iv. Target 4: obtain the oracle SQL tutorial. 

 v. Target 5: obtain the price of new Xbox one. 

 Third, select the first 20 results in both search engines, if they return the target, then mark them as relevant documents, otherwise, they are irrelevant. Assume that you have 14 relevant documents in total (retrieved and not-retrieved). 

 The following questions are based on your search results. 

 

a) List your target, results and designed search queries (You can use any keywords you think are related to the target). 

 

Get the precision and recall values for 20 documents for query 1 in search engine 1. Interpolate them to 11 standard recall levels. Then plot them into a chart. 

 

Get the precision and recall values for 20 documents for query 2 in search engine 1. Interpolate them to 11 standard recall levels. Then plot them into the same chart as above. 

Now find the average precision of query 1 and query 2 for search engine 1 and plot it into the same chart.

So you will have total of 3 curves in one single chart. 

 

b) List your target, results and designed search queries 

 Get the precision and recall values for 20 documents for query 1 in search engine 2. Interpolate them to 11 standard recall levels. Then plot them into a chart. 

 Get the precision and recall values for 20 documents for query 2 in search engine 2. Interpolate them to 11 standard recall levels. Then plot them into the same chart as above. 

 

Now find the average precision of query 1 and query 2 for search engine 2 and plot it into the same chart. So, you will have total of 3 curves in one single chart, separate to that of part (a). Plot the averages for Search Engine 1 and Search Engine 2 on a separate chart, and compare the algorithms in terms of precision and recall. Which search engine do you think is superior? Why?

Order a unique copy of this paper
(550 words)

Approximate price: $22

Basic features
  • Free title page and bibliography
  • Unlimited revisions
  • Plagiarism-free guarantee
  • Money-back guarantee
  • 24/7 support
On-demand options
  • Writer’s samples
  • Part-by-part delivery
  • Overnight delivery
  • Copies of used sources
  • Expert Proofreading
Paper format
  • 275 words per page
  • 12 pt Arial/Times New Roman
  • Double line spacing
  • Any citation style (APA, MLA, Chicago/Turabian, Harvard)

Our guarantees

We value our customers and so we ensure that what we do is 100% original..
With us you are guaranteed of quality work done by our qualified experts.Your information and everything that you do with us is kept completely confidential.

Money-back guarantee

You have to be 100% sure of the quality of your product to give a money-back guarantee. This describes us perfectly. Make sure that this guarantee is totally transparent.

Read more

Zero-plagiarism guarantee

The Product ordered is guaranteed to be original. Orders are checked by the most advanced anti-plagiarism software in the market to assure that the Product is 100% original. The Company has a zero tolerance policy for plagiarism.

Read more

Free-revision policy

The Free Revision policy is a courtesy service that the Company provides to help ensure Customer’s total satisfaction with the completed Order. To receive free revision the Company requires that the Customer provide the request within fourteen (14) days from the first completion date and within a period of thirty (30) days for dissertations.

Read more

Privacy policy

The Company is committed to protect the privacy of the Customer and it will never resell or share any of Customer’s personal information, including credit card data, with any third party. All the online transactions are processed through the secure and reliable online payment systems.

Read more

Fair-cooperation guarantee

By placing an order with us, you agree to the service we provide. We will endear to do all that it takes to deliver a comprehensive paper as per your requirements. We also count on your cooperation to ensure that we deliver on this mandate.

Read more

Calculate the price of your order

550 words
We'll send you the first draft for approval by September 11, 2018 at 10:52 AM
Total price:
$26
The price is based on these factors:
Academic level
Number of pages
Urgency