# MAPREDUCE, SIMILAR ITEMS AND DATA STREAMS

ASSESSMENT 1 – MAPREDUCE, SIMILAR ITEMS AND DATA STREAMS

Due: Week 2, Wednesday at 11.59 pm Weighting: 20%

# Purpose

The purpose of this assessment is to evaluate your learning and knowledge of using the MapReduce technique mentioned in Week 1, finding similar items and mining data streams.

## Exercise 1 – Friend Recommendation System (Stanford) (40 points)

• Write a MapReduce program in Spark (see Overview Module for download instructions) that implements a simple “People You Might Know” social network friendship recommendation algorithm.

The key idea is that if two people have a lot of mutual friends, then the system should recommend that they connect with each other.

## Input:

• ·       Download the input file from the link: http://snap.stanford.edu/class/ cs246- data/hw1q1.zip. The input file contains the adjacency list and has multiple lines in the following format: <User><TAB><Friends>
• ·       Here, <User> is a unique integer ID corresponding to a unique user, and <Friends> is a comma separated list of unique IDs corresponding to the friends of the user with the unique ID <User>.
• ·       Note that the friendships are mutual (i.e., edges are undirected): if A is friends with B then B is also friends with A. Algorithm: Let us use a simple algorithm such that, for each user U, the algorithm recommends N = 10 users who are not already friends with U, but have the greatest number of mutual friends in common with U.

## Output:

• The output should contain one line per user in the following format:

<User><TAB><Recommendations> where <User> is a unique ID corresponding to a user and <Recommendations> is a comma separated list of unique IDs corresponding to the algorithm’s recommendation of people that <User> might know, ordered in decreasing number of mutual friends.

• Even if a user has less than 10 second-degree friends, output all of them in decreasing order of the number of mutual friends.
• If there are recommended users with the same number of mutual friends, then output those user IDs in numerically ascending order.
• Also, please provide a description of how you are going to use MapReduce jobs to solve this problem. Do not write more than 3 to 4 sentences for this: only a very high- level description of your strategy to tackle this problem.

• Include in your writeup a short paragraph describing your algorithm to tackle this problem.
• Include in your writeup the recommendations for the users with following user IDs: 924, 8941, 8942, 9019, 9020, 9021, 9022, 9990, 9992, 9993.

## Exercise 2 S-curve (exercise 3.4.1 in Leskovec, Rajaraman and Ullman) (7+7+7 points)

Evaluate the S-curve 1 − (1 − sr)b for s = 0.1, 0.2, . . ., 0.9, for the following values of r and b;

• r=3 and b=10.
• r=6 and b=20.
• r=5 and b=50.

## Exercise 3 Filtering Streams (similar to Exercises of 4.3 in Leskovec, Rajaraman and Ullman) (10 + 10 points)

1. For the situation of the running example of Section 4.3.1 in Leskovec, Rajaraman and Ullman with changed conditions (10 billion bits, 2 billion members of the set S).

Calculate the false-positive rate when using three hash functions. Do the same for four hash functions.

• As a function of n, the number of bits and m the number of members in the set S, what number of hash functions minimizes the false-positive rate?

Reference:

Leskovec, J., Rajaraman, A. and Ullman, J.D., 2020. Mining of massive data sets. Cambridge university press.

# Requirements

• You must submit your assessment using the relevant portal in MyUni/Canvas.
• All written assessments (excluding quizzes) must be submitted using a text document e.g., doc, docx, pdf via the link at the top of the page.
• Consult the assessment rubric when preparing your submission.
• Questions can be posted to the relevant assessment Discussion Board.

This assessment is worth 20% of your overall grade. Refer to the attached rubric for detailed information on the grading criteria for this assessment.

Get expert help for SIMILAR ITEMS AND DATA STREAMS and many more. 24X7 help, plag free solution. Order online now!

Universal Assignment (June 14, 2024) MAPREDUCE, SIMILAR ITEMS AND DATA STREAMS. Retrieved from https://universalassignment.com/mapreduce-similar-items-and-data-streams/.
"MAPREDUCE, SIMILAR ITEMS AND DATA STREAMS." Universal Assignment - June 14, 2024, https://universalassignment.com/mapreduce-similar-items-and-data-streams/
Universal Assignment March 12, 2023 MAPREDUCE, SIMILAR ITEMS AND DATA STREAMS., viewed June 14, 2024,<https://universalassignment.com/mapreduce-similar-items-and-data-streams/>
Universal Assignment - MAPREDUCE, SIMILAR ITEMS AND DATA STREAMS. [Internet]. [Accessed June 14, 2024]. Available from: https://universalassignment.com/mapreduce-similar-items-and-data-streams/
"MAPREDUCE, SIMILAR ITEMS AND DATA STREAMS." Universal Assignment - Accessed June 14, 2024. https://universalassignment.com/mapreduce-similar-items-and-data-streams/
"MAPREDUCE, SIMILAR ITEMS AND DATA STREAMS." Universal Assignment [Online]. Available: https://universalassignment.com/mapreduce-similar-items-and-data-streams/. [Accessed: June 14, 2024]

## Please note along with our service, we will provide you with the following deliverables:

Please do not hesitate to put forward any queries regarding the service provision.

We look forward to having you on board with us.

# Get 90%* Discount on Assignment Help

### Most Frequent Questions & Answers

Universal Assignment Services is the best place to get help in your all kind of assignment help. We have 172+ experts available, who can help you to get HD+ grades. We also provide Free Plag report, Free Revisions,Best Price in the industry guaranteed.

We provide all kinds of assignmednt help, Report writing, Essay Writing, Dissertations, Thesis writing, Research Proposal, Research Report, Home work help, Question Answers help, Case studies, mathematical and Statistical tasks, Website development, Android application, Resume/CV writing, SOP(Statement of Purpose) Writing, Blog/Article, Poster making and so on.

We are available round the clock, 24X7, 365 days. You can appach us to our Whatsapp number +1 (613)778 8542 or email to info@universalassignment.com . We provide Free revision policy, if you need and revisions to be done on the task, we will do the same for you as soon as possible.

We provide services mainly to all major institutes and Universities in Australia, Canada, China, Malaysia, India, South Africa, New Zealand, Singapore, the United Arab Emirates, the United Kingdom, and the United States.

We provide lucrative discounts from 28% to 70% as per the wordcount, Technicality, Deadline and the number of your previous assignments done with us.

After your assignment request our team will check and update you the best suitable service for you alongwith the charges for the task. After confirmation and payment team will start the work and provide the task as per the deadline.

Yes, we will provide Plagirism free task and a free turnitin report along with the task without any extra cost.

No, if the main requirement is same, you don’t have to pay any additional amount. But it there is a additional requirement, then you have to pay the balance amount in order to get the revised solution.

The Fees are as minimum as \$10 per page(1 page=250 words) and in case of a big task, we provide huge discounts.

We accept all the major Credit and Debit Cards for the payment. We do accept Paypal also.

### ARCH7004: Planning and Development Control Assessment 3

Assessment 3: Choose a particular type of commercial, industrial or high-rise development (Class 2-9 building) or subdivision that is currently being considered by a Consent Authority such as a Local Council (court or tribunal) or a State or Federal Government Agency (this may be the site from Assessment 2). Once

### Promote Person-Centred Approaches in Care Settings:

Remember when you are answering the questions to look at the command words and here is what each of these mean within the questions, below is a table with the meanings of some of the operative words you will see in this unit. Describe Give a clear description that includes

### Promote Health, Safety and Wellbeing in Care Settings:

Remember when you are answering the questions to look at the command words and here is what each of these mean within the questions, below is a table with the meanings of some of the operative words you will see in this unit. Describe Give a clear description that includes

### Promote equality and inclusion in Care settings:

Remember when you are answering the questions to look at the command words and here is what each of these mean within the questions, below is a table with the meanings of some of the operative words you will see in this unit. Describe Give a clear description that includes

### Physical Activity, Health and Wellbeing Assignment

Bsc Public Health and Health Promotion (Top up) June 23 Intake,  LONDON          Physical Activity, Health and Wellbeing Assignment Brief.                  Assessment 1: Poster Design and written presentation of a physical activity intervention (weighted at 20%). 800 words Your aim is to create an intervention that ‘nudges’ students and staff

### Marco studied all evening for a chemistry test scheduled for the following morning

The title of the essay is exactly like this: Center of the page: WEEKLY ESSAY 2) MUST include 500 words ONLY not any more words or less. If you include any content that is NOT in your own words and fail to include appropriate citations, you will receive a zero.

### Innovation Proposal | Part 1 – Feasibility and Sustainability of Innovation

SUMMARY AMAZON Launching a new innovation will always include some level of inherent risk. Failed attempts at innovation can be costly. For this reason, it is important to assess the viability and risk of the innovation.  Get solved or fresh solution on Part 1 – Feasibility and Sustainability of Innovation

### Innovation Proposal | Part 2 – Execution and Change Plan

Instructions:  Part 2 Research indicates that the execution and implementation of innovation is the greatest challenge for leaders. Generating ideas is deemed exciting while implementing change is considered the biggest challenge, which often results in organizational resistance. REQUIREMENTS Top of Form Bottom of Form Submission status Grading criteria Implementation Schedule,

### Innovation Proposal | Part 3 – Leadership Reflection and Application

Instructions  Part 3  REQUIREMENTS Top of Form Bottom of Form Submission status Grading criteria Analysis (see rubric in syllabus for evaluation guidelines) Beginning (0-55); Developing (56-63); Accomplished (64-71); Exemplary (72-80) Fully developed introspective analysis of how innovation impacts personal leadership. Thoroughly examines the influence of personal faith worldview on pursuing

### EDUCATORS INQUIRING ABOUT THE WORLD

EDUCATORS INQUIRING ABOUT THE WORLD     ASSESSMENT 1 PROPOSAL PLAN (FORMATIVE) TEMPLATE (20 marks)  Complete the proposal under the following headings as they provide guidelines for the overall format and contents of the proposal.   DECLARATION: By submitting this assessment I declare the following  Remove ALL Blue Writing before submission. Leave

### Heike’s older brother suffers from a major depressive disorder- Assignment

1) The title of the essay is exactly like this:CHAPTER 8 please Center of the page: WEEKLY ESSAY 2) MUST include 500 words ONLY not any more words or less. If you include any content that is NOT in your own words and fail to include appropriate citations, you will

### Introduction to Sociology

Measurable Objectives Week 7 Materials The materials for the week address the issue of Crime & Deviance. Crime and Deviance are not the same!                                                                                      Crime is a violation of law (local, State, or federal laws).                                                                      Crime is a social construct. Crime is a product of someone’s reality. Deviance Deviance is

### MBA623 Healthcare Management: Technology Analysis

Assessment 3 Information Subject Code: MBA623 Subject Name: Healthcare Management Assessment Title Technology Analysis Assessment Type: Length: Individual video recording 10 minutes maximum Weighting: 30% Total Marks: Submission: 100 Online Due Date: Week 13 Your task Individually, you are required to record a 10-minute webinar discussing My Health Record’s role

### ARCH7004: Planning and Development Control Assessment 4

Assessment 4: Due on: 14 June 2024 NSW Students: The NSW Coast is considered of great importance in terms of its protection, conservation and development opportunities for the State. Describe the elements on the NSW Coastal Management Framework and the key aspects for development control within the State? What is

### EDM9780M CEEL Summative Assignment 2023-2024

Below you will find instructions on completing each of the four parts of your final summative assignment. Part 1 – Personal/professional area of interest in education (1000 – 1,500 words max) For this part of the assignment, you will need to: How to complete this part (Part 1): 1. Choose

Instructions:  Requirements

### CI 596 Materials Analysis and Design for TESOL

Final Assignment Assignment Questions Choose one of the following: Get expert help for CI 596 Materials Analysis and Design for TESOL and many more. 24X7 help, plag free solution. Order online now!

### AT1 PREPARATION REFLECTION TEMPLATE

Weighting: 5 marks (10%) of the assignment. COMPLETE & SUBMIT INDIVIDUALLY. This is the second of THREE documents required for submission for the assignment. Complete the following, describing and reflecting upon your involvement with the preparation for the Group Presentation, including your interaction with other members of your team in

### SUMMATIVE ASSIGNMENT – Mathematics for Science

IMPORTANT INFORMATION 1 Electric power is widely used in industrial, commercial and consumer applications. The latter include laboratory equipment for example water baths, spectrophotometers, and chromatographs. If you have 17.3 kA and 5.5 MV, what is the power? Give the appropriate unit.                                                                                                               (3 marks) 2 Oil immersion objective lenses

### Assignment CW 2. Foundations of Biology

The instructions in RED are the ones which are mark-bearing and need to be answered as part of the assignment. The instructions in BLACK tell you how to carry out the simulation Diffusion simulation: Results table Use Excel to calculate the mean and standard deviation. The functions are AVERGAGE and

### Assignment: Implement five dangerous software errors

Due: Monday, 6 May 2024, 3:00 PM The requirements for assessment 1: Too many developers are prioritising functionality and performance over security. Either that, or they just don’t come from a security background, so they don’t have security in mind when they are developing the application, therefore leaving the business

### LNDN08003 DATA ANALYTICS FINAL PROJECT

Business School                                                                 London campus Session 2023-24                                                                   Trimester 2 Module Code: LNDN08003 DATA ANALYTICS FINAL PROJECT Due Date: 12th APRIL 2024 Answer ALL questions. LNDN08003–Data Analytics Group Empirical Research Project Question 2-The project (2500 maximum word limit) The datasets for this assignment should be downloaded from the World Development Indicators (WDI)

### Microprocessor Based Systems: Embedded Burglar Alarm System

ASSIGNMENT BRIEF 2023/24 Microprocessor Based Systems   Embedded Burglar Alarm System Learning Outcomes This assignment achieves the following learning outcomes:   LO 2 -Use software for developing embedded systems in ‘C’ and testing microcontroller systems including the use of design tools such as Integrated Development Environments and In Circuit Debugger.

### Imagine you are an IT professional and your manager asked you to give a presentation about various financial tools used to help with decisions for investing in IT and/or security

Part 1, scenario: Imagine you are an IT professional and your manager asked you to give a presentation about various financial tools used to help with decisions for investing in IT and/or security. The presentation will be given to entry-level IT and security employees to understand financial investing. To simulate

### DX5600 Digital Artefact and Research Report

COLLEGE OF ENGINEERING, DESIGN AND PHYSICAL SCIENCES BRUNEL DESIGN SCHOOL DIGITAL MEDIA MSC DIGITAL DESIGN AND BRANDING MSC DIGITAL DESIGN (3D ANIMTION) MSC DIGITAL DESIGN (MOTION GRAPHICS) MSC DIGITAL DESIGN (IMMERSIVE MIXED REALITY) DIGITAL ARTEFACT AND RESEARCH REPORT                                                                 Module Code: DX5600 Module Title: MSc Dissertation Module Leader: XXXXXXXXXXXXXXXXX Assessment Title:

### 6HW109 Environmental Management and Sustainable Health

ASSESSMENT BRIEF MODULE CODE: 6HW109 MODULE TITLE: Environmental Management and Sustainable Health MODULE LEADER: XXXXXXXXX ACADEMIC YEAR: 2022-23 1        Demonstrate a critical awareness of the concept of Environmental Management linked to Health 2        Critically analyse climate change and health public policies. 3        Demonstrate a critical awareness of the concept of

### PROFESSIONAL SECURE NETWORKS COCS71196

PROFESSIONAL SECURE NETWORKS– Case Study Assessment Information Module Title: PROFESSIONAL SECURE NETWORKS   Module Code: COCS71196 Submission Deadline: 10th May 2024 by 3:30pm Instructions to candidates This assignment is one of two parts of the formal assessment for COCS71196 and is therefore compulsory. The assignment is weighted at 50% of