BIG DATA ARCHITECTURE
(FALL 2019) Term Project Version 28 September 2019
1 Objectives Develop a Big Data application using microservice architecture and deploy them on a Platform as a Service (PaaS). Your job is not only to build microservice and serverless applications but also to integrate them into a single distributed application that can be useful for your users.
2 Prerequisites Your application must use the following big data technology:
Hadoop Distributed File System (HDFS) MongoDB
Your application must use the following datasets:
Go here http://stat-computing.org/dataexpo/2009/the-data.html and download the airline on-time performance data from 1996 through 2006 (11 files/years in total). Hint: Make sure your application works with data from 2000 through 2002 first (3 years). Then, you should try with 5 years, 7 years, 9 years, and finally 11 years. The reason is that your machine may not be able to compute all 11 years in one scoop.
Store these files into your Hadoop system.
Go here http://stat-computing.org/dataexpo/2009/supplemental-data.html to download the following datasets:
Airports
CISC-525 Term Project Fall 2019 Carriers
Planes Process and store the content of these file into a MongoDB.
You are to develop the following software components, then integrate them using RESTful APIs:
1. Airport Locating Service
2. Carrier Identification Service
3. Plane Information Service
4. Airline On-time Performance Service
5. Weather Serverless Service
You are to provide a website or a simple console application that allow the user to use your service. For example, if I want to find to know the city that is identified by iata code 00M, I should be able to enter the 00M in a text field, the I should see Thigpen, Bay Springs, USA. In other words, develop a client application that integrate all the services.Java Term Project








Recent Comments