Introduction
Design a project where you predict the cost of mobile phones using kafka, hbase, spark etc. Make the model more efficient and user friendly.Run oozie workflow schedular.
Data preview
Here is a preview of the smartphone dataset used in this project: Download the data from here stream_data.csv| # | Brand | Model | Display (in) | RAM (GB) | Storage (GB) | Cameras | SIM | Battery (mAh) | Discount | Rating | Seller | Seller Score | Reviews Count | Reviews |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | Tecno | Spark 10 Pro | 6.8 | 8.0 | 128.0 | 50MP + 2MP + 32MP | Dual | 5000.0 | 43% | 4.4 | Minestar | 86% | 1002 | No reviews |
| 1 | Infinix | Hot 30 Play | 6.82 | 8.0 | 128.0 | 16MP + 8MP | Dual | 6000.0 | 22% | 4.7 | Tech Traders | 86% | 722 | [ (5 out of 5) GOOD ], [ (5 out of 5) I like it ], [ (5 out of 5) Like it! ], [ (5 out of 5) phone ], [ (5 out of 5) I love it ], [ (5 out of 5) Awesome! ], [ (4 out of 5) The Phone is great. ], [ (5 out of 5) I like it. ], [ (4 out of 5) Nice camera! However, put up 50MP main camera ], [ (4 out of 5) Like it so far! ] |
| 2 | XIAOMI | Redmi A2 | 6.52 | 3.0 | 64.0 | 8MP + 5MP | Dual | 5000.0 | 28% | 3.8 | Xiaomi Ecco World - AC | 80% | 36 | [ (5 out of 5) I like it ], [ (4 out of 5) I like it ], [ (4 out of 5) I like it ], [ (4 out of 5) fare perfomance ], [ (1 out of 5) not worthy ], [ (2 out of 5) Slow Charging ], [ (5 out of 5) redmi A2+ ] |
| 3 | Tecno | Spark 10C | 6.6 | 4.0 | 128.0 | 16MP + 8MP | Dual | 5000.0 | 35% | 4.8 | Minestar | 86% | 1002 | [ (5 out of 5) It's a good product ], [ (4 out of 5) smart watch ], [ (5 out of 5) Cool ], [ (5 out of 5) product and service delivery ], [ (5 out of 5) I like it ], [ (5 out of 5) Very nice!! ], [ (5 out of 5) Techno spark 10 ] |
| 4 | Infinix | Smart 7 HD | 6.6 | 2.0 | 64.0 | 8MP + 5MP |
Requirement
. Use hdfs for storage. . Use kafka for streaming. . Use hbase for concurrent view. . Use PostgreSQL for stack view. . Use Power Bi for dashboards. . Run oozzie workflow schedular.
Implementation
1. Start hadoop cluster
We will start the hdfs using the hadoop start-up script.start-dfs.sh
start-yarn.sh
Frequently Asked Questions
How long are mentoring sessions?
Standard mentoring sessions are 60 minutes long. You can book multiple sessions if you need more time.
What is the cost of mentoring?
Mentoring rates vary by mentor. Most sessions range from $50-$150 per hour depending on the mentor's experience level.
How do sessions take place?
Sessions are conducted via video call. You'll receive a link after booking your session.
Can I cancel or reschedule?
Yes, you can reschedule or cancel up to 24 hours before your session without any penalty.