Module 1
Concise overview of things learned: Technical area: • Set up the Google Colab Environment
• Set up the New local test Environment
• Learned Basics of Machine learning
• Learned Definition of Classification
• Learned the basic of Logistic regression model
• Learned Basics of NLP(by reading PDF)
• Learned Web Scrapping(Selenium, Chrome driver, and beautiful soup)
• Tools: Beautiful Soap, Selenium, Chrome driver, Github, Jupyter Notebook, Python
• Softskills: Learned about Project Management
Achievement highlights: Successfully set up a new test environment for the project Successfully use the tools selenium and Beautiful Soup to get data from the website.https://www.discoursehub.com/
Detailed Statement of Tasks Completed: 1 Use selenium and chrome driver to auto click the website 2 Locate to the section of the e-commerce 3 Use beautiful soup to collect data from the page. The data are the topic of the latest review of the e-commerce section.
Module 3
Technical
- World Cloud
- Logistic regression model
- Random Forest Model
- Xgboost Model
- Recommender
Tools
jupyter notebook ,word2Vec
Achievement
understanding the new python package word2vec
Successfully build three models
Challenge
The Accuracy of three models are not so good
Module 4
Technical
- Bert classification Model
- Simple Transformers Library
- Compare the various model results such as Bert and Random Forest
Tools
- Simple Transformer
- Torch
- Sklearn
- Tokenizers
Achievement
Successful built Bert Classification Model
Challenge
Did not build a ML app
Module 1
Concise overview of things learned:
Technical area: • Set up the Google Colab Environment
• Set up the New local test Environment
• Learned Basics of Machine learning
• Learned Definition of Classification
• Learned the basic of Logistic regression model
• Learned Basics of NLP(by reading PDF)
• Learned Web Scrapping(Selenium, Chrome driver, and beautiful soup)
• Tools: Beautiful Soap, Selenium, Chrome driver, Github, Jupyter Notebook, Python
• Softskills: Learned about Project Management
Achievement highlights: Successfully set up a new test environment for the project Successfully use the tools selenium and Beautiful Soup to get data from the website.https://www.discoursehub.com/
Detailed Statement of Tasks Completed: 1 Use selenium and chrome driver to auto click the website 2 Locate to the section of the e-commerce 3 Use beautiful soup to collect data from the page. The data are the topic of the latest review of the e-commerce section.