Web_scraping
Web Scraping¶
In this notebook, we will investigate how we can scrap amazon.com for information about the top 100 book releases and poloneix for ethereum USD price history.
Copyright By PowCoder代写 加微信 powcoder
Install necessary libraries¶
#!pip install numpy
#!pip install pandas
#!pip install bs4
#!pip install ast
#!pip install matplotlib
#!pip install lxml
Import necessary libraries¶
import numpy as np
import pandas as pd
import matplotlib.pyplot as plt
import urllib
from bs4 import BeautifulSoup
import datetime
import ast
import csv
import requests
from IPython.display import HTML
%matplotlib inline
Amazon Books Web Scrapping¶
Here we will scrape the following website: https://www.amazon.ca/gp/new-releases/books
to find the top 100 books plus relevant information.
HTML(‘https://www.amazon.ca/gp/new-releases/books’)
Skip to main content
Select your address
Select the department you want to search in
All Departments
Alexa Skills
Amazon Devices
Amazon Warehouse Deals
Apps & Games
Audible Audiobooks
Automotive
Clothing, Shoes & Jewelry
Electronics
Gift Cards
Health & Personal Care
Home & Kitchen
Industrial & Scientific
Kindle Store
Luggage & Travel Gear
Luxury Beauty
Movies & TV
Musical Instruments, Stage & Studio
Office Products
Patio, Lawn & Garden
Pet Supplies
Prime Video
Smart Home
Sports & Outdoors
Subscribe & Save
Tools & Home Improvement
Toys & Games
Video Games
Hello, Sign in
Account & Lists
Deals Store
Customer Service
Gift Ideas
Electronics
Toys & Games
Gift Cards
Health & Household
Computer & Video Games
Automotive
Sports & Outdoors
Pet Supplies
Beauty & Personal Care
Home Improvement
Subscribe & save
Advanced Search
Today’s Deals
Amazon Charts
The Globe & Mail
New York Times
of the Month
Children’s Books
Audible Audiobooks
Livres en français
Amazon Hot
Our best-selling new and future releases. Updated hourly.
Hot in Books
Weight Loss by Gina – Winter 2022 Program: Posts and Guidelines
4.8 out of 5 stars
Reminders of Him: A Novel
The Maid: A Novel
4.3 out of 5 stars
The Betrayal of : A Cold Case Investigation
Rosemary Sullivan
The Wings of Fire: The Brightest Night: A Graphic Novel (Wings of Fire Graphic Novel #5)
Tui T. Sutherland
4.7 out of 5 stars
PlantYou: 140+ Ridiculously Easy, Amazingly Delicious Plant-Based Oil-Free Recipes
Half Baked Harvest Every Day: Recipes for Balanced, Flexible, Feel-Good Meals: A Cookbook
Things I Should Have Said
The Office BFFs: Tales of The Office from Two Best Friends Who Were There
HWPO: Hard Work Pays Off
Mat Fraser
4.3 out of 5 stars
The Rose Oracle: A 44-Card Deck and Guidebook
Rebecca Campbell
House of Sky and Breath
Behind These Walls: A look inside one of the deadliest Covid outbreaks in Canadian long term care homes
4.4 out of 5 stars
: The Guided Path from Trauma to Profound Freedom and Inner Peace
Enough Already: Learning to Love the Way I Am Today
To Paradise: A Novel
4.0 out of 5 stars
Why Has Nobody Told Me This Before?
5.0 out of 5 stars
Something to Hide: A Lynley Novel
Elizabeth George
4.4 out of 5 stars
American Muckraker: Rethinking Journalism for the 21st Century
Balance: How to Invest and Spend for Happiness, Health, and Wealth
Good-bye Stacey, Good-bye: A Graphic Novel (The Baby-sitters Club #11) (Adapted edition)
Beatrice and Croc Harry
How to Begin: Start Doing Something That Matters
4.6 out of 5 stars
Healing Through Yoga: Transform Loss into Empowerment – With More Than 75 Yoga Poses and Meditations
Invisible: A Novel
4.6 out of 5 stars
The Fourth Closet: An AFK Book (Five Nights at Freddy’s Graphic Novel #3)
4.9 out of 5 stars
Greenlights: Your Journal, Your Journey
4.8 out of 5 stars
The Carnivore Code Cookbook: Reclaim Your Health, Strength, and Vitality with 100+ Delicious Recipes
The School for Good Mothers: A Novel
3.9 out of 5 stars
Demon Slayer: Kimetsu no Yaiba–Stories of Water and Flame
Ryoji Hirano
4.7 out of 5 stars
The Horsewoman
4.4 out of 5 stars
Tell Yourself a Better Lie: Use the power of Rapid Transformational Therapy to edit your story and rewrite your life.
Marisa Peer
4.6 out of 5 stars
The Comfortable Kitchen: 105 Laid-Back, Healthy, and Wholesome Recipes
4.8 out of 5 stars
Bitcoin Widow: Love, Betrayal and the Missing Millions
The 17 Day Kickstart Diet: A Doctor’s Plan for , Toxins, and Bad Habits
4.5 out of 5 stars
L’Équilibriste: Performez grâce à votre créativité
Mass Market Paperback
Bloom of the Flower Dragon: A Branches Book (Dragon Masters #21)
A Clockwork Reader Reading Journal
Hannah Azerang
4.9 out of 5 stars
The Great Reset: and the Rise of Twenty-First-Century Fascism
4.6 out of 5 stars
1 offer from $56.99
Chainsaw Man, Vol. 9 (Volume 9)
Unthinkable: Trauma, Truth, and the Trials of American Democracy
4.8 out of 5 stars
Still Life
4.5 out of 5 stars
The Next Civil War: Dispatches from the American Future
3.9 out of 5 stars
Ignite the Fire: Inferno
Heaven Official’s Blessing: Ci Fu (Novel) Vol. 2
The Simple Comforts Step-by-Step Instant Pot Cookbook: The Easiest and Most Satisfying Comfort Food Ever ― With Photographs of Every Step
The War of Two Queens
. Armentrout
Undo It!: How Simple Lifestyle Changes Can Reverse Most Chronic Diseases
Dean Ornish M.D.
4.4 out of 5 stars
The Fiber Fueled Cookbook: Inspiring Plant-Based Recipes to Turbocharge Your Health
Will Bulsiewicz MD
Cobalt: Cradle of the Demon Metals, Birth of a Mining Superpower
←Previous Page
Next page→
Bestsellers Archive
Movers & Shakers
Any Department
Arts & Photography
Biographies & Memoirs
Business & Investing
Children’s Books
Christian Books & Bibles
Comics & Graphic Novels
Computers & Technology
Cookbooks, Food & Wine
Crafts, Hobbies & Home
Education & Reference
French Books
Health, Fitness & Dieting
Humour & Entertainment
Literature & Fiction
Medical Books
Mystery, Thriller & Suspense
Parenting & Relationships
Politics & Social Sciences
Professional & Technical
Religion & Spirituality
Science & Math
Science Fiction & Fantasy
Sports & Outdoors
Teen & Young Adult
Back to top
Get to Know Us
Amazon and Our Planet
Investor Relations
Press Releases
Make Money with Us
Sell on Amazon
Amazon Associates
Sell on Amazon Handmade
Advertise Your Products
Independently Publish with Us
Host an Amazon Hub
Amazon Payment Products
Amazon.ca Rewards Mastercard
Shop with Points
Reload Your Balance
Amazon Currency Converter
Gift Cards
Amazon Cash
Let Us Help You
COVID-19 and Amazon
Shipping Rates & Policies
Amazon Prime
Returns Are Easy
Manage your Content and Devices
Customer Service
EnglishChoose a language for shopping.
CanadaChoose a country/region for shopping.
Amazon Music
Stream millions
of songs Amazon Advertising
Find, attract, and
engage customers Amazon Drive
Cloud storage
from Amazon Amazon Web Services
Scalable Cloud
Computing Services Book Depository
Books With Free
Delivery Worldwide
Book reviews
& recommendations IMDb
Movies, TV
& Celebrities Amazon Photos
Unlimited Photo Storage
Free With Prime Shopbop
Fashion Brands Warehouse Deals
Whole Foods Market
We Believe in
Real Food Amazon Renewed
Like-new products
you can trust Blink
Smart Security
for Every Home
Conditions of Use
Privacy Notice
Interest-Based Ads
© 1996-2022, Amazon.com, Inc. or its affiliates
Open URL and read the contents¶
headers = {“User-Agent”:”Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:66.0) Gecko/20100101 Firefox/66.0″, “Accept-Encoding”:”gzip, deflate”, “Accept”:”text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8″, “DNT”:”1″,”Connection”:”close”, “Upgrade-Insecure-Requests”:”1″}
r = requests.get(‘https://www.amazon.ca/gp/new-releases/books’, headers=headers)
content = r.content
print (content[0:1000])
b’\n
\n\n\n\n\n\n\n\n\n\n