(爬)周末假日爬個ETtoday旅遊云
(爬)周末假日爬個ETtoday旅遊云
難易度—＜＊＞
好像沒去過綠島 ，年底了雖然無法出去，但爬個綠島的資訊
了解一下，以便明年安排去綠島三日遊。
今天想爬的目標是ETtoday旅遊云
上面網址的最後page=1這個就是可以換頁，所以可以加
個迴圈來爬取多頁的資訊
想爬取旅遊云的目標如下紅圈
紅圈下方的長條紅圈是頁數
觀察一下網頁結構
紅圈裡的就是我要爬取的主要的點
程式碼
import requests
from bs4 import BeautifulSoup
for i in range(1,4):
print("第%d頁..."%i)
url='https://travel.ettoday.net/category/綠島/?&page='+str(i)
html=requests.get(url)
soup=BeautifulSoup(html.text, 'html.parser')
t=soup.find_all('h3', itemprop='headline')
for i in t:
title=i.find('a')
url=i.a['href']
print(title.getText())
if url.startswith('https://'):
print(url)
結果如下：
PS D:\python> & "C:/Program Files (x86)/python3.9.0/python.exe" d:/python/treavl.py
第1頁...
小白屋秘境拍「天然畫框」！綠島私房景點 ..
https://travel.ettoday.net/article/1819901.htm
玻璃海中悠游！特搜綠島必去10大景點 公..
https://travel.ettoday.net/article/1797581.htm
「台版非洲大草原」隱身綠島！湛藍大海在眼..
https://travel.ettoday.net/article/1741905.htm
窗外整片漸層藍海！綠島私房無敵海景民宿 秘密小徑通往私人沙灘
https://travel.ettoday.net/article/1715624.htm
10分鐘就攻頂！全台4條「台版萬里長城」步道 360度看陰陽海、綠色山林
https://travel.ettoday.net/article/1707510.htm
防疫情擴大！228連假起 體溫高於37.5度禁止搭船去綠島、蘭嶼
https://travel.ettoday.net/article/1655573.htm
360度看山海！全台3條「台版萬里長城」步道 每個轉身都是明信片美景
https://travel.ettoday.net/article/1565970.htm
入口幸福加倍！綠島靠「神秘聘禮」娶回美嬌娘 製作前還得先拜拜
https://travel.ettoday.net/article/1495919.htm
影／輕颱「丹娜絲」來了！台東－蘭嶼往返航班7/17、18整天停駛
https://travel.ettoday.net/article/1491298.htm
第2頁...
來趟生態旅遊！綠島深度5玩法 護蟹任務、..
https://travel.ettoday.net/article/1470482.htm
「流麻溝15號」曾是他們共同戶籍 201..
https://travel.ettoday.net/article/1466005.htm
綠島這樣玩！交通、景點、美食懶人包 柴口..
https://travel.ettoday.net/article/1450044.htm
尋找天空之鏡！盤點綠島必訪「9大景點」 泡溫泉還能看日出
https://travel.ettoday.net/article/1431460.htm
綠島也看得到熱氣球！2019台東熱氣球嘉年華8場光雕音樂會揭曉
https://travel.ettoday.net/article/1441867.htm
台灣好行新套票 台東公車搭到飽、還附綠島蘭嶼來回船票
https://travel.ettoday.net/article/1293043.htm
曾一天輾斃2000隻！綠島歡迎遊客「保護蟹媽媽過馬路」
https://travel.ettoday.net/article/1250277.htm
減少垃圾、保護大海！自備容器玩綠島 15地點免費加水
https://travel.ettoday.net/article/1231752.htm
綠島必遊6打卡點！尋找綠島天空之鏡、小長城
https://travel.ettoday.net/article/1178863.htm
第3頁...
今夏最棒的玩水體驗！全台必去2大「海底郵..
https://travel.ettoday.net/article/1164906.htm
世界最美百大潛點！綠島「豆丁海馬海底郵筒..
https://travel.ettoday.net/article/1164667.htm
跟進長灘島？台灣3大離島擬實施遊客「總量..
https://travel.ettoday.net/article/1164474.htm
不只能打卡！綠島「豆丁海馬海底郵筒」能讓海洋變乾淨
https://travel.ettoday.net/article/1164222.htm
世界最深！海下11米 綠島「豆丁海馬海底郵筒」正式啟用
https://travel.ettoday.net/article/1163418.htm
來自世界最深的祝福！綠島「豆丁海馬海底郵筒」5/4啟用
https://travel.ettoday.net/article/1160541.htm
綠島蘭嶼自由行懶人包！整理景點、美食和交通資訊
https://travel.ettoday.net/article/1157890.htm
綠島秘境賞火燒雲、療癒夕陽！海岸線石礁合拍異國景緻
https://travel.ettoday.net/article/1002346.htm
綠島柚子湖不是湖 礁岩、藍洞猶如踏進「神秘異世界」
https://travel.ettoday.net/article/986260.htm
留言
張貼留言