网络爬虫是通过什么方式来寻找网络上的信息的呢
通俗来讲，网络蜘蛛是通过网页的链接地址来寻找网页的。从网站某一个页面（通常是首页）开始，读取网页的内容，找到在网页中的其它链接地址，然后通过这些链接地址寻找下一个网页，这样不断循环，不断读取网上的信息，直到把这个网站所有的网页都抓取完为止。这样看来，网络爬虫就是一个爬行程序，一个抓取网页的程序。
为了进行淘宝的API开发，首先我们需要做下面几件事情。
注册地址
1）开发者注册一个账号，
2）然后为每个淘宝应用注册一个应用程序键（App Key) 。
3）下载淘宝API的SDK并掌握基本的API基础知识和调用，具体可以参考论坛的信息（http://dev./bbs/forum.php ）里面的技术分享区等。
4）利用SDK接口和对象，传入AppKey或者必要的时候获取并传入SessionKey来进行程序开发。
5）利用淘宝平台的文档中心和API测试工具，对接口进行测试。从而了解返回信息，方便程序获取。
以上是一般淘宝API应用开发的关键流程，其中通过淘宝文档中心和API测试工具，进行概念了解和接口信息查询很重要。因为这些数据就是我们需要在逐步显示出来的。淘宝的API很多，不过都分为了好几个领域，慢慢就会了解深入了。
然后我们也可以通过淘宝平台的API测试工具来了解返回的数据信息，每个淘宝API最下面一般都有一个API工具的内容，如下所示。其中我们选择【API Tools在线测试工具】就可以测试返回的接口数据了。
item_get - 获得淘宝商品详情
获取Key和secret
请求参数
请求参数：num_iid=520813250866&is_promotion=1
参数说明：num_iid:淘宝商品ID
is_promotion:是否获取取促销价
响应示例
Request address:
https://api-/taobao/item_get/?key=&
&num_iid=667746579912&is_promotion=1&&lang=zh-CN&secret=
---------------------------------------
Result Object:
---------------------------------------
{
"item": {
"num_iid": "667746579912",
"title": "【新品】ALIENWARE外星人x14 R1高端轻薄全能本笔记本电脑12代酷睿i7设计师办公商务便携学生七夕送礼物",
"desc_short": "",
"price": "10969",
"orginal_price": "11999.00",
"nick": "alienware外星人旗舰店",
"num": "200",
"pic_url": "///imgextra/i1/2510050218/O1CN011N3gnO1DTt75QnvFm_!!2-item_pic.png",
"brand": "alienware",
"brandId": "123574",
"rootCatId": "1101",
"cid": "1101",
"crumbs": [],
"detail_url": "/item.htm?id=667746579912",
"desc": "<p><img src=\"/imgextra/i2/2510050218/O1CN0126IHje1DTt74HZYLv_!!2510050218.jpg\" align=\"absmiddle\" /><img src=\"/imgextra/i3/2510050218/O1CN016AZ5YM1DTt6H3dxsX_!!2510050218.jpg\" align=\"absmiddle\" /><img src=\"/imgextra/i4/2510050218/O1CN01RacBbj1DTt70NBQXt_!!2510050218.jpg\" align=\"absmiddle\" /><img src=\"/imgextra/i1/2510050218/O1CN01tWe5zN1DTt75HxDoE_!!2510050218.jpg\" align=\"absmiddle\" /><img src=\"/imgextra/i4/2510050218/O1CN01LdyQCe1DTt73XPrjR_!!2510050218.jpg\" align=\"absmiddle\" /><img src=\"/imgextra/i1/2510050218/O1CN01EiKHhz1DTt73XO3W0_!!2510050218.jpg\" align=\"absmiddle\" /><img src=\"/imgextra/i4/2510050218/O1CN01CH3wit1DTt7CrFxkF_!!2510050218.jpg\" align=\"absmiddle\" /><img src=\"/imgextra/i3/2510050218/O1CN01ScPDM51DTt73XScKj_!!2510050218.jpg\" align=\"absmiddle\" /><img src=\"/imgextra/i3/2510050218/O1CN01wdNlfI1DTt78qPjIS_!!2510050218.jpg\" align=\"absmiddle\" /><img src=\"/imgextra/i4/2510050218/O1CN01JW6X1a1DTt718ABoY_!!2510050218.jpg\" align=\"absmiddle\" /><img src=\"/imgextra/i3/2510050218/O1CN01qRgJvk1DTt73XUUwS_!!2510050218.jpg\" align=\"absmiddle\" /><img src=\"/imgextra/i2/2510050218/O1CN01bcooB11DTt7CrJr9u_!!2510050218.jpg\" align=\"absmiddle\" /><img src=\"/imgextra/i3/2510050218/O1CN01mNAq7P1DTt6VKij8H_!!2510050218.jpg\" align=\"absmiddle\" /><img src=\"/imgextra/i2/2510050218/O1CN0140iHfA1DTt6XmeHxP_!!2510050218.jpg\" align=\"absmiddle\" /><img src=\"/imgextra/i1/2510050218/O1CN0180W12i1DTt6XmdU8f_!!2510050218.jpg\" align=\"absmiddle\" /><img src=\"/imgextra/i4/2510050218/O1CN01oUnmKj1DTt6XfAeib_!!2510050218.jpg\" align=\"absmiddle\" /><img src=\"/imgextra/i4/2510050218/O1CN01yFvVyW1DTt6UapZ61_!!2510050218.jpg\" align=\"absmiddle\" /><img src=\"/imgextra/i4/2510050218/O1CN011EF1Ja1DTt6XfBjSw_!!2510050218.jpg\" align=\"absmiddle\" /><img src=\"/imgextra/i3/2510050218/O1CN01CwP4Aa1DTt6NTBaQJ_!!2510050218.jpg\" align=\"absmiddle\" /><img src=\"/imgextra/i3/2510050218/O1CN01K8xJOR1DTt6y3GY3t_!!2510050218.jpg\" align=\"absmiddle\" /><img src=\"/imgextra/i4/2510050218/O1CN01qhC7v91DTt5pFNTjS_!!2510050218.jpg\" align=\"absmiddle\" /></p><img src=\"/i.php?t.png&rid=gw-1.62e8bfaaa6eb1&p=1778787198&k=i_key&t=1659420588\" style=\"display:none\" />",
"item_imgs": [
{
"url": "///imgextra/i1/2510050218/O1CN011N3gnO1DTt75QnvFm_!!2-item_pic.png"
},
{
"url": "///imgextra/i2/2510050218/O1CN01L84GlP1DTt6UjlsH5_!!2510050218.jpg"
},
{
"url": "///imgextra/i1/2510050218/O1CN01RRHxS51DTt6bSw2l5_!!2510050218.jpg"
},
{
"url": "///imgextra/i2/2510050218/O1CN01kNh6qZ1DTt63Ts19l_!!2510050218.jpg"
},
{
"url": "///imgextra/i4/2510050218/O1CN01JMo8QZ1DTt5qco75b_!!2510050218.jpg"
}
],
"item_weight": 0,
"location": "北京",
"post_fee": " 免运费",
"express_fee": 0,
"ems_fee": 0,
"shipping_to": "",
"has_discount": "true",
"video": [],
"is_virtual": "",
"sample_id": "",
"is_promotion": "true",
"prop_imgs": {
"prop_img": [
{
"properties": "1627207:6536025",
"url": "///imgextra/i2/2510050218/O1CN01PFHVkX1DTt6SAlJfh_!!2510050218.jpg"
},
{
"properties": "1627207:21722647200",
"url": "///imgextra/i3/2510050218/O1CN01CAH8vP1DTt6jevUVz_!!2510050218.jpg"
},
{
"properties": "1627207:21722591681",
"url": "///imgextra/i4/2510050218/O1CN01MJuOBE1DTt72dxglk_!!2510050218.jpg"
},
{
"properties": "1627207:21722656198",
"url": "///imgextra/i2/2510050218/O1CN01vwr7nn1DTt6jhjVNF_!!2510050218.jpg"
},
{
"properties": "1627207:21722607395",
"url": "///imgextra/i1/2510050218/O1CN01xtajDh1DTt6qrN0UH_!!2510050218.jpg"
}
]
},
"property_alias": "",
"props": [
{
"name": "品牌",
"value": "alienware"
},
{
"name": "系列",
"value": "X14 R1"
},
{
"name": "型号",
"value": "X14"
},
{
"name": "内存容量",
"value": "16GB"
},
{
"name": "硬盘容量",
"value": "512GB 固态硬盘"
},
{
"name": "CPU",
"value": "英特尔 酷睿 i7-12700H"
},
{
"name": "显存容量",
"value": "4G"
},
{
"name": "厚度",
"value": "10.0mm(含)-15.0mm(不含)"
},
{
"name": "颜色分类",
"value": "官方标配 +1299元购610M无线鼠+双肩背包 +2199元购AW920H三模降噪游戏耳机 +1499元购AW510K机械键盘 +6800元购2721D 27英寸2K显示器"
},
{
"name": "商品条形码",
"value": "0000000000000"
},
{
"name": "套餐类型",
"value": "1543: i5-12500H/16G/3050/512G SSD 1743: i7-12700H/16G/3050/ 512G SSD"
},
{
"name": "生产企业",
"value": "戴尔（中国）有限公司"
},
{
"name": "能效等级",
"value": "无"
},
{
"name": "笔记本电脑类型",
"value": "游戏本"
},
{
"name": "显卡类型",
"value": "NVIDIA GeForce RTX3050"
},
{
"name": "操作系统",
"value": "Windows 11"
},
{
"name": "适用场景",
"value": "高清游戏 尊贵旗舰"
},
{
"name": "CPU品牌",
"value": "英特尔"
},
{
"name": "毛重",
"value": "1.84kg"
},
{
"name": "屏幕分辨率",
"value": "1920x1080像素"
},
{
"name": "屏幕尺寸",
"value": "14英寸"
},
{
"name": "能效备案号",
"value": "无"
},
{
"name": "屏幕刷新率",
"value": "144Hz"
},
{
"name": "保修期",
"value": "2年"
},
{
"name": "3C证书编号",
"value": "010902130514"
}
],
"props_name": "5:103646:内存容量:16GB;2:526432424:硬盘容量:512GB 固态硬盘;1627207:6536025:颜色分类:官方标配;1627207:21722647200:颜色分类:+1299元购610M无线鼠+双肩背包;1627207:21722591681:颜色分类:+2199元购AW920H三模降噪游戏耳机;1627207:21722656198:颜色分类:+1499元购AW510K机械键盘;1627207:21722607395:颜色分类:+6800元购2721D 27英寸2K显示器;5919063:18596323774:套餐类型:1543: i5-12500H/16G/3050/512G SSD;5919063:21228140351:套餐类型:1743: i7-12700H/16G/3050/ 512G SSD",
"total_sold": 9400000,
"skus": {
"sku": [
{
"price": "10969",
"total_price": 0,
"orginal_price": "10969",
"properties": "5:103646;2:526432424;1627207:6536025;5919063:18596323774",
"properties_name": "5:103646:内存容量:16GB;2:526432424:硬盘容量:512GB 固态硬盘;1627207:6536025:颜色分类:官方标配;5919063:18596323774:套餐类型:1543: i5-12500H/16G/3050/512G SSD",
"quantity": "145",
"sku_id": "4860430856387"
},
{
"price": "11969",
"total_price": 0,
"orginal_price": "11969",
"properties": "5:103646;2:526432424;1627207:6536025;5919063:21228140351",
"properties_name": "5:103646:内存容量:16GB;2:526432424:硬盘容量:512GB 固态硬盘;1627207:6536025:颜色分类:官方标配;5919063:21228140351:套餐类型:1743: i7-12700H/16G/3050/ 512G SSD",
"quantity": "200",
"sku_id": "4860430856388"
},
{
"price": "12268",
"total_price": 0,
"orginal_price": "12268",
"properties": "5:103646;2:526432424;1627207:21722647200;5919063:18596323774",
"properties_name": "5:103646:内存容量:16GB;2:526432424:硬盘容量:512GB 固态硬盘;1627207:21722647200:颜色分类:+1299元购610M无线鼠+双肩背包;5919063:18596323774:套餐类型:1543: i5-12500H/16G/3050/512G SSD",
"quantity": "176",
"sku_id": "4860430856383"
},
{
"price": "13268",
"total_price": 0,
"orginal_price": "13268",
"properties": "5:103646;2:526432424;1627207:21722647200;5919063:21228140351",
"properties_name": "5:103646:内存容量:16GB;2:526432424:硬盘容量:512GB 固态硬盘;1627207:21722647200:颜色分类:+1299元购610M无线鼠+双肩背包;5919063:21228140351:套餐类型:1743: i7-12700H/16G/3050/ 512G SSD",
"quantity": "72",
"sku_id": "4860430856384"
},
{
"price": "13168",
"total_price": 0,
"orginal_price": "13168",
"properties": "5:103646;2:526432424;1627207:21722591681;5919063:18596323774",
"properties_name": "5:103646:内存容量:16GB;2:526432424:硬盘容量:512GB 固态硬盘;1627207:21722591681:颜色分类:+2199元购AW920H三模降噪游戏耳机;5919063:18596323774:套餐类型:1543: i5-12500H/16G/3050/512G SSD",
"quantity": "48",
"sku_id": "4860430856385"
},
{
"price": "14168",
"total_price": 0,
"orginal_price": "14168",
"properties": "5:103646;2:526432424;1627207:21722591681;5919063:21228140351",
"properties_name": "5:103646:内存容量:16GB;2:526432424:硬盘容量:512GB 固态硬盘;1627207:21722591681:颜色分类:+2199元购AW920H三模降噪游戏耳机;5919063:21228140351:套餐类型:1743: i7-12700H/16G/3050/ 512G SSD",
"quantity": "37",
"sku_id": "4860430856386"
},
{
"price": "12468",
"total_price": 0,
"orginal_price": "12468",
"properties": "5:103646;2:526432424;1627207:21722656198;5919063:18596323774",
"properties_name": "5:103646:内存容量:16GB;2:526432424:硬盘容量:512GB 固态硬盘;1627207:21722656198:颜色分类:+1499元购AW510K机械键盘;5919063:18596323774:套餐类型:1543: i5-12500H/16G/3050/512G SSD",
"quantity": "46",
"sku_id": "4860430856381"
},
{
"price": "13468",
"total_price": 0,
"orginal_price": "13468",
"properties": "5:103646;2:526432424;1627207:21722656198;5919063:21228140351",
"properties_name": "5:103646:内存容量:16GB;2:526432424:硬盘容量:512GB 固态硬盘;1627207:21722656198:颜色分类:+1499元购AW510K机械键盘;5919063:21228140351:套餐类型:1743: i7-12700H/16G/3050/ 512G SSD",
"quantity": "28",
"sku_id": "4860430856382"
},
{
"price": "17769",
"total_price": 0,
"orginal_price": "17769",
"properties": "5:103646;2:526432424;1627207:21722607395;5919063:18596323774",
"properties_name": "5:103646:内存容量:16GB;2:526432424:硬盘容量:512GB 固态硬盘;1627207:21722607395:颜色分类:+6800元购2721D 27英寸2K显示器;5919063:18596323774:套餐类型:1543: i5-12500H/16G/3050/512G SSD",
"quantity": "47",
"sku_id": "4860430856379"
},
{
"price": "18769",
"total_price": 0,
"orginal_price": "18769",
"properties": "5:103646;2:526432424;1627207:21722607395;5919063:21228140351",
"properties_name": "5:103646:内存容量:16GB;2:526432424:硬盘容量:512GB 固态硬盘;1627207:21722607395:颜色分类:+6800元购2721D 27英寸2K显示器;5919063:21228140351:套餐类型:1743: i7-12700H/16G/3050/ 512G SSD",
"quantity": "38",
"sku_id": "4860430856380"
}
]
},
"seller_id": "2510050218",
"shop_id": "127449538",
"props_list": {
"5:103646": "内存容量:16GB",
"2:526432424": "硬盘容量:512GB 固态硬盘",
"1627207:6536025": "颜色分类:官方标配",
"1627207:21722647200": "颜色分类:+1299元购610M无线鼠+双肩背包",
"1627207:21722591681": "颜色分类:+2199元购AW920H三模降噪游戏耳机",
"1627207:21722656198": "颜色分类:+1499元购AW510K机械键盘",
"1627207:21722607395": "颜色分类:+6800元购2721D 27英寸2K显示器",
"5919063:18596323774": "套餐类型:1543: i5-12500H/16G/3050/512G SSD",
"5919063:21228140351": "套餐类型:1743: i7-12700H/16G/3050/ 512G SSD"
},
"seller_info": {
"nick": "alienware外星人旗舰店",
"item_score": "4.8 ",
"score_p": "4.8 ",
"delivery_score": "4.9 ",
"shop_type": "B",
"user_num_id": "2510050218",
"sid": "127449538",
"title": "ALIENWARE外星人旗舰店",
"zhuy": "/",
"shop_name": "ALIENWARE外星人旗舰店"
},
"tmall": true,
"update_time": "-08-02 14:09:48",
"data_update": "-08-02 14:09:48",
"data_f": "xdl",
"data_from": "hid",
"promo_type": null,
"props_img": {
"1627207:6536025": "///imgextra/i2/2510050218/O1CN01PFHVkX1DTt6SAlJfh_!!2510050218.jpg",
"1627207:21722647200": "///imgextra/i3/2510050218/O1CN01CAH8vP1DTt6jevUVz_!!2510050218.jpg",
"1627207:21722591681": "///imgextra/i4/2510050218/O1CN01MJuOBE1DTt72dxglk_!!2510050218.jpg",
"1627207:21722656198": "///imgextra/i2/2510050218/O1CN01vwr7nn1DTt6jhjVNF_!!2510050218.jpg",
"1627207:21722607395": "///imgextra/i1/2510050218/O1CN01xtajDh1DTt6qrN0UH_!!2510050218.jpg"
},
"error": null,
"format_check": "ok",
"sales": 0,
"desc_img": [
"/imgextra/i2/2510050218/O1CN0126IHje1DTt74HZYLv_!!2510050218.jpg",
"/imgextra/i3/2510050218/O1CN016AZ5YM1DTt6H3dxsX_!!2510050218.jpg",
"/imgextra/i4/2510050218/O1CN01RacBbj1DTt70NBQXt_!!2510050218.jpg",
"/imgextra/i1/2510050218/O1CN01tWe5zN1DTt75HxDoE_!!2510050218.jpg",
"/imgextra/i4/2510050218/O1CN01LdyQCe1DTt73XPrjR_!!2510050218.jpg",
"/imgextra/i1/2510050218/O1CN01EiKHhz1DTt73XO3W0_!!2510050218.jpg",
"/imgextra/i4/2510050218/O1CN01CH3wit1DTt7CrFxkF_!!2510050218.jpg",
"/imgextra/i3/2510050218/O1CN01ScPDM51DTt73XScKj_!!2510050218.jpg",
"/imgextra/i3/2510050218/O1CN01wdNlfI1DTt78qPjIS_!!2510050218.jpg",
"/imgextra/i4/2510050218/O1CN01JW6X1a1DTt718ABoY_!!2510050218.jpg",
"/imgextra/i3/2510050218/O1CN01qRgJvk1DTt73XUUwS_!!2510050218.jpg",
"/imgextra/i2/2510050218/O1CN01bcooB11DTt7CrJr9u_!!2510050218.jpg",
"/imgextra/i3/2510050218/O1CN01mNAq7P1DTt6VKij8H_!!2510050218.jpg",
"/imgextra/i2/2510050218/O1CN0140iHfA1DTt6XmeHxP_!!2510050218.jpg",
"/imgextra/i1/2510050218/O1CN0180W12i1DTt6XmdU8f_!!2510050218.jpg",
"/imgextra/i4/2510050218/O1CN01oUnmKj1DTt6XfAeib_!!2510050218.jpg",
"/imgextra/i4/2510050218/O1CN01yFvVyW1DTt6UapZ61_!!2510050218.jpg",
"/imgextra/i4/2510050218/O1CN011EF1Ja1DTt6XfBjSw_!!2510050218.jpg",
"/imgextra/i3/2510050218/O1CN01CwP4Aa1DTt6NTBaQJ_!!2510050218.jpg",
"/imgextra/i3/2510050218/O1CN01K8xJOR1DTt6y3GY3t_!!2510050218.jpg",
"/imgextra/i4/2510050218/O1CN01qhC7v91DTt5pFNTjS_!!2510050218.jpg",
"/i.php?t.png&rid=gw-1.62e8bfaaa6eb1&p=1778787198&k=i_key&t=1659420588"
],
"shop_item": [],
"relate_items": []
},
"error": "",
"secache": "70f40941475c042d3b6c7b4ff6ff79ad",
"secache_time": 1659926913,
"secache_date": "-08-08 10:48:33",
"translate_status": "",
"translate_time": 0,
"language": {
"default_lang": "cn",
"current_lang": "cn"
},
"reason": "",
"error_code": "0000",
"cache": 0,
"api_info": "today:61 max:10100 all[94=61+9+24];expires:2030-12-31",
"execution_time": "0.295",
"server_time": "Beijing/-08-08 10:48:33",
"client_ip": "106.6.38.153",
"call_args": {
"num_iid": "667746579912",
"is_promotion": "1"
},
"api_type": "taobao",
"translate_language": "zh-CN",
"translate_engine": "google_new",
"server_memory": "0.93MB",
"request_id": "gw-4.62f079814c1fc",
"last_id": "1136808305"
}
如果觉得《网络爬虫 淘宝API商品详情测试（抓取详情数据）》对你有帮助，请点赞、收藏，并留下你的观点哦！
