{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# requests 模块:HTTP for Human" ] }, { "cell_type": "code", "execution_count": 1, "metadata": { "collapsed": true }, "outputs": [], "source": [ "import requests" ] }, { "cell_type": "markdown", "metadata": { "collapsed": true }, "source": [ "Python 标准库中的 `urllib2` 模块提供了你所需要的大多数 `HTTP` 功能,但是它的 `API` 不是特别方便使用。\n", "\n", "`requests` 模块号称 `HTTP for Human`,它可以这样使用:" ] }, { "cell_type": "code", "execution_count": 2, "metadata": { "collapsed": false }, "outputs": [], "source": [ "r = requests.get(\"http://httpbin.org/get\")\n", "r = requests.post('http://httpbin.org/post', data = {'key':'value'})\n", "r = requests.put(\"http://httpbin.org/put\")\n", "r = requests.delete(\"http://httpbin.org/delete\")\n", "r = requests.head(\"http://httpbin.org/get\")\n", "r = requests.options(\"http://httpbin.org/get\")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 传入 URL 参数" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "假如我们想访问 `httpbin.org/get?key=val`,我们可以使用 `params` 传入这些参数:" ] }, { "cell_type": "code", "execution_count": 3, "metadata": { "collapsed": true }, "outputs": [], "source": [ "payload = {'key1': 'value1', 'key2': 'value2'}\n", "r = requests.get(\"http://httpbin.org/get\", params=payload)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "查看 `url` :" ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "collapsed": false }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "http://httpbin.org/get?key2=value2&key1=value1\n" ] } ], "source": [ "print(r.url)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 读取响应内容" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "`Requests` 会自动解码来自服务器的内容。大多数 `unicode` 字符集都能被无缝地解码。" ] }, { "cell_type": "code", "execution_count": 5, "metadata": { "collapsed": false }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "{\"message\":\"Hello there, wayfaring stranger. If you’re reading this then you probably didn’t see our blog post a couple of years back announcing that this API would go away: http://git.io/17AROg Fear not, you should be able to get what you need from the shiny new Events API instead.\",\"documentation_url\":\"https://developer.github.com/v3/activity/events/#list-public-events\"}\n" ] } ], "source": [ "r = requests.get('https://github.com/timeline.json')\n", "\n", "print r.text" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "查看文字编码:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": { "collapsed": false }, "outputs": [ { "data": { "text/plain": [ "'utf-8'" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "r.encoding" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "每次改变文字编码,`text` 的内容也随之变化:" ] }, { "cell_type": "code", "execution_count": 7, "metadata": { "collapsed": false }, "outputs": [ { "data": { "text/plain": [ "u'{\"message\":\"Hello there, wayfaring stranger. If you\\xe2\\x80\\x99re reading this then you probably didn\\xe2\\x80\\x99t see our blog post a couple of years back announcing that this API would go away: http://git.io/17AROg Fear not, you should be able to get what you need from the shiny new Events API instead.\",\"documentation_url\":\"https://developer.github.com/v3/activity/events/#list-public-events\"}'" ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "r.encoding = \"ISO-8859-1\"\n", "\n", "r.text" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "`Requests` 中也有一个内置的 `JSON` 解码器处理 `JSON` 数据:" ] }, { "cell_type": "code", "execution_count": 8, "metadata": { "collapsed": false }, "outputs": [ { "data": { "text/plain": [ "{u'documentation_url': u'https://developer.github.com/v3/activity/events/#list-public-events',\n", " u'message': u'Hello there, wayfaring stranger. If you\\xe2\\x80\\x99re reading this then you probably didn\\xe2\\x80\\x99t see our blog post a couple of years back announcing that this API would go away: http://git.io/17AROg Fear not, you should be able to get what you need from the shiny new Events API instead.'}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "r.json()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "如果 `JSON` 解码失败, `r.json` 就会抛出一个异常。" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 响应状态码" ] }, { "cell_type": "code", "execution_count": 9, "metadata": { "collapsed": false }, "outputs": [ { "data": { "text/plain": [ "407" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "r = requests.get('http://httpbin.org/get')\n", "\n", "r.status_code" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 响应头" ] }, { "cell_type": "code", "execution_count": 10, "metadata": { "collapsed": false }, "outputs": [ { "data": { "text/plain": [ "'text/html'" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "r.headers['Content-Type']" ] } ], "metadata": { "kernelspec": { "display_name": "Python 2", "language": "python", "name": "python2" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 2 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython2", "version": "2.7.6" } }, "nbformat": 4, "nbformat_minor": 0 }