This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import asyncio | |
| import aiofiles | |
| import aiohttp | |
| import logging | |
| import re | |
| import sys | |
| import os | |
| import lxml.html |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import funcy | |
| import requests | |
| import aiohttp | |
| import asyncio | |
| import concurrent.futures | |
| pages = ["https://yandex.ru", "https://google.com", "http://selectel.ru"] | |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| from time import time | |
| import asyncio | |
| import aiohttp | |
| from aiohttp import web | |
| async def web_handler(request): | |
| n = int(request.GET.get('n', 0)) | |
| return web.Response(text=str(n+1)) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import time | |
| import random | |
| URIS = ("http://example.org/foo", "http://example.org/bar", | |
| "http://example.org/baz") | |
| def main(): | |
| for uri in URIS: |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import asyncio | |
| import aiohttp | |
| import bs4 | |
| import tqdm | |
| @asyncio.coroutine | |
| def get(*args, **kwargs): | |
| response = yield from aiohttp.request('GET', *args, **kwargs) | |
| return (yield from response.read_and_close(decode=True)) |