# Crawlee for Python · Fast, reliable Python web crawlers.


## python

- [Search the documentation](https://crawlee.dev/python/search.md)
- [crawlee](https://crawlee.dev/python/api.md)
- [_AsyncSession](https://crawlee.dev/python/api/class/_AsyncSession.md)
- [_AutoscaledPoolRun](https://crawlee.dev/python/api/class/_AutoscaledPoolRun.md)
- [_BasicCrawlerOptions](https://crawlee.dev/python/api/class/_BasicCrawlerOptions.md)
- [_BasicCrawlerOptionsGeneric](https://crawlee.dev/python/api/class/_BasicCrawlerOptionsGeneric.md)
- [_CurlImpersonateResponse](https://crawlee.dev/python/api/class/_CurlImpersonateResponse.md)
- [_DatasetMetadataUpdateParams](https://crawlee.dev/python/api/class/_DatasetMetadataUpdateParams.md)
- [_DatasetMetadataUpdateParams](https://crawlee.dev/python/api/class/_DatasetMetadataUpdateParams.md)
- [_DomainState](https://crawlee.dev/python/api/class/_DomainState.md)
- [_EmptyCookies](https://crawlee.dev/python/api/class/_EmptyCookies.md)
- [_HttpxResponse](https://crawlee.dev/python/api/class/_HttpxResponse.md)
- [_HttpxTransport](https://crawlee.dev/python/api/class/_HttpxTransport.md)
- [_ImpitResponse](https://crawlee.dev/python/api/class/_ImpitResponse.md)
- [_Middleware](https://crawlee.dev/python/api/class/_Middleware.md)
- [_NewUrlFunction](https://crawlee.dev/python/api/class/_NewUrlFunction.md)
- [_NonPersistentStatistics](https://crawlee.dev/python/api/class/_NonPersistentStatistics.md)
- [_PlaywrightCrawlerAdditionalOptions](https://crawlee.dev/python/api/class/_PlaywrightCrawlerAdditionalOptions.md)
- [_ProxyTierTracker](https://crawlee.dev/python/api/class/_ProxyTierTracker.md)
- [_PssAvailability](https://crawlee.dev/python/api/class/_PssAvailability.md)
- [_QueueMetadataUpdateParams](https://crawlee.dev/python/api/class/_QueueMetadataUpdateParams.md)
- [_QueueMetadataUpdateParams](https://crawlee.dev/python/api/class/_QueueMetadataUpdateParams.md)
- [_RequestManagerOpener](https://crawlee.dev/python/api/class/_RequestManagerOpener.md)
- [_RetryableSitemapStatusError](https://crawlee.dev/python/api/class/_RetryableSitemapStatusError.md)
- [_SetCookieResponse](https://crawlee.dev/python/api/class/_SetCookieResponse.md)
- [_SitemapItem](https://crawlee.dev/python/api/class/_SitemapItem.md)
- [_StorageCache](https://crawlee.dev/python/api/class/_StorageCache.md)
- [_TxtSitemapParser](https://crawlee.dev/python/api/class/_TxtSitemapParser.md)
- [_XMLSaxSitemapHandler](https://crawlee.dev/python/api/class/_XMLSaxSitemapHandler.md)
- [_XmlSitemapParser](https://crawlee.dev/python/api/class/_XmlSitemapParser.md)
- [AbortError](https://crawlee.dev/python/api/class/AbortError.md)
- [AbstractHttpCrawler](https://crawlee.dev/python/api/class/AbstractHttpCrawler.md)
- [AbstractHttpParser](https://crawlee.dev/python/api/class/AbstractHttpParser.md)
- [AdaptiveContextError](https://crawlee.dev/python/api/class/AdaptiveContextError.md)
- [AdaptivePlaywrightCrawler](https://crawlee.dev/python/api/class/AdaptivePlaywrightCrawler.md)
- [AdaptivePlaywrightCrawlerStatisticState](https://crawlee.dev/python/api/class/AdaptivePlaywrightCrawlerStatisticState.md)
- [AdaptivePlaywrightCrawlingContext](https://crawlee.dev/python/api/class/AdaptivePlaywrightCrawlingContext.md)
- [AdaptivePlaywrightPostNavCrawlingContext](https://crawlee.dev/python/api/class/AdaptivePlaywrightPostNavCrawlingContext.md)
- [AdaptivePlaywrightPreNavCrawlingContext](https://crawlee.dev/python/api/class/AdaptivePlaywrightPreNavCrawlingContext.md)
- [AddRequestsFunction](https://crawlee.dev/python/api/class/AddRequestsFunction.md)
- [AddRequestsKwargs](https://crawlee.dev/python/api/class/AddRequestsKwargs.md)
- [AddRequestsResponse](https://crawlee.dev/python/api/class/AddRequestsResponse.md)
- [AutosavedValue](https://crawlee.dev/python/api/class/AutosavedValue.md)
- [AutoscaledPool](https://crawlee.dev/python/api/class/AutoscaledPool.md)
- [AwareDateTime](https://crawlee.dev/python/api/class/AwareDateTime.md)
- [Base](https://crawlee.dev/python/api/class/Base.md)
- [BasePydanticAiHtmlDistiller](https://crawlee.dev/python/api/class/BasePydanticAiHtmlDistiller.md)
- [BasePydanticAiHtmlExtractor](https://crawlee.dev/python/api/class/BasePydanticAiHtmlExtractor.md)
- [BasicCrawler](https://crawlee.dev/python/api/class/BasicCrawler.md)
- [BasicCrawlerOptions](https://crawlee.dev/python/api/class/BasicCrawlerOptions.md)
- [BasicCrawlingContext](https://crawlee.dev/python/api/class/BasicCrawlingContext.md)
- [BeautifulSoupCrawler](https://crawlee.dev/python/api/class/BeautifulSoupCrawler.md)
- [BeautifulSoupCrawlingContext](https://crawlee.dev/python/api/class/BeautifulSoupCrawlingContext.md)
- [BeautifulSoupParser](https://crawlee.dev/python/api/class/BeautifulSoupParser.md)
- [BlockedInfo](https://crawlee.dev/python/api/class/BlockedInfo.md)
- [BlockRequestsFunction](https://crawlee.dev/python/api/class/BlockRequestsFunction.md)
- [BrowserController](https://crawlee.dev/python/api/class/BrowserController.md)
- [BrowserforgeFingerprintGenerator](https://crawlee.dev/python/api/class/BrowserforgeFingerprintGenerator.md)
- [BrowserforgeHeaderGenerator](https://crawlee.dev/python/api/class/BrowserforgeHeaderGenerator.md)
- [BrowserPlugin](https://crawlee.dev/python/api/class/BrowserPlugin.md)
- [BrowserPool](https://crawlee.dev/python/api/class/BrowserPool.md)
- [ByteSize](https://crawlee.dev/python/api/class/ByteSize.md)
- [ClientSnapshot](https://crawlee.dev/python/api/class/ClientSnapshot.md)
- [ConcurrencySettings](https://crawlee.dev/python/api/class/ConcurrencySettings.md)
- [Configuration](https://crawlee.dev/python/api/class/Configuration.md)
- [ContextPipeline](https://crawlee.dev/python/api/class/ContextPipeline.md)
- [ContextPipelineFinalizationError](https://crawlee.dev/python/api/class/ContextPipelineFinalizationError.md)
- [ContextPipelineInitializationError](https://crawlee.dev/python/api/class/ContextPipelineInitializationError.md)
- [ContextPipelineInterruptedError](https://crawlee.dev/python/api/class/ContextPipelineInterruptedError.md)
- [CookieParam](https://crawlee.dev/python/api/class/CookieParam.md)
- [CpuInfo](https://crawlee.dev/python/api/class/CpuInfo.md)
- [CpuSnapshot](https://crawlee.dev/python/api/class/CpuSnapshot.md)
- [CrawleeLogFormatter](https://crawlee.dev/python/api/class/CrawleeLogFormatter.md)
- [CrawleePage](https://crawlee.dev/python/api/class/CrawleePage.md)
- [CrawleeRequestData](https://crawlee.dev/python/api/class/CrawleeRequestData.md)
- [CrawlerInstrumentor](https://crawlee.dev/python/api/class/CrawlerInstrumentor.md)
- [CurlImpersonateHttpClient](https://crawlee.dev/python/api/class/CurlImpersonateHttpClient.md)
- [Dataset](https://crawlee.dev/python/api/class/Dataset.md)
- [DatasetClient](https://crawlee.dev/python/api/class/DatasetClient.md)
- [DatasetItemDb](https://crawlee.dev/python/api/class/DatasetItemDb.md)
- [DatasetItemsListPage](https://crawlee.dev/python/api/class/DatasetItemsListPage.md)
- [DatasetMetadata](https://crawlee.dev/python/api/class/DatasetMetadata.md)
- [DatasetMetadataBufferDb](https://crawlee.dev/python/api/class/DatasetMetadataBufferDb.md)
- [DatasetMetadataDb](https://crawlee.dev/python/api/class/DatasetMetadataDb.md)
- [DefaultRenderingTypePredictor](https://crawlee.dev/python/api/class/DefaultRenderingTypePredictor.md)
- [EnqueueLinksFunction](https://crawlee.dev/python/api/class/EnqueueLinksFunction.md)
- [EnqueueLinksKwargs](https://crawlee.dev/python/api/class/EnqueueLinksKwargs.md)
- [ErrorSnapshotter](https://crawlee.dev/python/api/class/ErrorSnapshotter.md)
- [ErrorTracker](https://crawlee.dev/python/api/class/ErrorTracker.md)
- [EventAbortingData](https://crawlee.dev/python/api/class/EventAbortingData.md)
- [EventCrawlerStatusData](https://crawlee.dev/python/api/class/EventCrawlerStatusData.md)
- [EventExitData](https://crawlee.dev/python/api/class/EventExitData.md)
- [EventLoopSnapshot](https://crawlee.dev/python/api/class/EventLoopSnapshot.md)
- [EventManager](https://crawlee.dev/python/api/class/EventManager.md)
- [EventManagerOptions](https://crawlee.dev/python/api/class/EventManagerOptions.md)
- [EventMigratingData](https://crawlee.dev/python/api/class/EventMigratingData.md)
- [EventPersistStateData](https://crawlee.dev/python/api/class/EventPersistStateData.md)
- [EventSystemInfoData](https://crawlee.dev/python/api/class/EventSystemInfoData.md)
- [ExportDataCsvKwargs](https://crawlee.dev/python/api/class/ExportDataCsvKwargs.md)
- [ExportDataJsonKwargs](https://crawlee.dev/python/api/class/ExportDataJsonKwargs.md)
- [ExportDataKwargs](https://crawlee.dev/python/api/class/ExportDataKwargs.md)
- [ExportToKwargs](https://crawlee.dev/python/api/class/ExportToKwargs.md)
- [ExtractFunction](https://crawlee.dev/python/api/class/ExtractFunction.md)
- [ExtractLinksFunction](https://crawlee.dev/python/api/class/ExtractLinksFunction.md)
- [FailedImport](https://crawlee.dev/python/api/class/FailedImport.md)
- [FieldSelector](https://crawlee.dev/python/api/class/FieldSelector.md)
- [FileDownloadCrawler](https://crawlee.dev/python/api/class/FileDownloadCrawler.md)
- [FileDownloadCrawlingContext](https://crawlee.dev/python/api/class/FileDownloadCrawlingContext.md)
- [FileSystemDatasetClient](https://crawlee.dev/python/api/class/FileSystemDatasetClient.md)
- [FileSystemKeyValueStoreClient](https://crawlee.dev/python/api/class/FileSystemKeyValueStoreClient.md)
- [FileSystemRequestQueueClient](https://crawlee.dev/python/api/class/FileSystemRequestQueueClient.md)
- [FileSystemStorageClient](https://crawlee.dev/python/api/class/FileSystemStorageClient.md)
- [FinalStatistics](https://crawlee.dev/python/api/class/FinalStatistics.md)
- [FingerprintGenerator](https://crawlee.dev/python/api/class/FingerprintGenerator.md)
- [GetDataKwargs](https://crawlee.dev/python/api/class/GetDataKwargs.md)
- [GetKeyValueStoreFromRequestHandlerFunction](https://crawlee.dev/python/api/class/GetKeyValueStoreFromRequestHandlerFunction.md)
- [GetKeyValueStoreFunction](https://crawlee.dev/python/api/class/GetKeyValueStoreFunction.md)
- [Glob](https://crawlee.dev/python/api/class/Glob.md)
- [GotoOptions](https://crawlee.dev/python/api/class/GotoOptions.md)
- [HeaderGenerator](https://crawlee.dev/python/api/class/HeaderGenerator.md)
- [HeaderGeneratorOptions](https://crawlee.dev/python/api/class/HeaderGeneratorOptions.md)
- [HttpClient](https://crawlee.dev/python/api/class/HttpClient.md)
- [HttpClientStatusCodeError](https://crawlee.dev/python/api/class/HttpClientStatusCodeError.md)
- [HttpCrawler](https://crawlee.dev/python/api/class/HttpCrawler.md)
- [HttpCrawlerOptions](https://crawlee.dev/python/api/class/HttpCrawlerOptions.md)
- [HttpCrawlingContext](https://crawlee.dev/python/api/class/HttpCrawlingContext.md)
- [HttpCrawlingResult](https://crawlee.dev/python/api/class/HttpCrawlingResult.md)
- [HttpHeaders](https://crawlee.dev/python/api/class/HttpHeaders.md)
- [HttpResponse](https://crawlee.dev/python/api/class/HttpResponse.md)
- [HttpStatusCodeError](https://crawlee.dev/python/api/class/HttpStatusCodeError.md)
- [HttpxHttpClient](https://crawlee.dev/python/api/class/HttpxHttpClient.md)
- [ImpitHttpClient](https://crawlee.dev/python/api/class/ImpitHttpClient.md)
- [ImportWrapper](https://crawlee.dev/python/api/class/ImportWrapper.md)
- [JsonField](https://crawlee.dev/python/api/class/JsonField.md)
- [KeyValueStore](https://crawlee.dev/python/api/class/KeyValueStore.md)
- [KeyValueStoreChangeRecords](https://crawlee.dev/python/api/class/KeyValueStoreChangeRecords.md)
- [KeyValueStoreClient](https://crawlee.dev/python/api/class/KeyValueStoreClient.md)
- [KeyValueStoreInterface](https://crawlee.dev/python/api/class/KeyValueStoreInterface.md)
- [KeyValueStoreMetadata](https://crawlee.dev/python/api/class/KeyValueStoreMetadata.md)
- [KeyValueStoreMetadataBufferDb](https://crawlee.dev/python/api/class/KeyValueStoreMetadataBufferDb.md)
- [KeyValueStoreMetadataDb](https://crawlee.dev/python/api/class/KeyValueStoreMetadataDb.md)
- [KeyValueStoreRecord](https://crawlee.dev/python/api/class/KeyValueStoreRecord.md)
- [KeyValueStoreRecordDb](https://crawlee.dev/python/api/class/KeyValueStoreRecordDb.md)
- [KeyValueStoreRecordMetadata](https://crawlee.dev/python/api/class/KeyValueStoreRecordMetadata.md)
- [KeyValueStoreValue](https://crawlee.dev/python/api/class/KeyValueStoreValue.md)
- [LoadRatioInfo](https://crawlee.dev/python/api/class/LoadRatioInfo.md)
- [LocalEventManager](https://crawlee.dev/python/api/class/LocalEventManager.md)
- [LoggerOnce](https://crawlee.dev/python/api/class/LoggerOnce.md)
- [MemoryDatasetClient](https://crawlee.dev/python/api/class/MemoryDatasetClient.md)
- [MemoryInfo](https://crawlee.dev/python/api/class/MemoryInfo.md)
- [MemoryKeyValueStoreClient](https://crawlee.dev/python/api/class/MemoryKeyValueStoreClient.md)
- [MemoryRequestQueueClient](https://crawlee.dev/python/api/class/MemoryRequestQueueClient.md)
- [MemorySnapshot](https://crawlee.dev/python/api/class/MemorySnapshot.md)
- [MemoryStorageClient](https://crawlee.dev/python/api/class/MemoryStorageClient.md)
- [MemoryUsageInfo](https://crawlee.dev/python/api/class/MemoryUsageInfo.md)
- [MetadataBufferDb](https://crawlee.dev/python/api/class/MetadataBufferDb.md)
- [MetadataUpdateParams](https://crawlee.dev/python/api/class/MetadataUpdateParams.md)
- [MetadataUpdateParams](https://crawlee.dev/python/api/class/MetadataUpdateParams.md)
- [NavigationRequestInterceptor](https://crawlee.dev/python/api/class/NavigationRequestInterceptor.md)
- [NestedSitemap](https://crawlee.dev/python/api/class/NestedSitemap.md)
- [NoParser](https://crawlee.dev/python/api/class/NoParser.md)
- [PageSnapshot](https://crawlee.dev/python/api/class/PageSnapshot.md)
- [ParsedHttpCrawlingContext](https://crawlee.dev/python/api/class/ParsedHttpCrawlingContext.md)
- [ParselCrawler](https://crawlee.dev/python/api/class/ParselCrawler.md)
- [ParselCrawlingContext](https://crawlee.dev/python/api/class/ParselCrawlingContext.md)
- [ParselParser](https://crawlee.dev/python/api/class/ParselParser.md)
- [ParseSitemapOptions](https://crawlee.dev/python/api/class/ParseSitemapOptions.md)
- [PatchedFingerprintGenerator](https://crawlee.dev/python/api/class/PatchedFingerprintGenerator.md)
- [PatchedHeaderGenerator](https://crawlee.dev/python/api/class/PatchedHeaderGenerator.md)
- [PlaywrightBrowserController](https://crawlee.dev/python/api/class/PlaywrightBrowserController.md)
- [PlaywrightBrowserPlugin](https://crawlee.dev/python/api/class/PlaywrightBrowserPlugin.md)
- [PlaywrightCookieParam](https://crawlee.dev/python/api/class/PlaywrightCookieParam.md)
- [PlaywrightCrawler](https://crawlee.dev/python/api/class/PlaywrightCrawler.md)
- [PlaywrightCrawlerOptions](https://crawlee.dev/python/api/class/PlaywrightCrawlerOptions.md)
- [PlaywrightCrawlingContext](https://crawlee.dev/python/api/class/PlaywrightCrawlingContext.md)
- [PlaywrightHttpClient](https://crawlee.dev/python/api/class/PlaywrightHttpClient.md)
- [PlaywrightHttpResponse](https://crawlee.dev/python/api/class/PlaywrightHttpResponse.md)
- [PlaywrightPersistentBrowser](https://crawlee.dev/python/api/class/PlaywrightPersistentBrowser.md)
- [PlaywrightPostNavCrawlingContext](https://crawlee.dev/python/api/class/PlaywrightPostNavCrawlingContext.md)
- [PlaywrightPreNavCrawlingContext](https://crawlee.dev/python/api/class/PlaywrightPreNavCrawlingContext.md)
- [ProcessedRequest](https://crawlee.dev/python/api/class/ProcessedRequest.md)
- [ProxyConfiguration](https://crawlee.dev/python/api/class/ProxyConfiguration.md)
- [ProxyError](https://crawlee.dev/python/api/class/ProxyError.md)
- [ProxyInfo](https://crawlee.dev/python/api/class/ProxyInfo.md)
- [PushDataFunction](https://crawlee.dev/python/api/class/PushDataFunction.md)
- [PushDataFunctionCall](https://crawlee.dev/python/api/class/PushDataFunctionCall.md)
- [PushDataKwargs](https://crawlee.dev/python/api/class/PushDataKwargs.md)
- [PydanticAiCleanHtmlDistiller](https://crawlee.dev/python/api/class/PydanticAiCleanHtmlDistiller.md)
- [PydanticAiCrawler](https://crawlee.dev/python/api/class/PydanticAiCrawler.md)
- [PydanticAiCrawlingContext](https://crawlee.dev/python/api/class/PydanticAiCrawlingContext.md)
- [PydanticAiDirectExtractor](https://crawlee.dev/python/api/class/PydanticAiDirectExtractor.md)
- [PydanticAiHtmlDistiller](https://crawlee.dev/python/api/class/PydanticAiHtmlDistiller.md)
- [PydanticAiHtmlExtractor](https://crawlee.dev/python/api/class/PydanticAiHtmlExtractor.md)
- [PydanticAiSelectorExtractor](https://crawlee.dev/python/api/class/PydanticAiSelectorExtractor.md)
- [PydanticAiSkeletonDistiller](https://crawlee.dev/python/api/class/PydanticAiSkeletonDistiller.md)
- [PydanticAiUsageStats](https://crawlee.dev/python/api/class/PydanticAiUsageStats.md)
- [Ratio](https://crawlee.dev/python/api/class/Ratio.md)
- [RecoverableState](https://crawlee.dev/python/api/class/RecoverableState.md)
- [RecurringTask](https://crawlee.dev/python/api/class/RecurringTask.md)
- [RedisClientMixin](https://crawlee.dev/python/api/class/RedisClientMixin.md)
- [RedisDatasetClient](https://crawlee.dev/python/api/class/RedisDatasetClient.md)
- [RedisKeyValueStoreClient](https://crawlee.dev/python/api/class/RedisKeyValueStoreClient.md)
- [RedisRequestQueueClient](https://crawlee.dev/python/api/class/RedisRequestQueueClient.md)
- [RedisStorageClient](https://crawlee.dev/python/api/class/RedisStorageClient.md)
- [RenderingTypePrediction](https://crawlee.dev/python/api/class/RenderingTypePrediction.md)
- [RenderingTypePredictor](https://crawlee.dev/python/api/class/RenderingTypePredictor.md)
- [RenderingTypePredictorState](https://crawlee.dev/python/api/class/RenderingTypePredictorState.md)
- [Request](https://crawlee.dev/python/api/class/Request.md)
- [RequestCollisionError](https://crawlee.dev/python/api/class/RequestCollisionError.md)
- [RequestDb](https://crawlee.dev/python/api/class/RequestDb.md)
- [RequestHandlerError](https://crawlee.dev/python/api/class/RequestHandlerError.md)
- [RequestHandlerRunResult](https://crawlee.dev/python/api/class/RequestHandlerRunResult.md)
- [RequestList](https://crawlee.dev/python/api/class/RequestList.md)
- [RequestListData](https://crawlee.dev/python/api/class/RequestListData.md)
- [RequestListState](https://crawlee.dev/python/api/class/RequestListState.md)
- [RequestLoader](https://crawlee.dev/python/api/class/RequestLoader.md)
- [RequestManager](https://crawlee.dev/python/api/class/RequestManager.md)
- [RequestManagerTandem](https://crawlee.dev/python/api/class/RequestManagerTandem.md)
- [RequestOptions](https://crawlee.dev/python/api/class/RequestOptions.md)
- [RequestProcessingRecord](https://crawlee.dev/python/api/class/RequestProcessingRecord.md)
- [RequestQueue](https://crawlee.dev/python/api/class/RequestQueue.md)
- [RequestQueueClient](https://crawlee.dev/python/api/class/RequestQueueClient.md)
- [RequestQueueMetadata](https://crawlee.dev/python/api/class/RequestQueueMetadata.md)
- [RequestQueueMetadataBufferDb](https://crawlee.dev/python/api/class/RequestQueueMetadataBufferDb.md)
- [RequestQueueMetadataDb](https://crawlee.dev/python/api/class/RequestQueueMetadataDb.md)
- [RequestQueueState](https://crawlee.dev/python/api/class/RequestQueueState.md)
- [RequestQueueStateDb](https://crawlee.dev/python/api/class/RequestQueueStateDb.md)
- [RequestState](https://crawlee.dev/python/api/class/RequestState.md)
- [RequestWithLock](https://crawlee.dev/python/api/class/RequestWithLock.md)
- [RobotsTxtFile](https://crawlee.dev/python/api/class/RobotsTxtFile.md)
- [Router](https://crawlee.dev/python/api/class/Router.md)
- [ScreenOptions](https://crawlee.dev/python/api/class/ScreenOptions.md)
- [SelectorCacheState](https://crawlee.dev/python/api/class/SelectorCacheState.md)
- [SelectorMap](https://crawlee.dev/python/api/class/SelectorMap.md)
- [SendRequestFunction](https://crawlee.dev/python/api/class/SendRequestFunction.md)
- [ServiceConflictError](https://crawlee.dev/python/api/class/ServiceConflictError.md)
- [ServiceLocator](https://crawlee.dev/python/api/class/ServiceLocator.md)
- [Session](https://crawlee.dev/python/api/class/Session.md)
- [SessionCookies](https://crawlee.dev/python/api/class/SessionCookies.md)
- [SessionError](https://crawlee.dev/python/api/class/SessionError.md)
- [SessionModel](https://crawlee.dev/python/api/class/SessionModel.md)
- [SessionPool](https://crawlee.dev/python/api/class/SessionPool.md)
- [SessionPoolModel](https://crawlee.dev/python/api/class/SessionPoolModel.md)
- [SharedTimeout](https://crawlee.dev/python/api/class/SharedTimeout.md)
- [Sitemap](https://crawlee.dev/python/api/class/Sitemap.md)
- [SitemapRequestLoader](https://crawlee.dev/python/api/class/SitemapRequestLoader.md)
- [SitemapRequestLoaderState](https://crawlee.dev/python/api/class/SitemapRequestLoaderState.md)
- [SitemapSource](https://crawlee.dev/python/api/class/SitemapSource.md)
- [SitemapUrl](https://crawlee.dev/python/api/class/SitemapUrl.md)
- [Snapshotter](https://crawlee.dev/python/api/class/Snapshotter.md)
- [SortedSnapshotList](https://crawlee.dev/python/api/class/SortedSnapshotList.md)
- [SqlClientMixin](https://crawlee.dev/python/api/class/SqlClientMixin.md)
- [SqlDatasetClient](https://crawlee.dev/python/api/class/SqlDatasetClient.md)
- [SqlKeyValueStoreClient](https://crawlee.dev/python/api/class/SqlKeyValueStoreClient.md)
- [SqlRequestQueueClient](https://crawlee.dev/python/api/class/SqlRequestQueueClient.md)
- [SqlStorageClient](https://crawlee.dev/python/api/class/SqlStorageClient.md)
- [StagehandBrowserController](https://crawlee.dev/python/api/class/StagehandBrowserController.md)
- [StagehandBrowserPlugin](https://crawlee.dev/python/api/class/StagehandBrowserPlugin.md)
- [StagehandCrawler](https://crawlee.dev/python/api/class/StagehandCrawler.md)
- [StagehandCrawlingContext](https://crawlee.dev/python/api/class/StagehandCrawlingContext.md)
- [StagehandOptions](https://crawlee.dev/python/api/class/StagehandOptions.md)
- [StagehandPage](https://crawlee.dev/python/api/class/StagehandPage.md)
- [StagehandPostNavCrawlingContext](https://crawlee.dev/python/api/class/StagehandPostNavCrawlingContext.md)
- [StagehandPreNavCrawlingContext](https://crawlee.dev/python/api/class/StagehandPreNavCrawlingContext.md)
- [Statistics](https://crawlee.dev/python/api/class/Statistics.md)
- [StatisticsState](https://crawlee.dev/python/api/class/StatisticsState.md)
- [Storage](https://crawlee.dev/python/api/class/Storage.md)
- [StorageClient](https://crawlee.dev/python/api/class/StorageClient.md)
- [StorageInstanceManager](https://crawlee.dev/python/api/class/StorageInstanceManager.md)
- [StorageMetadata](https://crawlee.dev/python/api/class/StorageMetadata.md)
- [StorageMetadataDb](https://crawlee.dev/python/api/class/StorageMetadataDb.md)
- [SubCrawlerRun](https://crawlee.dev/python/api/class/SubCrawlerRun.md)
- [SystemInfo](https://crawlee.dev/python/api/class/SystemInfo.md)
- [SystemStatus](https://crawlee.dev/python/api/class/SystemStatus.md)
- [ThrottlingRequestManager](https://crawlee.dev/python/api/class/ThrottlingRequestManager.md)
- [TimerResult](https://crawlee.dev/python/api/class/TimerResult.md)
- [UnprocessedRequest](https://crawlee.dev/python/api/class/UnprocessedRequest.md)
- [UserData](https://crawlee.dev/python/api/class/UserData.md)
- [UserDefinedErrorHandlerError](https://crawlee.dev/python/api/class/UserDefinedErrorHandlerError.md)
- [UserHandlerTimeoutError](https://crawlee.dev/python/api/class/UserHandlerTimeoutError.md)
- [UseStateFunction](https://crawlee.dev/python/api/class/UseStateFunction.md)
- [VersionDb](https://crawlee.dev/python/api/class/VersionDb.md)
- [_FieldKind](https://crawlee.dev/python/api/enum/_FieldKind.md)
- [Event](https://crawlee.dev/python/api/enum/Event.md)
- [Changelog](https://crawlee.dev/python/docs/changelog.md)
- [Deployment guides](https://crawlee.dev/python/docs/deployment.md)
- [Apify platform](https://crawlee.dev/python/docs/deployment/apify-platform.md)
- [Deploy on AWS Lambda](https://crawlee.dev/python/docs/deployment/aws-lambda.md)
- [Cloud Run](https://crawlee.dev/python/docs/deployment/gcp-cloud-run.md)
- [Cloud Run functions](https://crawlee.dev/python/docs/deployment/gcp-cloud-run-functions.md)
- [Examples](https://crawlee.dev/python/docs/examples.md)
- [Adaptive Playwright crawler](https://crawlee.dev/python/docs/examples/adaptive-playwright-crawler.md)
- [Add data to dataset](https://crawlee.dev/python/docs/examples/add-data-to-dataset.md)
- [BeautifulSoup crawler](https://crawlee.dev/python/docs/examples/beautifulsoup-crawler.md)
- [Capture screenshots using Playwright](https://crawlee.dev/python/docs/examples/capture-screenshots-using-playwright.md)
- [Capturing page snapshots with ErrorSnapshotter](https://crawlee.dev/python/docs/examples/capturing-page-snapshots-with-error-snapshotter.md)
- [Сonfigure JSON logging](https://crawlee.dev/python/docs/examples/configure-json-logging.md)
- [Crawl all links on website](https://crawlee.dev/python/docs/examples/crawl-all-links-on-website.md)
- [Crawl multiple URLs](https://crawlee.dev/python/docs/examples/crawl-multiple-urls.md)
- [Crawl specific links on website](https://crawlee.dev/python/docs/examples/crawl-specific-links-on-website.md)
- [Crawl website with relative links](https://crawlee.dev/python/docs/examples/crawl-website-with-relative-links.md)
- [Keep a Crawler alive waiting for more requests](https://crawlee.dev/python/docs/examples/crawler-keep-alive.md)
- [Stopping a Crawler with stop method](https://crawlee.dev/python/docs/examples/crawler-stop.md)
- [Export entire dataset to file](https://crawlee.dev/python/docs/examples/export-entire-dataset-to-file.md)
- [Download files](https://crawlee.dev/python/docs/examples/file-download.md)
- [Fill and submit web form](https://crawlee.dev/python/docs/examples/fill-and-submit-web-form.md)
- [Parsel crawler](https://crawlee.dev/python/docs/examples/parsel-crawler.md)
- [Playwright crawler](https://crawlee.dev/python/docs/examples/playwright-crawler.md)
- [Playwright crawler with block requests](https://crawlee.dev/python/docs/examples/playwright-crawler-with-block-requests.md)
- [Playwright crawler with Camoufox](https://crawlee.dev/python/docs/examples/playwright-crawler-with-camoufox.md)
- [Playwright crawler with fingerprint generator](https://crawlee.dev/python/docs/examples/playwright-crawler-with-fingerprint-generator.md)
- [Respect robots.txt file](https://crawlee.dev/python/docs/examples/respect-robots-txt-file.md)
- [Resuming a paused crawl](https://crawlee.dev/python/docs/examples/resuming-paused-crawl.md)
- [Run parallel crawlers](https://crawlee.dev/python/docs/examples/run-parallel-crawlers.md)
- [Using browser profile](https://crawlee.dev/python/docs/examples/using_browser_profile.md)
- [Using sitemap request loader](https://crawlee.dev/python/docs/examples/using-sitemap-request-loader.md)
- [Guides](https://crawlee.dev/python/docs/guides.md)
- [Adaptive Playwright crawler](https://crawlee.dev/python/docs/guides/adaptive-playwright-crawler.md)
- [Architecture overview](https://crawlee.dev/python/docs/guides/architecture-overview.md)
- [Avoid getting blocked](https://crawlee.dev/python/docs/guides/avoid-blocking.md)
- [Cookie management](https://crawlee.dev/python/docs/guides/cookie-management.md)
- [Creating web archive](https://crawlee.dev/python/docs/guides/creating-web-archive.md)
- [Error handling](https://crawlee.dev/python/docs/guides/error-handling.md)
- [Extending Crawlee](https://crawlee.dev/python/docs/guides/extending-crawlee.md)
- [HTTP clients](https://crawlee.dev/python/docs/guides/http-clients.md)
- [HTTP crawlers](https://crawlee.dev/python/docs/guides/http-crawlers.md)
- [HTTP headers](https://crawlee.dev/python/docs/guides/http-headers.md)
- [Logging in with a crawler](https://crawlee.dev/python/docs/guides/logging-in-with-a-crawler.md)
- [Playwright crawler](https://crawlee.dev/python/docs/guides/playwright-crawler.md)
- [Proxy management](https://crawlee.dev/python/docs/guides/proxy-management.md)
- [Pydantic AI crawler](https://crawlee.dev/python/docs/guides/pydantic-ai-crawler.md)
- [Request loaders](https://crawlee.dev/python/docs/guides/request-loaders.md)
- [Request router](https://crawlee.dev/python/docs/guides/request-router.md)
- [Request throttling](https://crawlee.dev/python/docs/guides/request-throttling.md)
- [Running in web server](https://crawlee.dev/python/docs/guides/running-in-web-server.md)
- [Scaling crawlers](https://crawlee.dev/python/docs/guides/scaling-crawlers.md)
- [Migrating from Scrapy](https://crawlee.dev/python/docs/guides/scrapy-migration.md)
- [Security of web scraping](https://crawlee.dev/python/docs/guides/security-of-web-scraping.md)
- [Service locator](https://crawlee.dev/python/docs/guides/service-locator.md)
- [Session management](https://crawlee.dev/python/docs/guides/session-management.md)
- [Stagehand crawler](https://crawlee.dev/python/docs/guides/stagehand-crawler.md)
- [Storage clients](https://crawlee.dev/python/docs/guides/storage-clients.md)
- [Storages](https://crawlee.dev/python/docs/guides/storages.md)
- [Trace and monitor crawlers](https://crawlee.dev/python/docs/guides/trace-and-monitor-crawlers.md)
- [Introduction](https://crawlee.dev/python/docs/introduction.md)
- [Adding more URLs](https://crawlee.dev/python/docs/introduction/adding-more-urls.md)
- [Crawling](https://crawlee.dev/python/docs/introduction/crawling.md)
- [Running your crawler in the Cloud](https://crawlee.dev/python/docs/introduction/deployment.md)
- [First crawler](https://crawlee.dev/python/docs/introduction/first-crawler.md)
- [Real-world project](https://crawlee.dev/python/docs/introduction/real-world-project.md)
- [Refactoring](https://crawlee.dev/python/docs/introduction/refactoring.md)
- [Saving data](https://crawlee.dev/python/docs/introduction/saving-data.md)
- [Scraping](https://crawlee.dev/python/docs/introduction/scraping.md)
- [Setting up](https://crawlee.dev/python/docs/introduction/setting-up.md)
- [Quick start](https://crawlee.dev/python/docs/quick-start.md)
- [Upgrading](https://crawlee.dev/python/docs/upgrading.md)
- [Upgrading to v0.x](https://crawlee.dev/python/docs/upgrading/upgrading-to-v0x.md)
- [Upgrading to v1](https://crawlee.dev/python/docs/upgrading/upgrading-to-v1.md)