Skip to content
1 viewer

rust 1,961,941 · typescript 233,850 · javascript 141,145 · python 22,871 · 6,801 files · digest 6d882eacc8db · built in 12.5 s · crystals off

PoliteFetcher::robots_for

cre8_app_provider::adapters::legal::crawl::native::PoliteFetcher::robots_for

method · cre8-app-provider · crates/cre8-app-provider/src/adapters/legal/crawl.rs:283

25lines
6cyclomatic
1max nesting
8statements
0? exits
2params
1callers
7callees
0.6 (p55)call-graph weight

Crystal

no crystal was derived for this function

Call neighbourhood

Callers left, callees right, two hops each way (1 direct callers, 7 direct callees; the heaviest shown). Dashed edges are method calls resolved by name alone.

self · 1 siteself · 1 siteself · 1 siteself · 1 sitemethod · 1 siteself · 1 siteself · 1 sitename · 2 sitesmethod · 1 sitepath · 1 sitepath · 1 sitemethod · 2 sitesname · 1 siteself · 1 sitemethod · 1 sitename · 1 sitename · 1 siteref · 1 sitename · 1 sitemethod · 1 sitePoliteFetcher::get_with_hea…app-provider · cc 1cre8_app_provider::adapters::legal::crawl::native::PoliteFetcher::get_with_headersPoliteFetcher::admitapp-provider · cc 1cre8_app_provider::adapters::legal::crawl::native::PoliteFetcher::admitPoliteFetcher::permittedapp-provider · cc 6cre8_app_provider::adapters::legal::crawl::native::PoliteFetcher::permittedPoliteFetcher::robots_forapp-provider · cc 6cre8_app_provider::adapters::legal::crawl::native::PoliteFetcher::robots_forMutex::lock_or_recoverutil-lock-ext · cc 2cre8_util_lock_ext::Mutex::lock_or_recoverTimestamp::elapsedplatform-time · cc 1cre8_platform_time::Timestamp::elapsedRobotsRules::parseutil-legal-text · cc 21cre8_util_legal_text::robots::RobotsRules::parsePoliteFetcher::wait_for_hostapp-provider · cc 2cre8_app_provider::adapters::legal::crawl::native::PoliteFetcher::wait_for_hostRobotsRules::allow_allutil-legal-text · cc 1cre8_util_legal_text::robots::RobotsRules::allow_allPoliteFetcher::headersapp-provider · cc 1cre8_app_provider::adapters::legal::crawl::native::PoliteFetcher::headersrobots_cacheapp-provider · cc 1cre8_app_provider::adapters::legal::crawl::native::robots_cachewarn_onceutil-lock-ext · cc 3cre8_util_lock_ext::warn_onceTimestamp::elapsed_msplatform-time · cc 1cre8_platform_time::Timestamp::elapsed_msRobotsRules::is_allowedutil-legal-text · cc 8cre8_util_legal_text::robots::RobotsRules::is_allowedsplit_fused_directivesutil-legal-text · cc 5cre8_util_legal_text::robots::split_fused_directiveshost_slotsapp-provider · cc 1cre8_app_provider::adapters::legal::crawl::native::host_slotsvisit_windowutil-legal-text · cc 4cre8_util_legal_text::robots::visit_windowrequest_intervalutil-legal-text · cc 4cre8_util_legal_text::robots::request_interval

Control flow

Source not readable from this process.

Callers 1

Callees 7

Source not readable from this process.