Package: rdomains 0.6.0

Gaurav Sood

rdomains: Get the Category of Content Hosted by a Domain

Fetch website content and classify it through the Python 'piedomains' text model. Look up domains in 'UT-Capitole', Steven Black, university, archived 'Shallalist' and 'DMOZ' lists, or use 'VirusTotal' <https://www.virustotal.com/>, 'OpenAI' and 'Anthropic' APIs. Report collection outcomes and source provenance. Includes a historical domain-name classifier trained on 'Shallalist' data.

Authors:Gaurav Sood [aut, cre]

rdomains_0.6.0.tar.gz
rdomains_0.6.0.zip(r-4.7-any)rdomains_0.6.0.zip(r-4.6-any)rdomains_0.6.0.zip(r-4.5-any)
rdomains_0.6.0.tgz(r-4.6-any)rdomains_0.6.0.tgz(r-4.5-any)
rdomains_0.6.0.tar.gz(r-4.7-any)rdomains_0.6.0.tar.gz(r-4.6-any)
rdomains_0.6.0.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION |NEWS
card.svg |card.png
rdomains/json (API)

# Install 'rdomains' in R:

install.packages('rdomains', repos = c('https://themains.r-universe.dev', 'https://cloud.r-project.org'))

Bug tracker:https://github.com/themains/rdomains/issues

Pkgdown/docs site:https://themains.github.io

On CRAN:

domain-classification machine-learning text-classification website-classification

6.25 score 59 stars 352 downloads 25 exports 57 dependencies

Last updated from:9cb9be476c. Checks:9 OK. Indexed: yes.

Target	Result	Time
linux-devel	OK	187
source / vignettes	OK	312
linux-release	OK	271
macos-release	OK	233
macos-oldrel	OK	233
windows-devel	OK	230
windows-release	OK	476
windows-oldrel	OK	266
wasm-release	OK	506

Exports:adult_name_probability cache_clear claude_cat collect_content dmoz_cat fetch_error_codes fetch_report get_dmoz_data get_shalla_data get_stevenblack_data get_ut1_data glm_shalla html_text_content news_url_signals openai_cat page_signals pie_cat rdomains_cache_dir shalla_cat source_vintage stevenblack_cat uni_cat ut1_cat virustotal_cat web_categories

Dependencies:AsioHeaders askpass backports bit bit64 checkmate cli clipr codetools cpp11 crayon curl dplyr foreach generics glmnet glue hms httr2 ipaddress iterators jsonlite lattice lifecycle magrittr Matrix openssl pillar pkgconfig prettyunits progress purrr R.methodsS3 R.oo R.utils R6 Rcpp RcppEigen readr rlang shape spiderbar stringi stringr survival sys tibble tidyselect triebeard tzdb urltools utf8 vctrs virustotal vroom withr xml2

Classify, compare, and resume

Preserve every membership | Preserve identifiers when resuming | Distinguish page state from content classification

Rendered fromrdomains.Rmdusingknitr::rmarkdown

Last update: 2026-10-27
Started: 2017-11-10

Citation

Development and contributors

Readme and manuals

Help Manual

Help page	Topics
rdomains: Classify Domains by their Content	rdomains-package rdomains
Probability that Domain Hosts Adult Content Based on features of Domain Name and Suffix alone.	adult_name_probability
Empty the page cache	cache_clear
Classification result contract	classification_results
Get Category from Anthropic Claude	claude_cat
Fetch homepage HTML and text for domains	collect_content
Get Category from DMOZ	dmoz_cat
Reasons a domain can fail to get a category	fetch_error_codes
Summarise the outcome of a fetch or classification run	fetch_report
Get DMOZ Data	get_dmoz_data
Get Shalla Data	get_shalla_data
Get Steven Black's Host List Data	get_stevenblack_data
Download the UT-Capitole blacklists	get_ut1_data
ML Model	glm_shalla
Extract text, title, description and language from HTML	html_text_content
Detect soft- and hard-news keywords in URLs	news_url_signals
Get Category from OpenAI	openai_cat
What kind of page is this?	page_signals
Classify fetched HTML with piedomains	pie_cat
A persistent cache directory for fetched pages	rdomains_cache_dir
Get Category from Shallalist	shalla_cat
Report what each category source is and when it was last published	source_vintage
Get Category from Steven Black's Host List	stevenblack_cat
Get Category from University Domain List	uni_cat
Get category from the UT-Capitole blacklists	ut1_cat
Get Category from VirusTotal	virustotal_cat
Default categories for domain-name inference	web_categories