RFC 9536 | RDAP Reverse Search | April 2024 |
Loffredo & Martinelli | Standards Track | [Page] |
The Registration Data Access Protocol (RDAP) does not include query capabilities for finding the list of domains related to a set of entities matching a given search pattern. Considering that an RDAP entity can be associated with any defined object class and other relationships between RDAP object classes exist, a reverse search can be applied to other use cases besides the classic domain-entity scenario. This document describes an RDAP extension that allows servers to provide a reverse search feature based on the relationship defined in RDAP between an object class for search and any related object class. The reverse search based on the domain-entity relationship is treated as a particular case.¶
This is an Internet Standards Track document.¶
This document is a product of the Internet Engineering Task Force (IETF). It represents the consensus of the IETF community. It has received public review and has been approved for publication by the Internet Engineering Steering Group (IESG). Further information on Internet Standards is available in Section 2 of RFC 7841.¶
Information about the current status of this document, any errata, and how to provide feedback on it may be obtained at https://www.rfc-editor.org/info/rfc9536.¶
Copyright (c) 2024 IETF Trust and the persons identified as the document authors. All rights reserved.¶
This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (https://trustee.ietf.org/license-info) in effect on the date of publication of this document. Please review these documents carefully, as they describe your rights and restrictions with respect to this document. Code Components extracted from this document must include Revised BSD License text as described in Section 4.e of the Trust Legal Provisions and are provided without warranty as described in the Revised BSD License.¶
The protocol described in this specification aims to extend the RDAP query capabilities and response to enable reverse search based on the relationships defined in RDAP between an object class for search and a related object class. The reverse search based on the domain-entity relationship is treated as a particular case of such a generic model.¶
RDAP providers willing to implement this specification should carefully consider its implications on the efficiency (see Section 10), the security (see Section 13), and the compliance with privacy regulations (see Section 12) of their RDAP service.¶
Reverse WHOIS is a service provided by many web applications that allows users to find domain names owned by an individual or a company starting from the owner's details, such as name and email. Even if it has been considered useful for some legal purposes (e.g., uncovering trademark infringements and detecting cybercrimes), its availability as a standardized WHOIS [RFC3912] capability has been objected to for two main reasons, which now don't seem to conflict with an RDAP implementation.¶
The first objection concerns the potential risks of privacy violation. However, the domain name community is considering a new generation of Registration Directory Services [ICANN-RDS] [ICANN-RA] that provide access to sensitive data under some permissible purposes and in accordance with appropriate policies for requestor accreditation, authentication, and authorization. RDAP's reliance on HTTP means that it can make use of common HTTP-based approaches to authentication and authorization, making it more useful than WHOIS in the context of such directory services. Since RDAP consequently permits a reverse search implementation complying with privacy protection principles, this first objection is not well-founded.¶
The second objection to the implementation of a reverse search capability has been connected with its impact on server processing. However, the core RDAP specifications already define search queries, with similar processing requirements, so the basis of this objection is not clear.¶
Reverse searches, such as finding the list of domain names associated with contacts or nameservers, may be useful to registrars as well. Usually, registries adopt out-of-band solutions to provide results to registrars asking for reverse searches on their domains. Possible reasons for such requests are:¶
Currently, RDAP does not provide any means for a client to search for the collection of domains associated with an entity [RFC9082]. A query (lookup or search) on domains can return the array of entities related to a domain with different roles (registrant, registrar, administrative, technical, reseller, etc.), but the reverse operation is not allowed. Only reverse searches to find the collection of domains related to a nameserver (ldhName or ip) can be requested. Since an entity can be in relationship with any RDAP object [RFC9083], the availability of a reverse search as largely intended can be common to all the object classes allowed for search. Through a further step of generalization, the meaning of reverse search in the RDAP context can be extended to include any query for retrieving all the objects that relates to another query matching a given search pattern.¶
The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "NOT RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in BCP 14 [RFC2119] [RFC8174] when, and only when, they appear in all capitals, as shown here.¶
A generic reverse search path is described by the syntax:¶
{searchable-resource-type}/reverse_search/{related-resource-type}?<search-condition>¶
The path segments are defined as follows:¶
While related-resource-type is defined as having one of a number of different values, the only reverse searches defined in this document are for a related-resource-type of "entity". Reverse searches for the other resource types specified in [RFC9082] and resource type extensions may be defined by future documents.¶
Based on the content of Section 2, defining a reverse search means to define the triple <searchable resource type, related resource type, property> and the mapping with the corresponding RDAP object member. The mapping is done through the use of a JSONPath expression [RFC9535]. Reverse searches are registered in the "RDAP Reverse Search" registry (see Section 11.2.3), whereas reverse search mappings are registered in the "RDAP Reverse Search Mapping" registry (see Section 11.2.4). The reason for having two registries is that it may be possible for a single type of reverse search to rely on different members, depending on the server's configuration (see Section 5).¶
All of the reverse searches defined by this document (see Section 8) have property names that are the same as the name of the RDAP object member that is the subject of the search. For example, the reverse search with the property name "fn" relies on the value of the "fn" member inside the jCard of an entity object. However, it is not necessary that these two names be the same. In particular, remapping of searches as part of the deprecation of an existing member (see Section 5) will typically lead to a member with a different name being used for the search.¶
Servers MUST NOT provide or implement reverse searches or reverse search mappings that are not registered with IANA.¶
Servers complying with this specification MUST extend the help response [RFC9083] with the "reverse_search_properties" member that contains an array of objects with the following mandatory child members:¶
An example of the help response including the "reverse_search_properties" member is shown in Figure 2¶
To permit clients to determine the member used by the server for a reverse search, servers MUST detail the mapping that is occurring by adding the "reverse_search_properties_mapping" member to the topmost object of a reverse search response. This data structure is included in the search response, rather than in the help response, because it may differ depending on the query that is sent to the server.¶
Documents that deprecate or restructure RDAP responses such that a registered reverse search is no longer able to be used MUST either note that the relevant reverse search is no longer available (in the case of deprecation) or describe how to continue supporting the relevant search by adding another mapping for the reverse search property (in the case of restructuring).¶
The "reverse_search_properties_mapping" member contains an array of objects with the following mandatory child members:¶
The searchable and the related resource types are derived from the query, so there is no need to include them in addition to the property in this member.¶
This member MUST be included for all properties used in the search, regardless of whether that property has multiple registered mappings as at the time of the search, because new mappings may be registered at any time.¶
When applied to an object, the JSONPath expression MUST produce a list of values, each of which is a JSON number or string.¶
An example of a reverse search response including the "reverse_search_properties_mapping" member is shown in Figure 3.¶
Reverse search responses use the formats defined in Section 8 of [RFC9083], which correspond to the searchable resource types defined in Section 2.¶
To process a reverse search, the server returns the objects from its data store that are of type searchable-resource-type and that match each of the predicates from the search conditions. To determine whether an object matches a predicate, the server:¶
A search pattern matches a value where it equals the string representation of the value or where it is a match for the value in accordance with the partial string matching behavior defined in Section 4.1 of [RFC9082].¶
Objects are only included in the search results if they satisfy all included predicates. This includes predicates that are for the same property; in such a case, it is necessary for the related object to match against each of those predicates.¶
Servers MUST return an HTTP 501 (Not Implemented) [RFC9110] response to inform clients of unsupported reverse searches.¶
Based on their policy, servers MAY restrict how predicates are used to make a valid search condition by returning a 400 (Bad Request) response when a problematic request is received.¶
A given reverse search or reverse search mapping MAY define additional or alternative search behavior past that set out in this section.¶
Since an entity can be associated with any other object class in RDAP, the most common kind of reverse search is one based on an entity's details. Such reverse searches arise from the query model by setting the related resource type to "entity".¶
By selecting a specific searchable resource type, the resulting reverse search aims at retrieving all the objects (e.g., all the domains) that are related to any entity object matching the search conditions.¶
This section defines the reverse search properties servers SHOULD support for the domain, nameserver, entity-searchable resource types, and entity-related resource type:¶
The presence of a predicate on the reverse search property "role" means that the RDAP response property "roles" MUST contain at least the specified role.¶
The last two properties are related to jCard elements [RFC7095], but the field references are to vCard [RFC6350], since jCard is the JSON format for vCard.¶
Examples of reverse search paths based on the domain-entity relationship are presented in Figure 1.¶
An example of the help response including the supported reverse search properties is shown in Figure 2.¶
An example of a response including the mapping that is occurring for the first reverse search in Figure 1 is shown below.¶
Servers complying with this specification MUST include the value "reverse_search" in the rdapConformance property of the help response [RFC9083] and any other response including the "reverse_search_properties_mapping" member. The information needed to register this value in the "RDAP Extensions" registry is described in Section 11.1.¶
To limit the impact of processing the search predicates, servers are RECOMMENDED to make use of techniques to speed up the data retrieval in their underlying data store, such as indexes or similar. In addition, risks with respect to performance degradation or result set generation can be mitigated by adopting practices used for standard searches, e.g., restricting the search functionality, limiting the rate of search requests according to the user's authorization, truncating and paging the results [RFC8977], and returning partial responses [RFC8982].¶
IANA has registered the following value in the "RDAP Extensions" registry:¶
IANA has created the "RDAP Reverse Search" and "RDAP Reverse Search Mapping" registries within the "Registration Data Access Protocol (RDAP)" category in the protocol registries.¶
These registries follow the Specification Required registration policy, as defined in Section 4.6 of [RFC8126].¶
The designated expert should prevent collisions and confirm that suitable documentation, as described in Section 4.5 of [RFC8126], is available to ensure interoperability.¶
Creators of either new RDAP reverse searches or new mappings for registered reverse searches SHOULD NOT replicate functionality already available by way of other documents referenced in these registries. Creators MAY register additional reverse search mappings for existing properties, but they SHOULD NOT map a registered reverse search property to a response field with a meaning other than that of the response fields referenced by the mappings already registered for that property. In other words, all the mappings for a reverse search property MUST point to response fields with the same meaning.¶
Registration requests can be sent to <[email protected]>.¶
The combination of Searchable Resource Type, Related Resource Type, and Property MUST be unique across the registry entries.¶
IANA has registered the following entries in the "RDAP Reverse Search" registry. For all entries, the common values are shown in Table 1, whereas the specific values are shown in Table 2.¶
Registry Property | Value |
---|---|
Searchable Resource Type | domains, nameservers, entities |
Related Resource Type | entity |
Registrant | IETF |
Contact Information | [email protected] |
Reference | RFC 9536 |
Property | Description |
---|---|
fn | The server supports the domain/nameserver/entity search based on the full name (a.k.a. formatted name) of an associated entity |
handle | The server supports the domain/nameserver/entity search based on the handle of an associated entity |
The server supports the domain/nameserver/entity search based on the email address of an associated entity | |
role | The server supports the domain/nameserver/entity search based on the role of an associated entity |
The combination of Searchable Resource Type, Related Resource Type, Property, and Property Path MUST be unique across the registry entries.¶
IANA has registered the following entries in the "RDAP Reverse Search Mapping" registry. For all entries, the common values are the same as defined in the "RDAP Reverse Search" registry (see Table 1), whereas the specific values are shown below (see Table 3).¶
Property | Property Path |
---|---|
fn | $.entities[*].vcardArray[1][?(@[0]=='fn')][3] |
handle | $.entities[*].handle |
$.entities[*].vcardArray[1][?(@[0]=='email')][3] | |
role | $.entities[*].roles |
The search functionality defined in this document may affect the privacy of entities in the registry (and elsewhere) in various ways; see [RFC6973] for a general treatment of privacy in protocol specifications. Registry operators should be aware of the trade-offs that result from implementing this functionality.¶
Many jurisdictions have laws or regulations that restrict the use of "personal data", per the definition in [RFC6973]. Given that, registry operators should ascertain whether the regulatory environment in which they operate permits implementation of the functionality defined in this document.¶
In those cases where this functionality makes use of sensitive information, the information MUST only be accessible to authorized users under a lawful basis.¶
Since reverse search requests and responses could contain Personally Identifiable Information (PII), reverse search functionality MUST be available over HTTPS only.¶
Providing reverse search in RDAP carries the following threats as described in [RFC6973]:¶
Therefore, RDAP providers need to mitigate the risk of those threats by implementing appropriate measures supported by security services (see Section 13).¶
Security services that are required to provide controlled access to the operations specified in this document are described in [RFC7481]. A non-exhaustive list of access control paradigms an RDAP provider can implement is presented in Appendix A.¶
As an additional measure to enforce security by preventing reverse searches to be accessed from unauthorized users, the RDAP providers may consider physically separating the reverse search endpoints from the other ones by configuring a proxy routing the reverse searches to a dedicated backend server and leveraging further security services offered by other protocol layers, such as digital certificates and IP allow-listing.¶
Finally, the specification of the relationship within the reverse search path allows the RDAP servers to implement different authorization policies on a per-relationship basis.¶
Access control can be implemented according to different paradigms introducing increasingly stringent rules. The paradigms listed below leverage the capabilities that are either built in or provided as extensions by the OpenID Connect [OIDCC]:¶
With regard to the privacy threats reported in Section 12, correlation and disclosure can be mitigated by minimizing both the request features and the response data based on user roles (i.e., RBAC). Misuse can be mitigated by checking for the purpose of the request (i.e., PBAC). It can be accomplished according to the following approaches:¶
The two approaches can be used together:¶
The authors would like to acknowledge the following individuals for their contributions to this document: Francesco Donini, Scott Hollenbeck, Francisco Arias, Gustavo Lozano, Eduardo Alvarez, Ulrich Wisser, James Gould, and Pawel Kowalik.¶
Tom Harrison and Jasdip Singh provided relevant feedback and constant support to the implementation of this proposal. Their contributions have been greatly appreciated.¶