Getting Started with Regulatory AI: Library Search
September 4, 2024
HData Library Overview
The HData platform offers powerful capabilities for accessing millions of centralized regulatory documents. This article explains how information is organized in the HData Library, and the numerous ways to search for and locate the information you need.
The HData Library provides centralized access to fully-digitized file catalogs, including:
- FERC Dockets
- State Dockets
- FERC Reports
- Private Documents
Under Library > My Catalogs, you will see a list of catalogs included in your HData account. Library > More Catalogs lists data sources that are available from HData, but not subscribed to by your account administrator. Contact your account administrator or HData Customer Success Manager to discuss access to additional data sources.
Docket Catalog Structure
FERC and state docket catalogs generally follow the same structure across each information source and contain the following elements:
Table Display
This is the primary view on the home screen of each catalog. This view lists information about each docket or file visible in the display. The results in this display are narrowed as you enter searches for dockets or files you would like to view.
Dockets View
This view displays a list of individual dockets, proceedings, or accessions either by date, or that match your search criteria. Searches at the docket level return results based on the metadata associated with a docket, such as the docket's description or type. Clicking into the docket displays a list of all files associated with the docket.
Files View
This view displays a list of individual files either by date, or that match your search criteria. Searches at the File level look for your search criteria within file contents, as well as the file metadata, such as file title or name of the filer.
FERC Reports & Private Documents
Visit the Knowledge Base for additional information on the catalog structure for FERC Reports and Private Documents.
Searching Dockets & Files
Search Content Bar
In the Files view of each Library catalog, entering a term in the Search Content bar returns results for files that contain the term within the file itself, or within the metadata associated with the file. Metadata can include information such as the file title or the name of the filer.
For example, searching for transmission line siting in the Search Content bar will return files that contain the words transmission and line and siting in the same file, or in the metadata associated with the file. The single phrase transmission line siting does not have to appear for a search result to match, but all words must be present to return a result. This search is likely to find files that contain phrases including transmission line, transmission siting, and line siting.
This is a particularly useful way to search when:
- You want to return a broad set of relevant results
- You do not know exactly how the search term you’re looking for appears in all files
Note that in the Dockets, Proceedings, and Accessions views of each Library catalog, entering a word or phrase in the Search Content bar returns results based on metadata from Dockets, Proceedings, and Accessions. Searches at this level do not return results based on file contents.
Advanced Search
With Advanced Search, users have the option to refine search results to:
All of these exact words and/or phrases
This option is known as exact match and will only return results that match exactly what the user enters. For entries that contain multiple words, everything the user enters must appear in the order entered to return a search result. Variations of any term entered will not be returned in the search results. For example, a search for transmission line siting will only return results with this exact phrase where all words appear exactly in this order.
Any of these words and/or phrases
A search result will be returned when the presence of at least one of the words or phrases the user enters is present, but not all terms have to be present for a search result to match. For example, entering transmission and line and siting will return files that contain any of these terms. The files do not have to contain all of these terms.
If only a single term is entered, the search will look only for this term, treating it the same as a search for all of these exact words and/or phrases.
None of these words and/or phrases
This option allows the user to exclude specific words or phrases. Files and associated file metadata with the terms entered will be excluded from the search results.
Advanced Search is available for all HData Library catalogs. The various options for search can be used together, and catalog filters can also be used with Advanced Search options.
For example, a search could be entered where matching files:
- Must contain the phrase transmission line siting
- Also must include the phrase Arizona Public Service
- Also must contain the word oppose or the word opposition
- Must be filed between 1/1/22 and 8/31/24
This search returns 53 total results:
Operators
Operators is the technical term for using specific characters to define how a search should be performed. Typing in operators is not necessary to use Advanced Search, but the option is available for you to type operators directly into the Search Content bar. When you enter search terms into the Advanced Search module, you will also see in the Search Content bar how the search is being performed with the use of operators. The search can always be modified in the Advanced Search module.
Operator | Function |
Use of + | Means AND |
Use of | | Means OR |
Use of "keyword" | Means EXACT PHRASE |
Use of - | Means NOT (or EXCLUDE) |
Docket Number Search
All docket catalogs provide a Docket # search bar in the top of your view. This is the easiest way to locate a docket when you know precisely what you're looking for.
Filters
The More Filters option at the top of your catalog view provides many additional ways to refine your search. Filters work in conjunction with Content Search and Advanced Search options. These allow you to narrow search results to match specific criteria such as document type, filing entity, or filing date. Available filters in the HData platform are dependent on filters available from each regulatory body, therefore filters vary between docket catalogs.
Tags
User-defined tags provide a way to label and organize files based on the information that's important to you and your organization. Tags are available as a filter in all docket catalogs. These enable you to create your own taxonomy to filter and view files using custom criteria.