# FedReporter Data Access Bot

## Overview
This bot is used to programmatically retrieve publicly available data from the FFIEC National Information Center (https://www.ffiec.gov/npw) for internal research and analysis purposes.

## Purpose
The bot helps us:
- Collect public banking institution data
- Automate daily updates to internal dashboards
- Support regulatory/compliance research

## Operator Info
- Organization: Fed Reporter Inc.
- Maintained by: Greg Bartlett
- Contact: greg.bartlett@fedreporter.net

## Bot Behavior
- Access Frequency: TBD based on steps I need to take to pull the data.
- Robots.txt compliance: Yes, however, we are only pulling specific to files we need to automate downloading.

## User-Agent Strings

Our bot may use one of the following User-Agent headers, depending on context:

1. `FedReporterDataBot/1.0 (+https://fedreporter.net/FedReporterBotDocumentation; contact: support@fedreporter.net)`
   - Primary identifier
   - Used during scheduled daily data retrieval jobs

2. `FedReporterDataBot-Testing/0.1 (+https://dev-pipe1.fedreporter.net/FedReporterBotDocumentation; contact: support@fedreporter.net)`
   - Used for development and testing
   - Low frequency, off-peak hours only


## Technical Notes
- Requests only target publicly available data
- No CAPTCHAs or bypass methods used
- No commercial redistribution of data
- using Selenium WebDriver to gather data and/or the HttpClient to programatically use the Search and post formData 

## Respect for Site Terms
We are committed to respecting FFIEC’s terms of service and data access policies. If any issues arise, please contact us and we will promptly respond.