[Bug] PDF Content Incorrectly Dumped into HTML/Markdown Fields During Web Craw

[Chippers255]

Describe the Bug
When crawling websites containing PDF files, the crawler is including the raw PDF contents in both HTML and markdown output fields. This causes performance issues by:

1. Significantly increasing response time when retrieving results
2. Taking up unnecessary storage space in the results database
3. Potentially making the results harder to parse and use effectively

To Reproduce

1. Run the crawl command on the target website containing PDF files (eg: https://becu.org/)
2. Observe the returned results in both HTML and markdown fields (eg: http://{HOST URL}/v1/crawl/{CRAWL ID})
3. Notice that PDF contents are being dumped as raw text into these fields

Screenshots

[skeptrunedev]

Damn, the bit of code that cleans up the HTML with needs a default exludeQuerySelector that removes these. I'll look into it soon'ish hopefully.