Release Notes Heritrix 3.4.0 20200518 - internetarchive/heritrix3 GitHub Wiki

Summary of changes since Release Notes - Heritrix 3.4.0-20200304 - see the full changelog for more details.

Additions

• Add parsing for HTML tags (data-*) #323 (clawia)
• Add support for the SFTP protocol #320 (bnfleb)

This supports archiving over SFTP, but stored as a reponse record rather than the resource record that has been more widely used in the past. The next release will resolve this as per this pull request.

Changes

• don't youtubedl receivedFromAMQP #330 (galgeek)
• youtube-dl no cache dir #329 (galgeek)
• best medium-ish size #327 (galgeek)
• youtube-dl: request best medium-ish size format #325 (galgeek)

Removals

none

Bugfixes

• Add real crawlStatus in the crawlReport #326 (clawia)
• Fix match result is always false in MatchesListRegexDecideRule #328 (morokosi)